[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:01:40 dist-test-slave-f0tn krb5kdc[12107](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:01:40 dist-test-slave-f0tn krb5kdc[12107](info): set up 2 sockets
Aug 12 00:01:40 dist-test-slave-f0tn krb5kdc[12107](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260812 00:01:41.188613 12089 mini_kdc.cc:121] Time spent starting KDC: real 1.194s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/krb5kdc/test-user.keytab.
Aug 12 00:01:41 dist-test-slave-f0tn krb5kdc[12107](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492901, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:01:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:01:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.206.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab.
Entry for principal kudu/127.11.206.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab.
I20260812 00:01:41.303299 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:38043
--webserver_interface=127.11.206.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab
--principal=kudu/127.11.206.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:35691
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.206.126:38043
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:01:41.416625 12140 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:01:41.416842 12140 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:01:41.416875 12140 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:01:41.418067 12140 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:01:41.418109 12140 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:01:41.418128 12140 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:01:41.418145 12140 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:01:41.418161 12140 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:01:41.419929 12140 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:35691
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.206.126:38043
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab
--principal=kudu/127.11.206.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:38043
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.206.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12140
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:01:41.420284 12140 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:01:41.420517 12140 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:01:41.426985 12149 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:01:41.426985 12147 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:01:41.427031 12140 server_base.cc:1034] running on GCE node
W20260812 00:01:41.426985 12151 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:01:41.427532 12140 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:01:41.429615 12140 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:01:41.430774 12140 hybrid_clock.cc:648] HybridClock initialized: now 1786492901430731 us; error 62 us; skew 500 ppm
Aug 12 00:01:41 dist-test-slave-f0tn krb5kdc[12107](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492901, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:01:41.433487 12140 init.cc:377] Logged in from keytab as kudu/127.11.206.126@KRBTEST.COM (short username kudu)
I20260812 00:01:41.433943 12140 webserver.cc:460] Webserver started at http://127.11.206.126:34039/ using document root <none> and password file <none>
I20260812 00:01:41.434248 12140 fs_manager.cc:359] Metadata directory not provided
I20260812 00:01:41.434307 12140 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:01:41.434449 12140 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:01:41.435734 12140 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/minicluster-data/master-0/data/instance:
uuid: "f41c3ba4af964566ae3d75091f78bc3d"
format_stamp: "Formatted at 2026-08-12 00:01:41 on dist-test-slave-f0tn"
server_key: "48e884d42d4d1ac75e6624b44e671d18"
server_key_iv: "29b0482482d81d117ea8f0f487536691"
server_key_version: "encryptionkey@0"
I20260812 00:01:41.436124 12140 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/minicluster-data/master-0/wal/instance:
uuid: "f41c3ba4af964566ae3d75091f78bc3d"
format_stamp: "Formatted at 2026-08-12 00:01:41 on dist-test-slave-f0tn"
server_key: "48e884d42d4d1ac75e6624b44e671d18"
server_key_iv: "29b0482482d81d117ea8f0f487536691"
server_key_version: "encryptionkey@0"
I20260812 00:01:41.438125 12140 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260812 00:01:41.439257 12168 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:41.439473 12140 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:01:41.439566 12140 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/minicluster-data/master-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/minicluster-data/master-0/wal
uuid: "f41c3ba4af964566ae3d75091f78bc3d"
format_stamp: "Formatted at 2026-08-12 00:01:41 on dist-test-slave-f0tn"
server_key: "48e884d42d4d1ac75e6624b44e671d18"
server_key_iv: "29b0482482d81d117ea8f0f487536691"
server_key_version: "encryptionkey@0"
I20260812 00:01:41.439637 12140 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:01:41.463743 12140 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:01:41.465559 12140 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:01:41.465711 12140 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:01:41.474270 12140 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.126:38043
I20260812 00:01:41.474325 12280 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.126:38043 every 8 connection(s)
I20260812 00:01:41.474726 12140 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
I20260812 00:01:41.478711 12281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:01:41.479627 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 12140
I20260812 00:01:41.479728 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/minicluster-data/master-0/wal/instance
I20260812 00:01:41.480337 12089 external_mini_cluster.cc:1428] Setting key 62c2aefe076730ed744c0e9e644d3732
I20260812 00:01:41.484287 12281 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f41c3ba4af964566ae3d75091f78bc3d: Bootstrap starting.
I20260812 00:01:41.485512 12281 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f41c3ba4af964566ae3d75091f78bc3d: Neither blocks nor log segments found. Creating new log.
I20260812 00:01:41.486045 12281 log.cc:824] T 00000000000000000000000000000000 P f41c3ba4af964566ae3d75091f78bc3d: Log is configured to *not* fsync() on all Append() calls
I20260812 00:01:41.487797 12281 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f41c3ba4af964566ae3d75091f78bc3d: No bootstrap required, opened a new log
I20260812 00:01:41.490731 12281 raft_consensus.cc:348] T 00000000000000000000000000000000 P f41c3ba4af964566ae3d75091f78bc3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f41c3ba4af964566ae3d75091f78bc3d" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 38043 } }
I20260812 00:01:41.491003 12281 raft_consensus.cc:374] T 00000000000000000000000000000000 P f41c3ba4af964566ae3d75091f78bc3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:01:41.491084 12281 raft_consensus.cc:729] T 00000000000000000000000000000000 P f41c3ba4af964566ae3d75091f78bc3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f41c3ba4af964566ae3d75091f78bc3d, State: Initialized, Role: FOLLOWER
I20260812 00:01:41.491268 12281 consensus_queue.cc:260] T 00000000000000000000000000000000 P f41c3ba4af964566ae3d75091f78bc3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f41c3ba4af964566ae3d75091f78bc3d" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 38043 } }
I20260812 00:01:41.491374 12281 raft_consensus.cc:388] T 00000000000000000000000000000000 P f41c3ba4af964566ae3d75091f78bc3d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:01:41.491410 12281 raft_consensus.cc:482] T 00000000000000000000000000000000 P f41c3ba4af964566ae3d75091f78bc3d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:01:41.491473 12281 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f41c3ba4af964566ae3d75091f78bc3d [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:01:41.492102 12281 raft_consensus.cc:504] T 00000000000000000000000000000000 P f41c3ba4af964566ae3d75091f78bc3d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f41c3ba4af964566ae3d75091f78bc3d" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 38043 } }
I20260812 00:01:41.492197 12281 leader_election.cc:302] T 00000000000000000000000000000000 P f41c3ba4af964566ae3d75091f78bc3d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f41c3ba4af964566ae3d75091f78bc3d; no voters:
I20260812 00:01:41.492360 12281 leader_election.cc:288] T 00000000000000000000000000000000 P f41c3ba4af964566ae3d75091f78bc3d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:01:41.492406 12286 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f41c3ba4af964566ae3d75091f78bc3d [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:01:41.492573 12286 raft_consensus.cc:686] T 00000000000000000000000000000000 P f41c3ba4af964566ae3d75091f78bc3d [term 1 LEADER]: Becoming Leader. State: Replica: f41c3ba4af964566ae3d75091f78bc3d, State: Running, Role: LEADER
I20260812 00:01:41.492719 12286 consensus_queue.cc:237] T 00000000000000000000000000000000 P f41c3ba4af964566ae3d75091f78bc3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f41c3ba4af964566ae3d75091f78bc3d" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 38043 } }
I20260812 00:01:41.492872 12281 sys_catalog.cc:564] T 00000000000000000000000000000000 P f41c3ba4af964566ae3d75091f78bc3d [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:01:41.493058 12286 sys_catalog.cc:455] T 00000000000000000000000000000000 P f41c3ba4af964566ae3d75091f78bc3d [sys.catalog]: SysCatalogTable state changed. Reason: New leader f41c3ba4af964566ae3d75091f78bc3d. Latest consensus state: current_term: 1 leader_uuid: "f41c3ba4af964566ae3d75091f78bc3d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f41c3ba4af964566ae3d75091f78bc3d" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 38043 } } }
I20260812 00:01:41.493292 12286 sys_catalog.cc:458] T 00000000000000000000000000000000 P f41c3ba4af964566ae3d75091f78bc3d [sys.catalog]: This master's current role is: LEADER
I20260812 00:01:41.493230 12290 sys_catalog.cc:455] T 00000000000000000000000000000000 P f41c3ba4af964566ae3d75091f78bc3d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f41c3ba4af964566ae3d75091f78bc3d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f41c3ba4af964566ae3d75091f78bc3d" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 38043 } } }
Aug 12 00:01:41 dist-test-slave-f0tn krb5kdc[12107](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492901, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:01:41.493584 12290 sys_catalog.cc:458] T 00000000000000000000000000000000 P f41c3ba4af964566ae3d75091f78bc3d [sys.catalog]: This master's current role is: LEADER
I20260812 00:01:41.494119 12294 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:01:41.495211 12294 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:01:41.497728 12294 catalog_manager.cc:1347] Generated new cluster ID: 4c7909353bc04b1086211f3b75891289
I20260812 00:01:41.497785 12294 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:01:41.498636 12283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:41.482555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52852 (local address 127.11.206.126:38043)
0812 00:01:41.482794 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:41.482806 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:41.483032 (+ 226us) server_negotiation.cc:407] Connection header received
0812 00:01:41.485704 (+ 2672us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:41.485714 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:41.485779 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:41.485912 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:01:41.487639 (+ 1727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:41.488670 (+ 1031us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:41.489766 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:41.490204 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:41.490316 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:41.494479 (+ 4163us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:01:41.494483 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:01:41.494483 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:01:41.494494 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:01:41.496550 (+ 2056us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:41.497035 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:41.497038 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:41.497039 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:41.497164 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:41.497481 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:41.497482 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:41.497483 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:41.497793 (+ 310us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:01:41.497917 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:41.498258 (+ 341us) server_negotiation.cc:299] Negotiation successful
0812 00:01:41.498386 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":179,"thread_start_us":84,"threads_started":1}
I20260812 00:01:41.512861 12294 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:01:41.513675 12294 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:01:41.515821 12294 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f41c3ba4af964566ae3d75091f78bc3d: Generated new TSK 0
I20260812 00:01:41.515990 12294 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.206.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.65.keytab.
Entry for principal kudu/127.11.206.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.65.keytab.
I20260812 00:01:41.542536 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.65:0
--local_ip_for_outbound_sockets=127.11.206.65
--webserver_interface=127.11.206.65
--webserver_port=0
--tserver_master_addrs=127.11.206.126:38043
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.65.keytab
--principal=kudu/127.11.206.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:35691
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:01:41.647708 12323 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:01:41.647945 12323 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:01:41.647975 12323 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:01:41.649302 12323 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:01:41.649356 12323 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:01:41.649422 12323 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.65
I20260812 00:01:41.651218 12323 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:35691
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.65.keytab
--principal=kudu/127.11.206.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.206.65
--webserver_port=0
--tserver_master_addrs=127.11.206.126:38043
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12323
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.65
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:01:41.651598 12323 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:01:41.651852 12323 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:01:41.660332 12328 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:01:41.660302 12331 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:01:41.660656 12335 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:01:41.660858 12323 server_base.cc:1034] running on GCE node
I20260812 00:01:41.661140 12323 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:01:41.661453 12323 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:01:41.662621 12323 hybrid_clock.cc:648] HybridClock initialized: now 1786492901662594 us; error 45 us; skew 500 ppm
Aug 12 00:01:41 dist-test-slave-f0tn krb5kdc[12107](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492901, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:01:41.666435 12323 init.cc:377] Logged in from keytab as kudu/127.11.206.65@KRBTEST.COM (short username kudu)
I20260812 00:01:41.666988 12323 webserver.cc:460] Webserver started at http://127.11.206.65:45795/ using document root <none> and password file <none>
I20260812 00:01:41.667233 12323 fs_manager.cc:359] Metadata directory not provided
I20260812 00:01:41.667286 12323 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:01:41.667423 12323 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:01:41.668710 12323 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/minicluster-data/ts-0/data/instance:
uuid: "5acefc0c82074fa1afd1199e79e5129f"
format_stamp: "Formatted at 2026-08-12 00:01:41 on dist-test-slave-f0tn"
server_key: "5d1c9a695061bb53ebf194e36c08f002"
server_key_iv: "0e8d064841430b2c4b2877bba664bc82"
server_key_version: "encryptionkey@0"
I20260812 00:01:41.669114 12323 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/minicluster-data/ts-0/wal/instance:
uuid: "5acefc0c82074fa1afd1199e79e5129f"
format_stamp: "Formatted at 2026-08-12 00:01:41 on dist-test-slave-f0tn"
server_key: "5d1c9a695061bb53ebf194e36c08f002"
server_key_iv: "0e8d064841430b2c4b2877bba664bc82"
server_key_version: "encryptionkey@0"
I20260812 00:01:41.670616 12323 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260812 00:01:41.671363 12348 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:41.671566 12323 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260812 00:01:41.671665 12323 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/minicluster-data/ts-0/wal
uuid: "5acefc0c82074fa1afd1199e79e5129f"
format_stamp: "Formatted at 2026-08-12 00:01:41 on dist-test-slave-f0tn"
server_key: "5d1c9a695061bb53ebf194e36c08f002"
server_key_iv: "0e8d064841430b2c4b2877bba664bc82"
server_key_version: "encryptionkey@0"
I20260812 00:01:41.671741 12323 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:01:41.688037 12323 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:01:41.690793 12323 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:01:41.691017 12323 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:01:41.692353 12323 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:01:41.692744 12323 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:01:41.692787 12323 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:41.692814 12323 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:01:41.692834 12323 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:41.704707 12323 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.65:44793
I20260812 00:01:41.704882 12560 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.65:44793 every 8 connection(s)
I20260812 00:01:41.705121 12323 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
I20260812 00:01:41.708635 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 12323
I20260812 00:01:41.708726 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/minicluster-data/ts-0/wal/instance
I20260812 00:01:41.709053 12089 external_mini_cluster.cc:1428] Setting key 7736b0437a4b9179c1dbbec94622da28
Aug 12 00:01:41 dist-test-slave-f0tn krb5kdc[12107](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492901, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.65@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:01:41.715770 12283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:41.706056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.65:32969 (local address 127.11.206.126:38043)
0812 00:01:41.706120 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:41.706122 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:41.706552 (+ 430us) server_negotiation.cc:407] Connection header received
0812 00:01:41.707224 (+ 672us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:41.707225 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:41.707235 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:41.707292 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:01:41.708594 (+ 1302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:41.709228 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:41.710430 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:41.710651 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:41.710708 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:41.713140 (+ 2432us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:01:41.713142 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:01:41.713142 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:01:41.713151 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:01:41.714480 (+ 1329us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:41.714868 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:41.714869 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:41.714870 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:41.714922 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:41.715150 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:41.715151 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:41.715152 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:41.715262 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:01:41.715316 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:41.715586 (+ 270us) server_negotiation.cc:299] Negotiation successful
0812 00:01:41.715678 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260812 00:01:41.716006 12565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:41.706027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:38043 (local address 127.11.206.65:32969)
0812 00:01:41.706346 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0812 00:01:41.706386 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 00:01:41.707140 (+ 754us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:01:41.707352 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:01:41.707355 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:01:41.708131 (+ 776us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:01:41.708493 (+ 362us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:41.708500 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:41.709310 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:41.709311 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:41.710350 (+ 1039us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:41.710353 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:41.710722 (+ 369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:41.710723 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:41.710888 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:41.711466 (+ 578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:01:41.711474 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:01:41.713045 (+ 1571us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:01:41.714573 (+ 1528us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:01:41.714580 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:01:41.714582 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:01:41.714800 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:01:41.714979 (+ 179us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:01:41.714980 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:01:41.714980 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:01:41.715092 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:01:41.715319 (+ 227us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:01:41.715326 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:01:41.715466 (+ 140us) client_negotiation.cc:769] Sending connection context
0812 00:01:41.715563 (+ 97us) client_negotiation.cc:240] Negotiation successful
0812 00:01:41.715724 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":261,"thread_start_us":182,"threads_started":1}
I20260812 00:01:41.716568 12562 heartbeater.cc:347] Connected to a master server at 127.11.206.126:38043
I20260812 00:01:41.716679 12562 heartbeater.cc:464] Registering TS with master...
I20260812 00:01:41.716872 12562 heartbeater.cc:511] Master 127.11.206.126:38043 requested a full tablet report, sending...
I20260812 00:01:41.717797 12209 ts_manager.cc:194] Registered new tserver with Master: 5acefc0c82074fa1afd1199e79e5129f (127.11.206.65:44793)
WARNING: no policy specified for kudu/127.11.206.66@KRBTEST.COM; defaulting to no policy
I20260812 00:01:41.718863 12209 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.206.65@KRBTEST.COM'} at 127.11.206.65:32969
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.66.keytab.
Entry for principal kudu/127.11.206.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.66.keytab.
I20260812 00:01:41.734397 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.66:0
--local_ip_for_outbound_sockets=127.11.206.66
--webserver_interface=127.11.206.66
--webserver_port=0
--tserver_master_addrs=127.11.206.126:38043
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.66.keytab
--principal=kudu/127.11.206.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:35691
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:01:41.851820 12569 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:01:41.852051 12569 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:01:41.852087 12569 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:01:41.853353 12569 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:01:41.853435 12569 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:01:41.853470 12569 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.66
I20260812 00:01:41.855052 12569 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:35691
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.66.keytab
--principal=kudu/127.11.206.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.206.66
--webserver_port=0
--tserver_master_addrs=127.11.206.126:38043
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12569
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.66
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:01:41.855259 12569 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:01:41.855448 12569 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:01:41.861575 12581 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:01:41.861577 12579 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:01:41.861691 12577 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:01:41.861956 12569 server_base.cc:1034] running on GCE node
I20260812 00:01:41.862182 12569 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:01:41.862433 12569 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:01:41.863593 12569 hybrid_clock.cc:648] HybridClock initialized: now 1786492901863581 us; error 31 us; skew 500 ppm
Aug 12 00:01:41 dist-test-slave-f0tn krb5kdc[12107](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492901, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:01:41.866673 12569 init.cc:377] Logged in from keytab as kudu/127.11.206.66@KRBTEST.COM (short username kudu)
I20260812 00:01:41.867133 12569 webserver.cc:460] Webserver started at http://127.11.206.66:41797/ using document root <none> and password file <none>
I20260812 00:01:41.867345 12569 fs_manager.cc:359] Metadata directory not provided
I20260812 00:01:41.867385 12569 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:01:41.867484 12569 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:01:41.868564 12569 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/minicluster-data/ts-1/data/instance:
uuid: "53a23c465f554e0eb77ba61510b3745d"
format_stamp: "Formatted at 2026-08-12 00:01:41 on dist-test-slave-f0tn"
server_key: "424c824ec61b60d29eeb61d11801892e"
server_key_iv: "091d08f9c2dd25cef0e2a0e7873dafce"
server_key_version: "encryptionkey@0"
I20260812 00:01:41.868875 12569 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/minicluster-data/ts-1/wal/instance:
uuid: "53a23c465f554e0eb77ba61510b3745d"
format_stamp: "Formatted at 2026-08-12 00:01:41 on dist-test-slave-f0tn"
server_key: "424c824ec61b60d29eeb61d11801892e"
server_key_iv: "091d08f9c2dd25cef0e2a0e7873dafce"
server_key_version: "encryptionkey@0"
I20260812 00:01:41.870213 12569 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260812 00:01:41.870870 12595 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:41.871021 12569 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:41.871110 12569 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/minicluster-data/ts-1/wal
uuid: "53a23c465f554e0eb77ba61510b3745d"
format_stamp: "Formatted at 2026-08-12 00:01:41 on dist-test-slave-f0tn"
server_key: "424c824ec61b60d29eeb61d11801892e"
server_key_iv: "091d08f9c2dd25cef0e2a0e7873dafce"
server_key_version: "encryptionkey@0"
I20260812 00:01:41.871171 12569 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:01:41.896145 12569 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:01:41.898887 12569 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:01:41.899093 12569 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:01:41.899458 12569 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:01:41.899818 12569 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:01:41.899858 12569 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:41.899892 12569 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:01:41.899921 12569 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:41.912873 12569 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.66:32977
I20260812 00:01:41.913105 12814 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.66:32977 every 8 connection(s)
I20260812 00:01:41.913324 12569 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
Aug 12 00:01:41 dist-test-slave-f0tn krb5kdc[12107](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492901, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.66@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:01:41.920485 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 12569
I20260812 00:01:41.920581 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/minicluster-data/ts-1/wal/instance
I20260812 00:01:41.920753 12089 external_mini_cluster.cc:1428] Setting key 6866a864ec314af8b4c14bfb322ba304
I20260812 00:01:41.922710 12283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:41.914164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.66:42267 (local address 127.11.206.126:38043)
0812 00:01:41.914223 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:41.914225 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:41.914500 (+ 275us) server_negotiation.cc:407] Connection header received
0812 00:01:41.915034 (+ 534us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:41.915035 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:41.915047 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:41.915097 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:01:41.916090 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:41.916601 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:41.917630 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:41.917827 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:41.917883 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:41.919995 (+ 2112us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:01:41.919997 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:01:41.919997 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:01:41.920004 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:01:41.921396 (+ 1392us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:41.921788 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:41.921789 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:41.921789 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:41.921844 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:41.922061 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:41.922062 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:41.922062 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:41.922205 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:01:41.922262 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:41.922535 (+ 273us) server_negotiation.cc:299] Negotiation successful
0812 00:01:41.922621 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260812 00:01:41.922957 12818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:41.914146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:38043 (local address 127.11.206.66:42267)
0812 00:01:41.914377 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0812 00:01:41.914416 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 00:01:41.914932 (+ 516us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:01:41.915185 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:01:41.915189 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:01:41.915786 (+ 597us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:01:41.915987 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:41.915992 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:41.916687 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:41.916688 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:41.917542 (+ 854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:41.917545 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:41.917894 (+ 349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:41.917895 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:41.918020 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:41.918489 (+ 469us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:01:41.918496 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:01:41.919898 (+ 1402us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:01:41.921471 (+ 1573us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:01:41.921478 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:01:41.921480 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:01:41.921694 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:01:41.921901 (+ 207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:01:41.921902 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:01:41.921902 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:01:41.922005 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:01:41.922281 (+ 276us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:01:41.922288 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:01:41.922413 (+ 125us) client_negotiation.cc:769] Sending connection context
0812 00:01:41.922502 (+ 89us) client_negotiation.cc:240] Negotiation successful
0812 00:01:41.922661 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":153,"threads_started":1}
I20260812 00:01:41.923437 12816 heartbeater.cc:347] Connected to a master server at 127.11.206.126:38043
I20260812 00:01:41.923533 12816 heartbeater.cc:464] Registering TS with master...
I20260812 00:01:41.923709 12816 heartbeater.cc:511] Master 127.11.206.126:38043 requested a full tablet report, sending...
I20260812 00:01:41.924108 12209 ts_manager.cc:194] Registered new tserver with Master: 53a23c465f554e0eb77ba61510b3745d (127.11.206.66:32977)
I20260812 00:01:41.924472 12209 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.206.66@KRBTEST.COM'} at 127.11.206.66:42267
WARNING: no policy specified for kudu/127.11.206.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.67.keytab.
Entry for principal kudu/127.11.206.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.67.keytab.
I20260812 00:01:41.948089 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.67:0
--local_ip_for_outbound_sockets=127.11.206.67
--webserver_interface=127.11.206.67
--webserver_port=0
--tserver_master_addrs=127.11.206.126:38043
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.67.keytab
--principal=kudu/127.11.206.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:35691
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:01:42.063267 12824 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:01:42.063486 12824 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:01:42.063520 12824 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:01:42.064718 12824 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:01:42.064759 12824 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:01:42.064795 12824 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.67
I20260812 00:01:42.066394 12824 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:35691
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.67.keytab
--principal=kudu/127.11.206.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.206.67
--webserver_port=0
--tserver_master_addrs=127.11.206.126:38043
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12824
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.67
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:01:42.066640 12824 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:01:42.066847 12824 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:01:42.072417 12838 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:01:42.072503 12832 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:01:42.072634 12829 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:01:42.072646 12824 server_base.cc:1034] running on GCE node
I20260812 00:01:42.072867 12824 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:01:42.073084 12824 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:01:42.074237 12824 hybrid_clock.cc:648] HybridClock initialized: now 1786492902074222 us; error 38 us; skew 500 ppm
Aug 12 00:01:42 dist-test-slave-f0tn krb5kdc[12107](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492902, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:01:42.076910 12824 init.cc:377] Logged in from keytab as kudu/127.11.206.67@KRBTEST.COM (short username kudu)
I20260812 00:01:42.077365 12824 webserver.cc:460] Webserver started at http://127.11.206.67:45813/ using document root <none> and password file <none>
I20260812 00:01:42.077615 12824 fs_manager.cc:359] Metadata directory not provided
I20260812 00:01:42.077657 12824 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:01:42.077783 12824 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:01:42.078939 12824 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/minicluster-data/ts-2/data/instance:
uuid: "ef89078e949344038ca9d281c7e11ea5"
format_stamp: "Formatted at 2026-08-12 00:01:42 on dist-test-slave-f0tn"
server_key: "7a04b66662cc88121c78e3ea8a63a6c8"
server_key_iv: "76bef708868a33f7f53eab0c82378a66"
server_key_version: "encryptionkey@0"
I20260812 00:01:42.079329 12824 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/minicluster-data/ts-2/wal/instance:
uuid: "ef89078e949344038ca9d281c7e11ea5"
format_stamp: "Formatted at 2026-08-12 00:01:42 on dist-test-slave-f0tn"
server_key: "7a04b66662cc88121c78e3ea8a63a6c8"
server_key_iv: "76bef708868a33f7f53eab0c82378a66"
server_key_version: "encryptionkey@0"
I20260812 00:01:42.080617 12824 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 00:01:42.081346 12851 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:42.081530 12824 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 00:01:42.081619 12824 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/minicluster-data/ts-2/wal
uuid: "ef89078e949344038ca9d281c7e11ea5"
format_stamp: "Formatted at 2026-08-12 00:01:42 on dist-test-slave-f0tn"
server_key: "7a04b66662cc88121c78e3ea8a63a6c8"
server_key_iv: "76bef708868a33f7f53eab0c82378a66"
server_key_version: "encryptionkey@0"
I20260812 00:01:42.081674 12824 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:01:42.089630 12824 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:01:42.091588 12824 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:01:42.091701 12824 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:01:42.091985 12824 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:01:42.092360 12824 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:01:42.092397 12824 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:42.092418 12824 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:01:42.092430 12824 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:42.102209 12824 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.67:40443
I20260812 00:01:42.102337 13050 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.67:40443 every 8 connection(s)
I20260812 00:01:42.102591 12824 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
I20260812 00:01:42.103739 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 12824
I20260812 00:01:42.103807 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786492899949492-12089-0/minicluster-data/ts-2/wal/instance
I20260812 00:01:42.103943 12089 external_mini_cluster.cc:1428] Setting key 502e9c4c48e6a2383652c9c0a0498ce2
Aug 12 00:01:42 dist-test-slave-f0tn krb5kdc[12107](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492902, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.67@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:01:42.111925 12283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:42.103335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.67:58081 (local address 127.11.206.126:38043)
0812 00:01:42.103387 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:42.103389 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:42.103633 (+ 244us) server_negotiation.cc:407] Connection header received
0812 00:01:42.104345 (+ 712us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:42.104346 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:42.104359 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:42.104411 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:01:42.105414 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:42.105933 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:42.106984 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:42.107179 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:42.107234 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:42.109480 (+ 2246us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:01:42.109481 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:01:42.109482 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:01:42.109489 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:01:42.110694 (+ 1205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:42.111065 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:42.111066 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:42.111066 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:42.111119 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:42.111331 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:42.111331 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:42.111331 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:42.111442 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:01:42.111496 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:42.111755 (+ 259us) server_negotiation.cc:299] Negotiation successful
0812 00:01:42.111833 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260812 00:01:42.112107 13054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:42.103311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:38043 (local address 127.11.206.67:58081)
0812 00:01:42.103501 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0812 00:01:42.103537 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0812 00:01:42.104239 (+ 702us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:01:42.104498 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:01:42.104502 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:01:42.105107 (+ 605us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:01:42.105316 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:42.105321 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:42.106015 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:42.106016 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:42.106896 (+ 880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:42.106899 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:42.107248 (+ 349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:42.107249 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:42.107428 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:42.107960 (+ 532us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:01:42.107969 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:01:42.109371 (+ 1402us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:01:42.110772 (+ 1401us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:01:42.110779 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:01:42.110781 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:01:42.111000 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:01:42.111174 (+ 174us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:01:42.111175 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:01:42.111176 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:01:42.111275 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:01:42.111495 (+ 220us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:01:42.111502 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:01:42.111638 (+ 136us) client_negotiation.cc:769] Sending connection context
0812 00:01:42.111728 (+ 90us) client_negotiation.cc:240] Negotiation successful
0812 00:01:42.111883 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":89,"threads_started":1}
I20260812 00:01:42.112514 13051 heartbeater.cc:347] Connected to a master server at 127.11.206.126:38043
I20260812 00:01:42.112609 13051 heartbeater.cc:464] Registering TS with master...
I20260812 00:01:42.112803 13051 heartbeater.cc:511] Master 127.11.206.126:38043 requested a full tablet report, sending...
I20260812 00:01:42.113222 12209 ts_manager.cc:194] Registered new tserver with Master: ef89078e949344038ca9d281c7e11ea5 (127.11.206.67:40443)
I20260812 00:01:42.113637 12209 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.206.67@KRBTEST.COM'} at 127.11.206.67:58081
I20260812 00:01:42.115964 12089 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 00:01:42 dist-test-slave-f0tn krb5kdc[12107](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492902, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 00:01:42 dist-test-slave-f0tn krb5kdc[12107](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492902, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.11.206.65@KRBTEST.COM
I20260812 00:01:42.140615 13061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:42.132637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44552 (local address 127.11.206.65:44793)
0812 00:01:42.132850 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:42.132855 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:42.132867 (+ 12us) server_negotiation.cc:407] Connection header received
0812 00:01:42.132894 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:42.132896 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:42.132910 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:42.132980 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:01:42.133659 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:42.134422 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:42.135227 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:42.135544 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:42.135600 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:42.138013 (+ 2413us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:01:42.138023 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:01:42.138023 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:01:42.138030 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:01:42.139442 (+ 1412us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:42.139827 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:42.139830 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:42.139830 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:42.139891 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:42.140065 (+ 174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:42.140065 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:42.140066 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:42.140206 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:01:42.140344 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:42.140384 (+ 40us) server_negotiation.cc:299] Negotiation successful
0812 00:01:42.140450 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":176,"thread_start_us":136,"threads_started":1}
W20260812 00:01:42.141110 12402 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44552
Aug 12 00:01:42 dist-test-slave-f0tn krb5kdc[12107](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492902, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 00:01:42 dist-test-slave-f0tn krb5kdc[12107](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492902, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.206.65@KRBTEST.COM
I20260812 00:01:42.164758 13061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:42.157642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44568 (local address 127.11.206.65:44793)
0812 00:01:42.157706 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:42.157708 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:42.157791 (+ 83us) server_negotiation.cc:407] Connection header received
0812 00:01:42.157851 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:42.157852 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:42.157861 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:42.157910 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:01:42.158474 (+ 564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:42.158985 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:42.159873 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:42.160084 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:42.160139 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:42.162534 (+ 2395us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:01:42.162535 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:01:42.162536 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:01:42.162543 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:01:42.163830 (+ 1287us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:42.164172 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:42.164173 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:42.164173 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:42.164219 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:42.164372 (+ 153us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:42.164372 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:42.164372 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:42.164459 (+ 87us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:01:42.164543 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:42.164624 (+ 81us) server_negotiation.cc:299] Negotiation successful
0812 00:01:42.164687 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260812 00:01:42.165305 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 12323
I20260812 00:01:42.180456 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 12569
I20260812 00:01:42.200477 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 12824
I20260812 00:01:42.216866 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 12140
2026-08-12T00:01:42Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2266 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:01:42 dist-test-slave-f0tn krb5kdc[13070](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:01:42 dist-test-slave-f0tn krb5kdc[13070](info): set up 2 sockets
Aug 12 00:01:42 dist-test-slave-f0tn krb5kdc[13070](info): commencing operation
krb5kdc: starting...
W20260812 00:01:43.423358 12089 mini_kdc.cc:121] Time spent starting KDC: real 1.168s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/krb5kdc/test-user.keytab.
Aug 12 00:01:43 dist-test-slave-f0tn krb5kdc[13070](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492903, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:01:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:01:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.206.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab.
Entry for principal kudu/127.11.206.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab.
I20260812 00:01:43.540627 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:38775
--webserver_interface=127.11.206.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab
--principal=kudu/127.11.206.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:38153
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.206.126:38775
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:01:43.623338 13088 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:01:43.623554 13088 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:01:43.623576 13088 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:01:43.624715 13088 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:01:43.624760 13088 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:01:43.624773 13088 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:01:43.624785 13088 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:01:43.624807 13088 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:01:43.626379 13088 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:38153
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.206.126:38775
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab
--principal=kudu/127.11.206.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:38775
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.206.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13088
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:01:43.626631 13088 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:01:43.626981 13088 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:01:43.632031 13094 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:01:43.632018 13097 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:01:43.632000 13095 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:01:43.632143 13088 server_base.cc:1034] running on GCE node
I20260812 00:01:43.632450 13088 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:01:43.632750 13088 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:01:43.633890 13088 hybrid_clock.cc:648] HybridClock initialized: now 1786492903633876 us; error 29 us; skew 500 ppm
Aug 12 00:01:43 dist-test-slave-f0tn krb5kdc[13070](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492903, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:01:43.643862 13088 init.cc:377] Logged in from keytab as kudu/127.11.206.126@KRBTEST.COM (short username kudu)
I20260812 00:01:43.644333 13088 webserver.cc:460] Webserver started at http://127.11.206.126:43541/ using document root <none> and password file <none>
I20260812 00:01:43.644560 13088 fs_manager.cc:359] Metadata directory not provided
I20260812 00:01:43.644610 13088 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:01:43.644745 13088 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:01:43.645941 13088 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/minicluster-data/master-0/data/instance:
uuid: "bd28f637aa69462c962d648f9abae950"
format_stamp: "Formatted at 2026-08-12 00:01:43 on dist-test-slave-f0tn"
server_key: "bf9430b55a5f378b9a33d935456ced80"
server_key_iv: "67b8ef7be2d7bfbd2296369413c16f70"
server_key_version: "encryptionkey@0"
I20260812 00:01:43.646279 13088 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/minicluster-data/master-0/wal/instance:
uuid: "bd28f637aa69462c962d648f9abae950"
format_stamp: "Formatted at 2026-08-12 00:01:43 on dist-test-slave-f0tn"
server_key: "bf9430b55a5f378b9a33d935456ced80"
server_key_iv: "67b8ef7be2d7bfbd2296369413c16f70"
server_key_version: "encryptionkey@0"
I20260812 00:01:43.647544 13088 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 00:01:43.648221 13119 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:43.648381 13088 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:01:43.648480 13088 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/minicluster-data/master-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/minicluster-data/master-0/wal
uuid: "bd28f637aa69462c962d648f9abae950"
format_stamp: "Formatted at 2026-08-12 00:01:43 on dist-test-slave-f0tn"
server_key: "bf9430b55a5f378b9a33d935456ced80"
server_key_iv: "67b8ef7be2d7bfbd2296369413c16f70"
server_key_version: "encryptionkey@0"
I20260812 00:01:43.648543 13088 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:01:43.659898 13088 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:01:43.661906 13088 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:01:43.662050 13088 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:01:43.665925 13088 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.126:38775
I20260812 00:01:43.665964 13219 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.126:38775 every 8 connection(s)
I20260812 00:01:43.666330 13088 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
I20260812 00:01:43.667217 13222 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:01:43.669766 13222 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bd28f637aa69462c962d648f9abae950: Bootstrap starting.
I20260812 00:01:43.670400 13222 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bd28f637aa69462c962d648f9abae950: Neither blocks nor log segments found. Creating new log.
I20260812 00:01:43.670675 13222 log.cc:824] T 00000000000000000000000000000000 P bd28f637aa69462c962d648f9abae950: Log is configured to *not* fsync() on all Append() calls
I20260812 00:01:43.671383 13222 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bd28f637aa69462c962d648f9abae950: No bootstrap required, opened a new log
I20260812 00:01:43.672961 13222 raft_consensus.cc:348] T 00000000000000000000000000000000 P bd28f637aa69462c962d648f9abae950 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd28f637aa69462c962d648f9abae950" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 38775 } }
I20260812 00:01:43.673105 13222 raft_consensus.cc:374] T 00000000000000000000000000000000 P bd28f637aa69462c962d648f9abae950 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:01:43.673126 13222 raft_consensus.cc:729] T 00000000000000000000000000000000 P bd28f637aa69462c962d648f9abae950 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd28f637aa69462c962d648f9abae950, State: Initialized, Role: FOLLOWER
I20260812 00:01:43.673280 13222 consensus_queue.cc:260] T 00000000000000000000000000000000 P bd28f637aa69462c962d648f9abae950 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd28f637aa69462c962d648f9abae950" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 38775 } }
I20260812 00:01:43.673350 13222 raft_consensus.cc:388] T 00000000000000000000000000000000 P bd28f637aa69462c962d648f9abae950 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:01:43.673399 13222 raft_consensus.cc:482] T 00000000000000000000000000000000 P bd28f637aa69462c962d648f9abae950 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:01:43.673452 13222 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bd28f637aa69462c962d648f9abae950 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:01:43.673995 13222 raft_consensus.cc:504] T 00000000000000000000000000000000 P bd28f637aa69462c962d648f9abae950 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd28f637aa69462c962d648f9abae950" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 38775 } }
I20260812 00:01:43.674093 13222 leader_election.cc:302] T 00000000000000000000000000000000 P bd28f637aa69462c962d648f9abae950 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bd28f637aa69462c962d648f9abae950; no voters:
I20260812 00:01:43.674253 13222 leader_election.cc:288] T 00000000000000000000000000000000 P bd28f637aa69462c962d648f9abae950 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:01:43.674295 13231 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bd28f637aa69462c962d648f9abae950 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:01:43.674437 13231 raft_consensus.cc:686] T 00000000000000000000000000000000 P bd28f637aa69462c962d648f9abae950 [term 1 LEADER]: Becoming Leader. State: Replica: bd28f637aa69462c962d648f9abae950, State: Running, Role: LEADER
I20260812 00:01:43.674523 13222 sys_catalog.cc:564] T 00000000000000000000000000000000 P bd28f637aa69462c962d648f9abae950 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:01:43.674532 13231 consensus_queue.cc:237] T 00000000000000000000000000000000 P bd28f637aa69462c962d648f9abae950 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd28f637aa69462c962d648f9abae950" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 38775 } }
I20260812 00:01:43.674930 13233 sys_catalog.cc:455] T 00000000000000000000000000000000 P bd28f637aa69462c962d648f9abae950 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bd28f637aa69462c962d648f9abae950. Latest consensus state: current_term: 1 leader_uuid: "bd28f637aa69462c962d648f9abae950" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd28f637aa69462c962d648f9abae950" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 38775 } } }
I20260812 00:01:43.675011 13233 sys_catalog.cc:458] T 00000000000000000000000000000000 P bd28f637aa69462c962d648f9abae950 [sys.catalog]: This master's current role is: LEADER
I20260812 00:01:43.675077 13232 sys_catalog.cc:455] T 00000000000000000000000000000000 P bd28f637aa69462c962d648f9abae950 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bd28f637aa69462c962d648f9abae950" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd28f637aa69462c962d648f9abae950" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 38775 } } }
I20260812 00:01:43.675158 13232 sys_catalog.cc:458] T 00000000000000000000000000000000 P bd28f637aa69462c962d648f9abae950 [sys.catalog]: This master's current role is: LEADER
I20260812 00:01:43.675475 13240 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:01:43.675932 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 13088
I20260812 00:01:43.676023 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/minicluster-data/master-0/wal/instance
I20260812 00:01:43.676009 13240 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:01:43.676177 12089 external_mini_cluster.cc:1428] Setting key 95be1a9f70751da1b019f31f6f46c7aa
I20260812 00:01:43.677625 13240 catalog_manager.cc:1347] Generated new cluster ID: 78f5a31381e3464bb03066a73dbd92c4
I20260812 00:01:43.677677 13240 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 00:01:43 dist-test-slave-f0tn krb5kdc[13070](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492903, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:01:43.687953 13264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:43.676853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56500 (local address 127.11.206.126:38775)
0812 00:01:43.677017 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:43.677026 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:43.677051 (+ 25us) server_negotiation.cc:407] Connection header received
0812 00:01:43.677176 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:43.677184 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:43.677262 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:43.677410 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:01:43.678146 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:43.679603 (+ 1457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:43.680724 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:43.681399 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:43.681536 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:43.684293 (+ 2757us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:01:43.684297 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:01:43.684298 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:01:43.684311 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:01:43.686240 (+ 1929us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:43.686643 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:43.686646 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:43.686647 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:43.686749 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:43.686939 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:43.686939 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:43.686940 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:43.687230 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:01:43.687365 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:43.687471 (+ 106us) server_negotiation.cc:299] Negotiation successful
0812 00:01:43.687706 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":76,"threads_started":1}
I20260812 00:01:43.710654 13240 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:01:43.711225 13240 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:01:43.713980 13240 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bd28f637aa69462c962d648f9abae950: Generated new TSK 0
I20260812 00:01:43.714159 13240 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.206.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.65.keytab.
Entry for principal kudu/127.11.206.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.65.keytab.
I20260812 00:01:43.742436 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.65:0
--local_ip_for_outbound_sockets=127.11.206.65
--webserver_interface=127.11.206.65
--webserver_port=0
--tserver_master_addrs=127.11.206.126:38775
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.65.keytab
--principal=kudu/127.11.206.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:38153
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:01:43.826892 13276 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:01:43.827119 13276 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:01:43.827143 13276 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:01:43.828354 13276 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:01:43.828413 13276 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:01:43.828449 13276 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.65
I20260812 00:01:43.830058 13276 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:38153
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.65.keytab
--principal=kudu/127.11.206.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.206.65
--webserver_port=0
--tserver_master_addrs=127.11.206.126:38775
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13276
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.65
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:01:43.830310 13276 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:01:43.830528 13276 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:01:43.835739 13289 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:01:43.835739 13284 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:01:43.835744 13285 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:01:43.835975 13276 server_base.cc:1034] running on GCE node
I20260812 00:01:43.836208 13276 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:01:43.836442 13276 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:01:43.837585 13276 hybrid_clock.cc:648] HybridClock initialized: now 1786492903837568 us; error 32 us; skew 500 ppm
Aug 12 00:01:43 dist-test-slave-f0tn krb5kdc[13070](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492903, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:01:43.840106 13276 init.cc:377] Logged in from keytab as kudu/127.11.206.65@KRBTEST.COM (short username kudu)
I20260812 00:01:43.840565 13276 webserver.cc:460] Webserver started at http://127.11.206.65:42263/ using document root <none> and password file <none>
I20260812 00:01:43.840783 13276 fs_manager.cc:359] Metadata directory not provided
I20260812 00:01:43.840832 13276 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:01:43.840972 13276 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:01:43.842105 13276 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/minicluster-data/ts-0/data/instance:
uuid: "11085ea6bbc044d790f21b4e576fdd4f"
format_stamp: "Formatted at 2026-08-12 00:01:43 on dist-test-slave-f0tn"
server_key: "ffa8fd4a643900d785281757d15f6b0f"
server_key_iv: "677f354729c983a6b310aaec9c064832"
server_key_version: "encryptionkey@0"
I20260812 00:01:43.842449 13276 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/minicluster-data/ts-0/wal/instance:
uuid: "11085ea6bbc044d790f21b4e576fdd4f"
format_stamp: "Formatted at 2026-08-12 00:01:43 on dist-test-slave-f0tn"
server_key: "ffa8fd4a643900d785281757d15f6b0f"
server_key_iv: "677f354729c983a6b310aaec9c064832"
server_key_version: "encryptionkey@0"
I20260812 00:01:43.843773 13276 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 00:01:43.844485 13299 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:43.844638 13276 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:01:43.844727 13276 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/minicluster-data/ts-0/wal
uuid: "11085ea6bbc044d790f21b4e576fdd4f"
format_stamp: "Formatted at 2026-08-12 00:01:43 on dist-test-slave-f0tn"
server_key: "ffa8fd4a643900d785281757d15f6b0f"
server_key_iv: "677f354729c983a6b310aaec9c064832"
server_key_version: "encryptionkey@0"
I20260812 00:01:43.844796 13276 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:01:43.870254 13276 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:01:43.872144 13276 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:01:43.872304 13276 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:01:43.872545 13276 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:01:43.872864 13276 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:01:43.872900 13276 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:43.872929 13276 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:01:43.872947 13276 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:43.878710 13276 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.65:42639
I20260812 00:01:43.878772 13516 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.65:42639 every 8 connection(s)
I20260812 00:01:43.879079 13276 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
Aug 12 00:01:43 dist-test-slave-f0tn krb5kdc[13070](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492903, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.65@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:01:43.887530 13264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:43.879791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.65:55447 (local address 127.11.206.126:38775)
0812 00:01:43.879849 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:43.879850 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:43.880072 (+ 222us) server_negotiation.cc:407] Connection header received
0812 00:01:43.880982 (+ 910us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:43.880983 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:43.880993 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:43.881049 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:01:43.881706 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:43.882213 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:43.883183 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:43.883383 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:43.883424 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:43.885396 (+ 1972us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:01:43.885398 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:01:43.885398 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:01:43.885406 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:01:43.886498 (+ 1092us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:43.886848 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:43.886849 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:43.886849 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:43.886891 (+ 42us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:43.887059 (+ 168us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:43.887059 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:43.887060 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:43.887153 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:01:43.887196 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:43.887399 (+ 203us) server_negotiation.cc:299] Negotiation successful
0812 00:01:43.887462 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260812 00:01:43.887696 13520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:43.879754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:38775 (local address 127.11.206.65:55447)
0812 00:01:43.879930 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0812 00:01:43.879989 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0812 00:01:43.880896 (+ 907us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:01:43.881110 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:01:43.881113 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:01:43.881419 (+ 306us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:01:43.881628 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:43.881634 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:43.882295 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:43.882295 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:43.883118 (+ 823us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:43.883121 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:43.883435 (+ 314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:43.883436 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:43.883532 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:43.883964 (+ 432us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:01:43.883972 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:01:43.885283 (+ 1311us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:01:43.886560 (+ 1277us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:01:43.886566 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:01:43.886568 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:01:43.886790 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:01:43.886932 (+ 142us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:01:43.886932 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:01:43.886932 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:01:43.887021 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:01:43.887194 (+ 173us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:01:43.887197 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:01:43.887308 (+ 111us) client_negotiation.cc:769] Sending connection context
0812 00:01:43.887382 (+ 74us) client_negotiation.cc:240] Negotiation successful
0812 00:01:43.887497 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":87,"threads_started":1}
I20260812 00:01:43.888286 13517 heartbeater.cc:347] Connected to a master server at 127.11.206.126:38775
I20260812 00:01:43.888397 13517 heartbeater.cc:464] Registering TS with master...
I20260812 00:01:43.888403 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 13276
I20260812 00:01:43.888490 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/minicluster-data/ts-0/wal/instance
I20260812 00:01:43.888595 13517 heartbeater.cc:511] Master 127.11.206.126:38775 requested a full tablet report, sending...
I20260812 00:01:43.888669 12089 external_mini_cluster.cc:1428] Setting key d582d7604e132afdaf023d7dfb754125
I20260812 00:01:43.889153 13156 ts_manager.cc:194] Registered new tserver with Master: 11085ea6bbc044d790f21b4e576fdd4f (127.11.206.65:42639)
I20260812 00:01:43.889864 13156 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.206.65@KRBTEST.COM'} at 127.11.206.65:55447
WARNING: no policy specified for kudu/127.11.206.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.66.keytab.
Entry for principal kudu/127.11.206.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.66.keytab.
I20260812 00:01:43.915880 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.66:0
--local_ip_for_outbound_sockets=127.11.206.66
--webserver_interface=127.11.206.66
--webserver_port=0
--tserver_master_addrs=127.11.206.126:38775
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.66.keytab
--principal=kudu/127.11.206.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:38153
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:01:43.998836 13525 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:01:43.999037 13525 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:01:43.999059 13525 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:01:44.000155 13525 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:01:44.000213 13525 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:01:44.000249 13525 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.66
I20260812 00:01:44.002015 13525 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:38153
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.66.keytab
--principal=kudu/127.11.206.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.206.66
--webserver_port=0
--tserver_master_addrs=127.11.206.126:38775
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13525
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.66
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:01:44.002285 13525 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:01:44.002511 13525 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:01:44.007298 13535 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:01:44.007308 13538 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:01:44.007320 13536 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:01:44.007644 13525 server_base.cc:1034] running on GCE node
I20260812 00:01:44.007851 13525 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:01:44.008082 13525 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:01:44.009238 13525 hybrid_clock.cc:648] HybridClock initialized: now 1786492904009225 us; error 28 us; skew 500 ppm
Aug 12 00:01:44 dist-test-slave-f0tn krb5kdc[13070](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492904, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:01:44.011781 13525 init.cc:377] Logged in from keytab as kudu/127.11.206.66@KRBTEST.COM (short username kudu)
I20260812 00:01:44.012252 13525 webserver.cc:460] Webserver started at http://127.11.206.66:35439/ using document root <none> and password file <none>
I20260812 00:01:44.012482 13525 fs_manager.cc:359] Metadata directory not provided
I20260812 00:01:44.012531 13525 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:01:44.012658 13525 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:01:44.013743 13525 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/minicluster-data/ts-1/data/instance:
uuid: "afbc37a86fe84d3fb4951f7fa3683913"
format_stamp: "Formatted at 2026-08-12 00:01:44 on dist-test-slave-f0tn"
server_key: "a1fa2455f886da82005f0f678650d897"
server_key_iv: "2fb2cc1a1b5bbe41dc37a851426d46ab"
server_key_version: "encryptionkey@0"
I20260812 00:01:44.014077 13525 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/minicluster-data/ts-1/wal/instance:
uuid: "afbc37a86fe84d3fb4951f7fa3683913"
format_stamp: "Formatted at 2026-08-12 00:01:44 on dist-test-slave-f0tn"
server_key: "a1fa2455f886da82005f0f678650d897"
server_key_iv: "2fb2cc1a1b5bbe41dc37a851426d46ab"
server_key_version: "encryptionkey@0"
I20260812 00:01:44.015384 13525 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:01:44.016095 13550 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:44.016266 13525 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:01:44.016351 13525 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/minicluster-data/ts-1/wal
uuid: "afbc37a86fe84d3fb4951f7fa3683913"
format_stamp: "Formatted at 2026-08-12 00:01:44 on dist-test-slave-f0tn"
server_key: "a1fa2455f886da82005f0f678650d897"
server_key_iv: "2fb2cc1a1b5bbe41dc37a851426d46ab"
server_key_version: "encryptionkey@0"
I20260812 00:01:44.016413 13525 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:01:44.028316 13525 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:01:44.030187 13525 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:01:44.030333 13525 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:01:44.030545 13525 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:01:44.030843 13525 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:01:44.030877 13525 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:44.030905 13525 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:01:44.030927 13525 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:44.036468 13525 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.66:38333
I20260812 00:01:44.036506 13769 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.66:38333 every 8 connection(s)
I20260812 00:01:44.036808 13525 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
I20260812 00:01:44.041235 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 13525
I20260812 00:01:44.041330 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/minicluster-data/ts-1/wal/instance
I20260812 00:01:44.041532 12089 external_mini_cluster.cc:1428] Setting key 8bd00e7fd2acf0a82a75254dac7af2bd
Aug 12 00:01:44 dist-test-slave-f0tn krb5kdc[13070](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492904, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.66@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:01:44.046097 13264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:44.037488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.66:33787 (local address 127.11.206.126:38775)
0812 00:01:44.037540 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:44.037543 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:44.037796 (+ 253us) server_negotiation.cc:407] Connection header received
0812 00:01:44.038699 (+ 903us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:44.038701 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:44.038711 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:44.038768 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:01:44.039318 (+ 550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:44.039816 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:44.040913 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:44.041127 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:44.041172 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:44.043387 (+ 2215us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:01:44.043389 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:01:44.043390 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:01:44.043399 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:01:44.044759 (+ 1360us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:44.045158 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:44.045160 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:44.045160 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:44.045218 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:44.045462 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:44.045463 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:44.045463 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:44.045577 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:01:44.045634 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:44.045896 (+ 262us) server_negotiation.cc:299] Negotiation successful
0812 00:01:44.045988 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 00:01:44.046226 13775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:44.037505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:38775 (local address 127.11.206.66:33787)
0812 00:01:44.037674 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0812 00:01:44.037714 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 00:01:44.038604 (+ 890us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:01:44.038810 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:01:44.038813 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:01:44.039060 (+ 247us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:01:44.039257 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:44.039261 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:44.039911 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:44.039913 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:44.040818 (+ 905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:44.040821 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:44.041200 (+ 379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:44.041201 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:44.041350 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:44.041898 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:01:44.041908 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:01:44.043298 (+ 1390us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:01:44.044848 (+ 1550us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:01:44.044855 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:01:44.044857 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:01:44.045081 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:01:44.045273 (+ 192us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:01:44.045274 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:01:44.045275 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:01:44.045372 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:01:44.045632 (+ 260us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:01:44.045639 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:01:44.045771 (+ 132us) client_negotiation.cc:769] Sending connection context
0812 00:01:44.045852 (+ 81us) client_negotiation.cc:240] Negotiation successful
0812 00:01:44.046006 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":91,"threads_started":1}
I20260812 00:01:44.046677 13773 heartbeater.cc:347] Connected to a master server at 127.11.206.126:38775
I20260812 00:01:44.046763 13773 heartbeater.cc:464] Registering TS with master...
I20260812 00:01:44.046937 13773 heartbeater.cc:511] Master 127.11.206.126:38775 requested a full tablet report, sending...
I20260812 00:01:44.047433 13156 ts_manager.cc:194] Registered new tserver with Master: afbc37a86fe84d3fb4951f7fa3683913 (127.11.206.66:38333)
I20260812 00:01:44.047811 13156 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.206.66@KRBTEST.COM'} at 127.11.206.66:33787
WARNING: no policy specified for kudu/127.11.206.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.67.keytab.
Entry for principal kudu/127.11.206.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.67.keytab.
I20260812 00:01:44.066416 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.67:0
--local_ip_for_outbound_sockets=127.11.206.67
--webserver_interface=127.11.206.67
--webserver_port=0
--tserver_master_addrs=127.11.206.126:38775
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.67.keytab
--principal=kudu/127.11.206.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:38153
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:01:44.161580 13781 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:01:44.161825 13781 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:01:44.161852 13781 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:01:44.163130 13781 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:01:44.163172 13781 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:01:44.163198 13781 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.67
I20260812 00:01:44.164749 13781 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:38153
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.67.keytab
--principal=kudu/127.11.206.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.206.67
--webserver_port=0
--tserver_master_addrs=127.11.206.126:38775
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13781
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.67
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:01:44.164954 13781 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:01:44.165158 13781 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:01:44.170565 13798 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:01:44.170549 13803 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:01:44.170580 13781 server_base.cc:1034] running on GCE node
W20260812 00:01:44.170549 13797 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:01:44.170979 13781 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:01:44.171217 13781 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:01:44.172366 13781 hybrid_clock.cc:648] HybridClock initialized: now 1786492904172353 us; error 29 us; skew 500 ppm
Aug 12 00:01:44 dist-test-slave-f0tn krb5kdc[13070](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492904, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:01:44.174948 13781 init.cc:377] Logged in from keytab as kudu/127.11.206.67@KRBTEST.COM (short username kudu)
I20260812 00:01:44.175448 13781 webserver.cc:460] Webserver started at http://127.11.206.67:41483/ using document root <none> and password file <none>
I20260812 00:01:44.175705 13781 fs_manager.cc:359] Metadata directory not provided
I20260812 00:01:44.175766 13781 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:01:44.175881 13781 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:01:44.176915 13781 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/minicluster-data/ts-2/data/instance:
uuid: "4a210daea3bd4342a4d30c34002cf741"
format_stamp: "Formatted at 2026-08-12 00:01:44 on dist-test-slave-f0tn"
server_key: "c003483f6084b3c456f91fecbb9e7337"
server_key_iv: "469de2b35582bee02ab339adbc015bf3"
server_key_version: "encryptionkey@0"
I20260812 00:01:44.177222 13781 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/minicluster-data/ts-2/wal/instance:
uuid: "4a210daea3bd4342a4d30c34002cf741"
format_stamp: "Formatted at 2026-08-12 00:01:44 on dist-test-slave-f0tn"
server_key: "c003483f6084b3c456f91fecbb9e7337"
server_key_iv: "469de2b35582bee02ab339adbc015bf3"
server_key_version: "encryptionkey@0"
I20260812 00:01:44.178478 13781 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:01:44.179221 13814 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:44.179375 13781 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:01:44.179459 13781 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/minicluster-data/ts-2/wal
uuid: "4a210daea3bd4342a4d30c34002cf741"
format_stamp: "Formatted at 2026-08-12 00:01:44 on dist-test-slave-f0tn"
server_key: "c003483f6084b3c456f91fecbb9e7337"
server_key_iv: "469de2b35582bee02ab339adbc015bf3"
server_key_version: "encryptionkey@0"
I20260812 00:01:44.179520 13781 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:01:44.189234 13781 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:01:44.191224 13781 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:01:44.191412 13781 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:01:44.191728 13781 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:01:44.192028 13781 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:01:44.192062 13781 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:44.192090 13781 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:01:44.192114 13781 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:44.202363 13781 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.67:36443
I20260812 00:01:44.202454 14015 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.67:36443 every 8 connection(s)
I20260812 00:01:44.202751 13781 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
Aug 12 00:01:44 dist-test-slave-f0tn krb5kdc[13070](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492904, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.67@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:01:44.211675 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 13781
I20260812 00:01:44.211762 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786492899949492-12089-0/minicluster-data/ts-2/wal/instance
I20260812 00:01:44.211894 12089 external_mini_cluster.cc:1428] Setting key ea2962154aae99ee7cd335c691b4591d
I20260812 00:01:44.212059 13264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:44.203532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.67:47165 (local address 127.11.206.126:38775)
0812 00:01:44.203587 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:44.203589 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:44.203863 (+ 274us) server_negotiation.cc:407] Connection header received
0812 00:01:44.204867 (+ 1004us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:44.204869 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:44.204882 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:44.204934 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:01:44.205601 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:44.206109 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:44.207172 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:44.207368 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:44.207423 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:44.209701 (+ 2278us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:01:44.209703 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:01:44.209703 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:01:44.209711 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:01:44.210832 (+ 1121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:44.211183 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:44.211183 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:44.211184 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:44.211230 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:44.211415 (+ 185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:44.211415 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:44.211415 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:44.211533 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:01:44.211587 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:44.211884 (+ 297us) server_negotiation.cc:299] Negotiation successful
0812 00:01:44.211966 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260812 00:01:44.212332 14018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:44.203493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:38775 (local address 127.11.206.67:47165)
0812 00:01:44.203730 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0812 00:01:44.203773 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 00:01:44.204757 (+ 984us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:01:44.205006 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:01:44.205010 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:01:44.205277 (+ 267us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:01:44.205516 (+ 239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:44.205521 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:44.206193 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:44.206194 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:44.207087 (+ 893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:44.207090 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:44.207438 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:44.207439 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:44.207558 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:44.208094 (+ 536us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:01:44.208102 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:01:44.209605 (+ 1503us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:01:44.210902 (+ 1297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:01:44.210908 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:01:44.210910 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:01:44.211124 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:01:44.211276 (+ 152us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:01:44.211276 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:01:44.211276 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:01:44.211371 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:01:44.211600 (+ 229us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:01:44.211607 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:01:44.211745 (+ 138us) client_negotiation.cc:769] Sending connection context
0812 00:01:44.211858 (+ 113us) client_negotiation.cc:240] Negotiation successful
0812 00:01:44.212016 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":98,"threads_started":1}
I20260812 00:01:44.212932 14016 heartbeater.cc:347] Connected to a master server at 127.11.206.126:38775
I20260812 00:01:44.213040 14016 heartbeater.cc:464] Registering TS with master...
I20260812 00:01:44.213233 14016 heartbeater.cc:511] Master 127.11.206.126:38775 requested a full tablet report, sending...
I20260812 00:01:44.213613 13156 ts_manager.cc:194] Registered new tserver with Master: 4a210daea3bd4342a4d30c34002cf741 (127.11.206.67:36443)
I20260812 00:01:44.214032 13156 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.206.67@KRBTEST.COM'} at 127.11.206.67:47165
I20260812 00:01:44.223634 12089 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:01:44.231194 13264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:44.225815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56502 (local address 127.11.206.126:38775)
0812 00:01:44.225863 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:44.225864 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:44.225934 (+ 70us) server_negotiation.cc:407] Connection header received
0812 00:01:44.225980 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:44.225981 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:44.225990 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:44.226039 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:01:44.226557 (+ 518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:44.227042 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:44.227754 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:44.227952 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:44.228022 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:44.229124 (+ 1102us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:01:44.229125 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:01:44.229125 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:01:44.229133 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:01:44.230335 (+ 1202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:44.230624 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:44.230625 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:44.230625 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:44.230669 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:44.230795 (+ 126us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:44.230795 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:44.230795 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:44.230930 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:01:44.231001 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:44.231072 (+ 71us) server_negotiation.cc:299] Negotiation successful
0812 00:01:44.231130 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 00:01:44.233641 13156 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56502:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:01:44.235530 13156 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:01:44.242596 14043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:44.238536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58396 (local address 127.11.206.67:36443)
0812 00:01:44.238777 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:44.238780 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:44.238790 (+ 10us) server_negotiation.cc:407] Connection header received
0812 00:01:44.238871 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:44.238874 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:44.238892 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:44.238966 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:01:44.239157 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:44.240373 (+ 1216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:44.241686 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:44.242202 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:44.242268 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:44.242330 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:44.242468 (+ 138us) server_negotiation.cc:299] Negotiation successful
0812 00:01:44.242511 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":211,"thread_start_us":87,"threads_started":1}
I20260812 00:01:44.242579 14033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:44.238300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.67:36443 (local address 127.0.0.1:58396)
0812 00:01:44.238724 (+ 424us) negotiation.cc:107] Waiting for socket to connect
0812 00:01:44.238734 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:01:44.238778 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:01:44.238980 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:01:44.238983 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:01:44.238985 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:01:44.239059 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:44.239061 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:44.240557 (+ 1496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:44.240558 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:44.241619 (+ 1061us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:44.241621 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:44.242287 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:44.242288 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:44.242368 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:44.242381 (+ 13us) client_negotiation.cc:769] Sending connection context
0812 00:01:44.242447 (+ 66us) client_negotiation.cc:240] Negotiation successful
0812 00:01:44.242501 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":376,"mutex_wait_us":2,"thread_start_us":47,"threads_started":1}
I20260812 00:01:44.242795 14032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:44.238300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.66:38333 (local address 127.0.0.1:36640)
0812 00:01:44.238572 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0812 00:01:44.238617 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 00:01:44.238684 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:01:44.239181 (+ 497us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:01:44.239182 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:01:44.239184 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:01:44.239229 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:44.239231 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:44.240606 (+ 1375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:44.240607 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:44.241457 (+ 850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:44.241460 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:44.242557 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:44.242558 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:44.242626 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:44.242632 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 00:01:44.242678 (+ 46us) client_negotiation.cc:240] Negotiation successful
0812 00:01:44.242717 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":92,"threads_started":1}
I20260812 00:01:44.242910 14034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:44.238300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.65:42639 (local address 127.0.0.1:33612)
0812 00:01:44.238796 (+ 496us) negotiation.cc:107] Waiting for socket to connect
0812 00:01:44.238807 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:01:44.238859 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:01:44.239238 (+ 379us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:01:44.239239 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:01:44.239240 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:01:44.239296 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:44.239297 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:44.240210 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:44.240211 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:44.241492 (+ 1281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:44.241496 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:44.242559 (+ 1063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:44.242560 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:44.242626 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:44.242634 (+ 8us) client_negotiation.cc:769] Sending connection context
0812 00:01:44.242678 (+ 44us) client_negotiation.cc:240] Negotiation successful
0812 00:01:44.242726 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":475,"mutex_wait_us":23,"thread_start_us":179,"threads_started":1}
I20260812 00:01:44.242992 14040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:44.238485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33612 (local address 127.11.206.65:42639)
0812 00:01:44.238968 (+ 483us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:44.238973 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:44.238983 (+ 10us) server_negotiation.cc:407] Connection header received
0812 00:01:44.239051 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:44.239053 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:44.239070 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:44.239143 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:01:44.239366 (+ 223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:44.240106 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:44.241573 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:44.242391 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:44.242464 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:44.242520 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:44.242861 (+ 341us) server_negotiation.cc:299] Negotiation successful
0812 00:01:44.242907 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":423,"thread_start_us":111,"threads_started":1}
I20260812 00:01:44.243127 14041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:44.238550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36640 (local address 127.11.206.66:38333)
0812 00:01:44.238725 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:44.238730 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:44.238743 (+ 13us) server_negotiation.cc:407] Connection header received
0812 00:01:44.238894 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:44.238897 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:44.238914 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:44.238991 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:01:44.239353 (+ 362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:44.240466 (+ 1113us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:44.241538 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:44.242406 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:44.242464 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:44.242520 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:44.242977 (+ 457us) server_negotiation.cc:299] Negotiation successful
0812 00:01:44.243017 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":73,"threads_started":1}
I20260812 00:01:44.243974 13653 tablet_service.cc:1467] Processing CreateTablet for tablet 7d1127019efd4d11b514ac90ac0bac57 (DEFAULT_TABLE table=test-table [id=edf85e3ef10b49318c231230ba6ca3b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:01:44.243978 13899 tablet_service.cc:1467] Processing CreateTablet for tablet 7d1127019efd4d11b514ac90ac0bac57 (DEFAULT_TABLE table=test-table [id=edf85e3ef10b49318c231230ba6ca3b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:01:44.244280 13653 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d1127019efd4d11b514ac90ac0bac57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:01:44.244309 13899 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d1127019efd4d11b514ac90ac0bac57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:01:44.246837 13399 tablet_service.cc:1467] Processing CreateTablet for tablet 7d1127019efd4d11b514ac90ac0bac57 (DEFAULT_TABLE table=test-table [id=edf85e3ef10b49318c231230ba6ca3b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:01:44.247187 13399 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d1127019efd4d11b514ac90ac0bac57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:01:44.247372 14044 tablet_bootstrap.cc:492] T 7d1127019efd4d11b514ac90ac0bac57 P 4a210daea3bd4342a4d30c34002cf741: Bootstrap starting.
I20260812 00:01:44.247926 14045 tablet_bootstrap.cc:492] T 7d1127019efd4d11b514ac90ac0bac57 P afbc37a86fe84d3fb4951f7fa3683913: Bootstrap starting.
I20260812 00:01:44.248374 14044 tablet_bootstrap.cc:654] T 7d1127019efd4d11b514ac90ac0bac57 P 4a210daea3bd4342a4d30c34002cf741: Neither blocks nor log segments found. Creating new log.
I20260812 00:01:44.248986 14045 tablet_bootstrap.cc:654] T 7d1127019efd4d11b514ac90ac0bac57 P afbc37a86fe84d3fb4951f7fa3683913: Neither blocks nor log segments found. Creating new log.
I20260812 00:01:44.249189 14044 log.cc:824] T 7d1127019efd4d11b514ac90ac0bac57 P 4a210daea3bd4342a4d30c34002cf741: Log is configured to *not* fsync() on all Append() calls
I20260812 00:01:44.249964 14045 log.cc:824] T 7d1127019efd4d11b514ac90ac0bac57 P afbc37a86fe84d3fb4951f7fa3683913: Log is configured to *not* fsync() on all Append() calls
I20260812 00:01:44.250183 14044 tablet_bootstrap.cc:492] T 7d1127019efd4d11b514ac90ac0bac57 P 4a210daea3bd4342a4d30c34002cf741: No bootstrap required, opened a new log
I20260812 00:01:44.250252 14044 ts_tablet_manager.cc:1397] T 7d1127019efd4d11b514ac90ac0bac57 P 4a210daea3bd4342a4d30c34002cf741: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.002s
I20260812 00:01:44.250893 14045 tablet_bootstrap.cc:492] T 7d1127019efd4d11b514ac90ac0bac57 P afbc37a86fe84d3fb4951f7fa3683913: No bootstrap required, opened a new log
I20260812 00:01:44.250943 14045 ts_tablet_manager.cc:1397] T 7d1127019efd4d11b514ac90ac0bac57 P afbc37a86fe84d3fb4951f7fa3683913: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260812 00:01:44.251138 14052 tablet_bootstrap.cc:492] T 7d1127019efd4d11b514ac90ac0bac57 P 11085ea6bbc044d790f21b4e576fdd4f: Bootstrap starting.
I20260812 00:01:44.252331 14052 tablet_bootstrap.cc:654] T 7d1127019efd4d11b514ac90ac0bac57 P 11085ea6bbc044d790f21b4e576fdd4f: Neither blocks nor log segments found. Creating new log.
I20260812 00:01:44.253285 14052 log.cc:824] T 7d1127019efd4d11b514ac90ac0bac57 P 11085ea6bbc044d790f21b4e576fdd4f: Log is configured to *not* fsync() on all Append() calls
I20260812 00:01:44.253413 14044 raft_consensus.cc:348] T 7d1127019efd4d11b514ac90ac0bac57 P 4a210daea3bd4342a4d30c34002cf741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afbc37a86fe84d3fb4951f7fa3683913" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 38333 } } peers { permanent_uuid: "11085ea6bbc044d790f21b4e576fdd4f" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 42639 } } peers { permanent_uuid: "4a210daea3bd4342a4d30c34002cf741" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 36443 } }
I20260812 00:01:44.253600 14044 raft_consensus.cc:374] T 7d1127019efd4d11b514ac90ac0bac57 P 4a210daea3bd4342a4d30c34002cf741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:01:44.253674 14044 raft_consensus.cc:729] T 7d1127019efd4d11b514ac90ac0bac57 P 4a210daea3bd4342a4d30c34002cf741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a210daea3bd4342a4d30c34002cf741, State: Initialized, Role: FOLLOWER
I20260812 00:01:44.253831 14044 consensus_queue.cc:260] T 7d1127019efd4d11b514ac90ac0bac57 P 4a210daea3bd4342a4d30c34002cf741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afbc37a86fe84d3fb4951f7fa3683913" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 38333 } } peers { permanent_uuid: "11085ea6bbc044d790f21b4e576fdd4f" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 42639 } } peers { permanent_uuid: "4a210daea3bd4342a4d30c34002cf741" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 36443 } }
I20260812 00:01:44.254132 14052 tablet_bootstrap.cc:492] T 7d1127019efd4d11b514ac90ac0bac57 P 11085ea6bbc044d790f21b4e576fdd4f: No bootstrap required, opened a new log
I20260812 00:01:44.254186 14044 ts_tablet_manager.cc:1428] T 7d1127019efd4d11b514ac90ac0bac57 P 4a210daea3bd4342a4d30c34002cf741: Time spent starting tablet: real 0.004s user 0.002s sys 0.002s
I20260812 00:01:44.254248 14052 ts_tablet_manager.cc:1397] T 7d1127019efd4d11b514ac90ac0bac57 P 11085ea6bbc044d790f21b4e576fdd4f: Time spent bootstrapping tablet: real 0.003s user 0.003s sys 0.000s
I20260812 00:01:44.254078 14045 raft_consensus.cc:348] T 7d1127019efd4d11b514ac90ac0bac57 P afbc37a86fe84d3fb4951f7fa3683913 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afbc37a86fe84d3fb4951f7fa3683913" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 38333 } } peers { permanent_uuid: "11085ea6bbc044d790f21b4e576fdd4f" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 42639 } } peers { permanent_uuid: "4a210daea3bd4342a4d30c34002cf741" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 36443 } }
I20260812 00:01:44.254339 14016 heartbeater.cc:503] Master 127.11.206.126:38775 was elected leader, sending a full tablet report...
I20260812 00:01:44.254362 14045 raft_consensus.cc:374] T 7d1127019efd4d11b514ac90ac0bac57 P afbc37a86fe84d3fb4951f7fa3683913 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:01:44.254443 14045 raft_consensus.cc:729] T 7d1127019efd4d11b514ac90ac0bac57 P afbc37a86fe84d3fb4951f7fa3683913 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afbc37a86fe84d3fb4951f7fa3683913, State: Initialized, Role: FOLLOWER
I20260812 00:01:44.254555 14045 consensus_queue.cc:260] T 7d1127019efd4d11b514ac90ac0bac57 P afbc37a86fe84d3fb4951f7fa3683913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afbc37a86fe84d3fb4951f7fa3683913" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 38333 } } peers { permanent_uuid: "11085ea6bbc044d790f21b4e576fdd4f" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 42639 } } peers { permanent_uuid: "4a210daea3bd4342a4d30c34002cf741" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 36443 } }
I20260812 00:01:44.254951 14045 ts_tablet_manager.cc:1428] T 7d1127019efd4d11b514ac90ac0bac57 P afbc37a86fe84d3fb4951f7fa3683913: Time spent starting tablet: real 0.004s user 0.000s sys 0.004s
I20260812 00:01:44.255065 13773 heartbeater.cc:503] Master 127.11.206.126:38775 was elected leader, sending a full tablet report...
I20260812 00:01:44.256700 14052 raft_consensus.cc:348] T 7d1127019efd4d11b514ac90ac0bac57 P 11085ea6bbc044d790f21b4e576fdd4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afbc37a86fe84d3fb4951f7fa3683913" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 38333 } } peers { permanent_uuid: "11085ea6bbc044d790f21b4e576fdd4f" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 42639 } } peers { permanent_uuid: "4a210daea3bd4342a4d30c34002cf741" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 36443 } }
I20260812 00:01:44.256860 14052 raft_consensus.cc:374] T 7d1127019efd4d11b514ac90ac0bac57 P 11085ea6bbc044d790f21b4e576fdd4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:01:44.256886 14052 raft_consensus.cc:729] T 7d1127019efd4d11b514ac90ac0bac57 P 11085ea6bbc044d790f21b4e576fdd4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11085ea6bbc044d790f21b4e576fdd4f, State: Initialized, Role: FOLLOWER
I20260812 00:01:44.256961 14052 consensus_queue.cc:260] T 7d1127019efd4d11b514ac90ac0bac57 P 11085ea6bbc044d790f21b4e576fdd4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afbc37a86fe84d3fb4951f7fa3683913" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 38333 } } peers { permanent_uuid: "11085ea6bbc044d790f21b4e576fdd4f" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 42639 } } peers { permanent_uuid: "4a210daea3bd4342a4d30c34002cf741" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 36443 } }
I20260812 00:01:44.257198 14052 ts_tablet_manager.cc:1428] T 7d1127019efd4d11b514ac90ac0bac57 P 11085ea6bbc044d790f21b4e576fdd4f: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 00:01:44.257200 13517 heartbeater.cc:503] Master 127.11.206.126:38775 was elected leader, sending a full tablet report...
I20260812 00:01:44.268328 14058 raft_consensus.cc:482] T 7d1127019efd4d11b514ac90ac0bac57 P 11085ea6bbc044d790f21b4e576fdd4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:01:44.268425 14058 raft_consensus.cc:504] T 7d1127019efd4d11b514ac90ac0bac57 P 11085ea6bbc044d790f21b4e576fdd4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afbc37a86fe84d3fb4951f7fa3683913" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 38333 } } peers { permanent_uuid: "11085ea6bbc044d790f21b4e576fdd4f" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 42639 } } peers { permanent_uuid: "4a210daea3bd4342a4d30c34002cf741" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 36443 } }
I20260812 00:01:44.268776 14058 leader_election.cc:288] T 7d1127019efd4d11b514ac90ac0bac57 P 11085ea6bbc044d790f21b4e576fdd4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers afbc37a86fe84d3fb4951f7fa3683913 (127.11.206.66:38333), 4a210daea3bd4342a4d30c34002cf741 (127.11.206.67:36443)
I20260812 00:01:44.271456 14041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:44.268989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.65:34045 (local address 127.11.206.66:38333)
0812 00:01:44.269031 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:44.269033 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:44.269043 (+ 10us) server_negotiation.cc:407] Connection header received
0812 00:01:44.269107 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:44.269108 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:44.269116 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:44.269174 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:01:44.269350 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:44.269866 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:44.270788 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:44.271144 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:44.271204 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:44.271214 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:44.271363 (+ 149us) server_negotiation.cc:299] Negotiation successful
0812 00:01:44.271398 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 00:01:44.271456 13520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:44.268918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.66:38333 (local address 127.11.206.65:34045)
0812 00:01:44.268992 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0812 00:01:44.269004 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 00:01:44.269050 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:01:44.269185 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:01:44.269186 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:01:44.269188 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:01:44.269278 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:44.269279 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:44.269940 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:44.269941 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:44.270701 (+ 760us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:44.270704 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:44.271220 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:44.271221 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:44.271300 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:44.271303 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:01:44.271347 (+ 44us) client_negotiation.cc:240] Negotiation successful
0812 00:01:44.271383 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53}
I20260812 00:01:44.271631 14043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:44.268990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.65:32805 (local address 127.11.206.67:36443)
0812 00:01:44.269031 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:44.269033 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:44.269246 (+ 213us) server_negotiation.cc:407] Connection header received
0812 00:01:44.269310 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:44.269312 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:44.269320 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:44.269364 (+ 44us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:01:44.269586 (+ 222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:44.270052 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:44.270966 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:44.271333 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:44.271392 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:44.271400 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:44.271536 (+ 136us) server_negotiation.cc:299] Negotiation successful
0812 00:01:44.271571 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 00:01:44.271643 14061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:44.268932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.67:36443 (local address 127.11.206.65:32805)
0812 00:01:44.269190 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0812 00:01:44.269201 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:01:44.269262 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:01:44.269364 (+ 102us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:01:44.269365 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:01:44.269366 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:01:44.269521 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:44.269523 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:44.270126 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:44.270127 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:44.270888 (+ 761us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:44.270891 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:44.271406 (+ 515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:44.271407 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:44.271479 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:44.271483 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:01:44.271530 (+ 47us) client_negotiation.cc:240] Negotiation successful
0812 00:01:44.271566 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":184,"threads_started":1}
I20260812 00:01:44.271826 13684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1127019efd4d11b514ac90ac0bac57" candidate_uuid: "11085ea6bbc044d790f21b4e576fdd4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afbc37a86fe84d3fb4951f7fa3683913" is_pre_election: true
I20260812 00:01:44.271984 13684 raft_consensus.cc:2454] T 7d1127019efd4d11b514ac90ac0bac57 P afbc37a86fe84d3fb4951f7fa3683913 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11085ea6bbc044d790f21b4e576fdd4f in term 0.
I20260812 00:01:44.271986 13934 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1127019efd4d11b514ac90ac0bac57" candidate_uuid: "11085ea6bbc044d790f21b4e576fdd4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a210daea3bd4342a4d30c34002cf741" is_pre_election: true
I20260812 00:01:44.272141 13934 raft_consensus.cc:2454] T 7d1127019efd4d11b514ac90ac0bac57 P 4a210daea3bd4342a4d30c34002cf741 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11085ea6bbc044d790f21b4e576fdd4f in term 0.
I20260812 00:01:44.272383 13304 leader_election.cc:302] T 7d1127019efd4d11b514ac90ac0bac57 P 11085ea6bbc044d790f21b4e576fdd4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11085ea6bbc044d790f21b4e576fdd4f, 4a210daea3bd4342a4d30c34002cf741; no voters:
I20260812 00:01:44.272516 14058 raft_consensus.cc:2781] T 7d1127019efd4d11b514ac90ac0bac57 P 11085ea6bbc044d790f21b4e576fdd4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:01:44.272573 14058 raft_consensus.cc:482] T 7d1127019efd4d11b514ac90ac0bac57 P 11085ea6bbc044d790f21b4e576fdd4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:01:44.272588 14058 raft_consensus.cc:3037] T 7d1127019efd4d11b514ac90ac0bac57 P 11085ea6bbc044d790f21b4e576fdd4f [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:01:44.273859 14058 raft_consensus.cc:504] T 7d1127019efd4d11b514ac90ac0bac57 P 11085ea6bbc044d790f21b4e576fdd4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afbc37a86fe84d3fb4951f7fa3683913" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 38333 } } peers { permanent_uuid: "11085ea6bbc044d790f21b4e576fdd4f" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 42639 } } peers { permanent_uuid: "4a210daea3bd4342a4d30c34002cf741" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 36443 } }
I20260812 00:01:44.273985 14058 leader_election.cc:288] T 7d1127019efd4d11b514ac90ac0bac57 P 11085ea6bbc044d790f21b4e576fdd4f [CANDIDATE]: Term 1 election: Requested vote from peers afbc37a86fe84d3fb4951f7fa3683913 (127.11.206.66:38333), 4a210daea3bd4342a4d30c34002cf741 (127.11.206.67:36443)
I20260812 00:01:44.274128 13934 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1127019efd4d11b514ac90ac0bac57" candidate_uuid: "11085ea6bbc044d790f21b4e576fdd4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a210daea3bd4342a4d30c34002cf741"
I20260812 00:01:44.274151 13684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1127019efd4d11b514ac90ac0bac57" candidate_uuid: "11085ea6bbc044d790f21b4e576fdd4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afbc37a86fe84d3fb4951f7fa3683913"
I20260812 00:01:44.274204 13934 raft_consensus.cc:3037] T 7d1127019efd4d11b514ac90ac0bac57 P 4a210daea3bd4342a4d30c34002cf741 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:01:44.274236 13684 raft_consensus.cc:3037] T 7d1127019efd4d11b514ac90ac0bac57 P afbc37a86fe84d3fb4951f7fa3683913 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:01:44.275249 13934 raft_consensus.cc:2454] T 7d1127019efd4d11b514ac90ac0bac57 P 4a210daea3bd4342a4d30c34002cf741 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11085ea6bbc044d790f21b4e576fdd4f in term 1.
I20260812 00:01:44.275408 13304 leader_election.cc:302] T 7d1127019efd4d11b514ac90ac0bac57 P 11085ea6bbc044d790f21b4e576fdd4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11085ea6bbc044d790f21b4e576fdd4f, 4a210daea3bd4342a4d30c34002cf741; no voters:
I20260812 00:01:44.275480 13684 raft_consensus.cc:2454] T 7d1127019efd4d11b514ac90ac0bac57 P afbc37a86fe84d3fb4951f7fa3683913 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11085ea6bbc044d790f21b4e576fdd4f in term 1.
I20260812 00:01:44.275488 14058 raft_consensus.cc:2781] T 7d1127019efd4d11b514ac90ac0bac57 P 11085ea6bbc044d790f21b4e576fdd4f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:01:44.275704 14058 raft_consensus.cc:686] T 7d1127019efd4d11b514ac90ac0bac57 P 11085ea6bbc044d790f21b4e576fdd4f [term 1 LEADER]: Becoming Leader. State: Replica: 11085ea6bbc044d790f21b4e576fdd4f, State: Running, Role: LEADER
I20260812 00:01:44.275806 14058 consensus_queue.cc:237] T 7d1127019efd4d11b514ac90ac0bac57 P 11085ea6bbc044d790f21b4e576fdd4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afbc37a86fe84d3fb4951f7fa3683913" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 38333 } } peers { permanent_uuid: "11085ea6bbc044d790f21b4e576fdd4f" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 42639 } } peers { permanent_uuid: "4a210daea3bd4342a4d30c34002cf741" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 36443 } }
I20260812 00:01:44.276751 13156 catalog_manager.cc:5495] T 7d1127019efd4d11b514ac90ac0bac57 P 11085ea6bbc044d790f21b4e576fdd4f reported cstate change: term changed from 0 to 1, leader changed from <none> to 11085ea6bbc044d790f21b4e576fdd4f (127.11.206.65). New cstate: current_term: 1 leader_uuid: "11085ea6bbc044d790f21b4e576fdd4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afbc37a86fe84d3fb4951f7fa3683913" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 38333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11085ea6bbc044d790f21b4e576fdd4f" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 42639 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a210daea3bd4342a4d30c34002cf741" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 36443 } health_report { overall_health: UNKNOWN } } }
W20260812 00:01:44.287303 13774 tablet.cc:2369] T 7d1127019efd4d11b514ac90ac0bac57 P afbc37a86fe84d3fb4951f7fa3683913: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 12 00:01:44 dist-test-slave-f0tn krb5kdc[13070](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492903, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.206.65@KRBTEST.COM
I20260812 00:01:44.291133 14040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:44.284175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33616 (local address 127.11.206.65:42639)
0812 00:01:44.284233 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:44.284235 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:44.284344 (+ 109us) server_negotiation.cc:407] Connection header received
0812 00:01:44.284407 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:44.284408 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:44.284418 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:44.284464 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:01:44.284999 (+ 535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:44.285499 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:44.286187 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:44.286373 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:44.286427 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:44.288617 (+ 2190us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:01:44.288627 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:01:44.288627 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:01:44.288635 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:01:44.290068 (+ 1433us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:44.290403 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:44.290406 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:44.290407 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:44.290461 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:44.290624 (+ 163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:44.290625 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:44.290626 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:44.290768 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:01:44.290898 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:44.290967 (+ 69us) server_negotiation.cc:299] Negotiation successful
0812 00:01:44.291046 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
Aug 12 00:01:44 dist-test-slave-f0tn krb5kdc[13070](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492904, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 00:01:44 dist-test-slave-f0tn krb5kdc[13070](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492904, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.11.206.65@KRBTEST.COM
I20260812 00:01:44.313794 14040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:44.307374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33632 (local address 127.11.206.65:42639)
0812 00:01:44.307435 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:44.307437 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:44.307497 (+ 60us) server_negotiation.cc:407] Connection header received
0812 00:01:44.307562 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:44.307563 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:44.307573 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:44.307619 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:01:44.308146 (+ 527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:44.308634 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:44.309322 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:44.309581 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:44.309637 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:44.311696 (+ 2059us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:01:44.311697 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:01:44.311697 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:01:44.311703 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:01:44.312877 (+ 1174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:44.313171 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:44.313172 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:44.313172 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:44.313215 (+ 43us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:44.313340 (+ 125us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:44.313340 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:44.313340 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:44.313458 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:01:44.313530 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:44.313657 (+ 127us) server_negotiation.cc:299] Negotiation successful
0812 00:01:44.313715 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
Aug 12 00:01:44 dist-test-slave-f0tn krb5kdc[13070](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492904, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 00:01:44 dist-test-slave-f0tn krb5kdc[13070](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492904, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.206.65@KRBTEST.COM
I20260812 00:01:44.335055 14040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:44.328759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33646 (local address 127.11.206.65:42639)
0812 00:01:44.328821 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:44.328823 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:44.328882 (+ 59us) server_negotiation.cc:407] Connection header received
0812 00:01:44.328952 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:44.328953 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:44.328964 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:44.329013 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:01:44.329602 (+ 589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:44.330089 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:44.330794 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:44.330983 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:44.331038 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:44.333109 (+ 2071us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:01:44.333111 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:01:44.333112 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:01:44.333119 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:01:44.334215 (+ 1096us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:44.334510 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:44.334510 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:44.334511 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:44.334556 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:44.334681 (+ 125us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:44.334682 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:44.334682 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:44.334779 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:01:44.334850 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:44.334925 (+ 75us) server_negotiation.cc:299] Negotiation successful
0812 00:01:44.334983 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
W20260812 00:01:44.335765 13358 tablet_service.cc:2908] Rejecting scan request for tablet 7d1127019efd4d11b514ac90ac0bac57: Uninitialized: clean time has not yet been initialized
I20260812 00:01:44.336745 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 13276
I20260812 00:01:44.353739 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 13525
I20260812 00:01:44.364521 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 13781
I20260812 00:01:44.376906 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 13088
2026-08-12T00:01:44Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2149 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:01:44 dist-test-slave-f0tn krb5kdc[14088](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:01:44 dist-test-slave-f0tn krb5kdc[14088](info): set up 2 sockets
Aug 12 00:01:44 dist-test-slave-f0tn krb5kdc[14088](info): commencing operation
krb5kdc: starting...
W20260812 00:01:45.579205 12089 mini_kdc.cc:121] Time spent starting KDC: real 1.175s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/krb5kdc/test-user.keytab.
Aug 12 00:01:45 dist-test-slave-f0tn krb5kdc[14088](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492905, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:01:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:01:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.206.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab.
Entry for principal kudu/127.11.206.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab.
I20260812 00:01:45.697435 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:35071
--webserver_interface=127.11.206.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab
--principal=kudu/127.11.206.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:44639
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.206.126:35071
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:01:45.778687 14113 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:01:45.778911 14113 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:01:45.778941 14113 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:01:45.780063 14113 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:01:45.780103 14113 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260812 00:01:45.780120 14113 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:01:45.780139 14113 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:01:45.780154 14113 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:01:45.780171 14113 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:01:45.782001 14113 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:44639
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.206.126:35071
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab
--principal=kudu/127.11.206.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:35071
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.206.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14113
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:01:45.782433 14113 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:01:45.782680 14113 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:01:45.787483 14128 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:01:45.787547 14113 server_base.cc:1034] running on GCE node
W20260812 00:01:45.787492 14124 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:01:45.787493 14125 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:01:45.787912 14113 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:01:45.788196 14113 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:01:45.789345 14113 hybrid_clock.cc:648] HybridClock initialized: now 1786492905789331 us; error 30 us; skew 500 ppm
Aug 12 00:01:45 dist-test-slave-f0tn krb5kdc[14088](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492905, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:01:45.791695 14113 init.cc:377] Logged in from keytab as kudu/127.11.206.126@KRBTEST.COM (short username kudu)
I20260812 00:01:45.792099 14113 webserver.cc:460] Webserver started at http://127.11.206.126:35045/ using document root <none> and password file <none>
I20260812 00:01:45.792294 14113 fs_manager.cc:359] Metadata directory not provided
I20260812 00:01:45.792332 14113 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:01:45.792425 14113 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:01:45.793491 14113 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/minicluster-data/master-0/data/instance:
uuid: "6356127de1274c789efd271bae36d0d9"
format_stamp: "Formatted at 2026-08-12 00:01:45 on dist-test-slave-f0tn"
server_key: "f2f42a1c3e08993631f2d01586b8c8a0"
server_key_iv: "1f2b57cbb17339f907b48c83cbe79413"
server_key_version: "encryptionkey@0"
I20260812 00:01:45.793797 14113 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/minicluster-data/master-0/wal/instance:
uuid: "6356127de1274c789efd271bae36d0d9"
format_stamp: "Formatted at 2026-08-12 00:01:45 on dist-test-slave-f0tn"
server_key: "f2f42a1c3e08993631f2d01586b8c8a0"
server_key_iv: "1f2b57cbb17339f907b48c83cbe79413"
server_key_version: "encryptionkey@0"
I20260812 00:01:45.794970 14113 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:01:45.795614 14141 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:45.795758 14113 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:01:45.795840 14113 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/minicluster-data/master-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/minicluster-data/master-0/wal
uuid: "6356127de1274c789efd271bae36d0d9"
format_stamp: "Formatted at 2026-08-12 00:01:45 on dist-test-slave-f0tn"
server_key: "f2f42a1c3e08993631f2d01586b8c8a0"
server_key_iv: "1f2b57cbb17339f907b48c83cbe79413"
server_key_version: "encryptionkey@0"
I20260812 00:01:45.795898 14113 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:01:45.814361 14113 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:01:45.816157 14113 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:01:45.816301 14113 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:01:45.821025 14113 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.126:35071
I20260812 00:01:45.821141 14241 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.126:35071 every 8 connection(s)
I20260812 00:01:45.821471 14113 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
I20260812 00:01:45.822070 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 14113
I20260812 00:01:45.822144 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/minicluster-data/master-0/wal/instance
I20260812 00:01:45.822217 14244 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:01:45.822301 12089 external_mini_cluster.cc:1428] Setting key d8de00361422b31c1bd8fa3fac92e28a
I20260812 00:01:45.825677 14244 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6356127de1274c789efd271bae36d0d9: Bootstrap starting.
I20260812 00:01:45.826376 14244 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6356127de1274c789efd271bae36d0d9: Neither blocks nor log segments found. Creating new log.
I20260812 00:01:45.826651 14244 log.cc:824] T 00000000000000000000000000000000 P 6356127de1274c789efd271bae36d0d9: Log is configured to *not* fsync() on all Append() calls
I20260812 00:01:45.827402 14244 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6356127de1274c789efd271bae36d0d9: No bootstrap required, opened a new log
Aug 12 00:01:45 dist-test-slave-f0tn krb5kdc[14088](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492905, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:01:45.829351 14244 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6356127de1274c789efd271bae36d0d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6356127de1274c789efd271bae36d0d9" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 35071 } }
I20260812 00:01:45.829533 14244 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6356127de1274c789efd271bae36d0d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:01:45.829576 14244 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6356127de1274c789efd271bae36d0d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6356127de1274c789efd271bae36d0d9, State: Initialized, Role: FOLLOWER
I20260812 00:01:45.829712 14244 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6356127de1274c789efd271bae36d0d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6356127de1274c789efd271bae36d0d9" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 35071 } }
I20260812 00:01:45.829777 14244 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6356127de1274c789efd271bae36d0d9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:01:45.829808 14244 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6356127de1274c789efd271bae36d0d9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:01:45.829856 14244 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6356127de1274c789efd271bae36d0d9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:01:45.830489 14244 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6356127de1274c789efd271bae36d0d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6356127de1274c789efd271bae36d0d9" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 35071 } }
I20260812 00:01:45.830608 14244 leader_election.cc:302] T 00000000000000000000000000000000 P 6356127de1274c789efd271bae36d0d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6356127de1274c789efd271bae36d0d9; no voters:
I20260812 00:01:45.830792 14244 leader_election.cc:288] T 00000000000000000000000000000000 P 6356127de1274c789efd271bae36d0d9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:01:45.830830 14260 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6356127de1274c789efd271bae36d0d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:01:45.830933 14260 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6356127de1274c789efd271bae36d0d9 [term 1 LEADER]: Becoming Leader. State: Replica: 6356127de1274c789efd271bae36d0d9, State: Running, Role: LEADER
I20260812 00:01:45.831079 14244 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6356127de1274c789efd271bae36d0d9 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:01:45.831085 14260 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6356127de1274c789efd271bae36d0d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6356127de1274c789efd271bae36d0d9" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 35071 } }
I20260812 00:01:45.831502 14262 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6356127de1274c789efd271bae36d0d9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6356127de1274c789efd271bae36d0d9. Latest consensus state: current_term: 1 leader_uuid: "6356127de1274c789efd271bae36d0d9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6356127de1274c789efd271bae36d0d9" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 35071 } } }
I20260812 00:01:45.831727 14262 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6356127de1274c789efd271bae36d0d9 [sys.catalog]: This master's current role is: LEADER
I20260812 00:01:45.831660 14261 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6356127de1274c789efd271bae36d0d9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6356127de1274c789efd271bae36d0d9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6356127de1274c789efd271bae36d0d9" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 35071 } } }
I20260812 00:01:45.831988 14261 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6356127de1274c789efd271bae36d0d9 [sys.catalog]: This master's current role is: LEADER
I20260812 00:01:45.832155 14276 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:01:45.832697 14276 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:01:45.834097 14256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:45.822822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35570 (local address 127.11.206.126:35071)
0812 00:01:45.823018 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:45.823029 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:45.823065 (+ 36us) server_negotiation.cc:407] Connection header received
0812 00:01:45.823755 (+ 690us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:45.823766 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:45.823836 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:45.823994 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:01:45.824570 (+ 576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:45.825948 (+ 1378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:45.826719 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:45.827274 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:45.827385 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:45.829725 (+ 2340us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:01:45.829730 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:01:45.829730 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:01:45.829742 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:01:45.832244 (+ 2502us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:45.832687 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:45.832691 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:45.832691 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:45.832826 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:45.833123 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:45.833124 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:45.833125 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:45.833462 (+ 337us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:01:45.833616 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:45.833741 (+ 125us) server_negotiation.cc:299] Negotiation successful
0812 00:01:45.833886 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":88,"threads_started":1}
I20260812 00:01:45.834533 14276 catalog_manager.cc:1347] Generated new cluster ID: 02fa105397504bfebf8586dee5a740a3
I20260812 00:01:45.834623 14276 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:01:45.841315 14276 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:01:45.841990 14276 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:01:45.844892 14276 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6356127de1274c789efd271bae36d0d9: Generated new TSK 0
I20260812 00:01:45.845062 14276 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.206.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.65.keytab.
Entry for principal kudu/127.11.206.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.65.keytab.
I20260812 00:01:45.870373 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.65:0
--local_ip_for_outbound_sockets=127.11.206.65
--webserver_interface=127.11.206.65
--webserver_port=0
--tserver_master_addrs=127.11.206.126:35071
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.65.keytab
--principal=kudu/127.11.206.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:44639
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:01:45.952165 14296 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:01:45.952382 14296 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:01:45.952405 14296 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:01:45.953603 14296 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:01:45.953697 14296 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:01:45.953740 14296 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 00:01:45.953769 14296 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.65
I20260812 00:01:45.955330 14296 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:44639
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.65.keytab
--principal=kudu/127.11.206.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.206.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.206.126:35071
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14296
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.65
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:01:45.955567 14296 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:01:45.955801 14296 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:01:45.960762 14310 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:01:45.960748 14296 server_base.cc:1034] running on GCE node
W20260812 00:01:45.960721 14314 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:01:45.960714 14309 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:01:45.961112 14296 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:01:45.961392 14296 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:01:45.962541 14296 hybrid_clock.cc:648] HybridClock initialized: now 1786492905962528 us; error 30 us; skew 500 ppm
Aug 12 00:01:45 dist-test-slave-f0tn krb5kdc[14088](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492905, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:01:45.964977 14296 init.cc:377] Logged in from keytab as kudu/127.11.206.65@KRBTEST.COM (short username kudu)
I20260812 00:01:45.965427 14296 webserver.cc:460] Webserver started at http://127.11.206.65:46673/ using document root <none> and password file <none>
I20260812 00:01:45.965621 14296 fs_manager.cc:359] Metadata directory not provided
I20260812 00:01:45.965660 14296 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:01:45.965752 14296 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:01:45.966758 14296 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/minicluster-data/ts-0/data/instance:
uuid: "55a1716880c7419a90ef5062e0fdb5e8"
format_stamp: "Formatted at 2026-08-12 00:01:45 on dist-test-slave-f0tn"
server_key: "714588599394b08479f1f10e7f6bb38a"
server_key_iv: "e0849e6beff3f8854f0837bfbf5e8116"
server_key_version: "encryptionkey@0"
I20260812 00:01:45.967059 14296 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/minicluster-data/ts-0/wal/instance:
uuid: "55a1716880c7419a90ef5062e0fdb5e8"
format_stamp: "Formatted at 2026-08-12 00:01:45 on dist-test-slave-f0tn"
server_key: "714588599394b08479f1f10e7f6bb38a"
server_key_iv: "e0849e6beff3f8854f0837bfbf5e8116"
server_key_version: "encryptionkey@0"
I20260812 00:01:45.968359 14296 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:01:45.969044 14325 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:45.969194 14296 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:01:45.969287 14296 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/minicluster-data/ts-0/wal
uuid: "55a1716880c7419a90ef5062e0fdb5e8"
format_stamp: "Formatted at 2026-08-12 00:01:45 on dist-test-slave-f0tn"
server_key: "714588599394b08479f1f10e7f6bb38a"
server_key_iv: "e0849e6beff3f8854f0837bfbf5e8116"
server_key_version: "encryptionkey@0"
I20260812 00:01:45.969353 14296 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:01:46.019073 14296 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:01:46.021320 14296 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:01:46.021478 14296 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:01:46.022025 14296 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:01:46.022068 14296 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:46.022089 14296 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:01:46.022101 14296 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:46.028364 14296 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.65:34127
I20260812 00:01:46.028424 14535 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.65:34127 every 8 connection(s)
I20260812 00:01:46.028780 14296 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
Aug 12 00:01:46 dist-test-slave-f0tn krb5kdc[14088](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492905, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.65@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:01:46.031970 14256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:46.022479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.65:59553 (local address 127.11.206.126:35071)
0812 00:01:46.022542 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:46.022544 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:46.022771 (+ 227us) server_negotiation.cc:407] Connection header received
0812 00:01:46.023259 (+ 488us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:46.023260 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:46.023273 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:46.023311 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:01:46.024146 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:46.024918 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:46.026525 (+ 1607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:46.026738 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:46.026797 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:46.029364 (+ 2567us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:01:46.029365 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:01:46.029365 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:01:46.029390 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:01:46.030685 (+ 1295us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:46.031112 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:46.031113 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:46.031113 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:46.031165 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:46.031344 (+ 179us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:46.031344 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:46.031345 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:46.031447 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:01:46.031491 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:46.031788 (+ 297us) server_negotiation.cc:299] Negotiation successful
0812 00:01:46.031895 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260812 00:01:46.032095 14341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:46.022448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:35071 (local address 127.11.206.65:59553)
0812 00:01:46.022620 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0812 00:01:46.022662 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 00:01:46.023167 (+ 505us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:01:46.023406 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:01:46.023410 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:01:46.023769 (+ 359us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:01:46.024052 (+ 283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:46.024060 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:46.025041 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:46.025043 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:46.026417 (+ 1374us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:46.026421 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:46.026825 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:46.026826 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:46.026982 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:46.027580 (+ 598us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:01:46.027592 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:01:46.029284 (+ 1692us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:01:46.030820 (+ 1536us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:01:46.030827 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:01:46.030829 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:01:46.031044 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:01:46.031210 (+ 166us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:01:46.031210 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:01:46.031211 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:01:46.031302 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:01:46.031487 (+ 185us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:01:46.031490 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:01:46.031678 (+ 188us) client_negotiation.cc:769] Sending connection context
0812 00:01:46.031764 (+ 86us) client_negotiation.cc:240] Negotiation successful
0812 00:01:46.031910 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":75,"threads_started":1}
I20260812 00:01:46.032578 14537 heartbeater.cc:347] Connected to a master server at 127.11.206.126:35071
I20260812 00:01:46.032684 14537 heartbeater.cc:464] Registering TS with master...
I20260812 00:01:46.032866 14537 heartbeater.cc:511] Master 127.11.206.126:35071 requested a full tablet report, sending...
I20260812 00:01:46.033439 14170 ts_manager.cc:194] Registered new tserver with Master: 55a1716880c7419a90ef5062e0fdb5e8 (127.11.206.65:34127)
I20260812 00:01:46.034360 14170 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.206.65@KRBTEST.COM'} at 127.11.206.65:59553
I20260812 00:01:46.035995 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 14296
I20260812 00:01:46.036093 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/minicluster-data/ts-0/wal/instance
I20260812 00:01:46.036521 12089 external_mini_cluster.cc:1428] Setting key 5b6fa273b9be9aae53dbdb24554199a0
I20260812 00:01:46.039451 14548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:46.033595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:35071 (local address 127.11.206.65:38791)
0812 00:01:46.033735 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0812 00:01:46.033745 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:01:46.033801 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:01:46.033909 (+ 108us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:01:46.033910 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:01:46.034100 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:01:46.034174 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:46.034175 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:46.034892 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:46.034893 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:46.035550 (+ 657us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:46.035552 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:46.035930 (+ 378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:46.035931 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:46.035998 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:46.036407 (+ 409us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:01:46.036411 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:01:46.036807 (+ 396us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:01:46.038508 (+ 1701us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:01:46.038509 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:01:46.038509 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:01:46.038676 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:01:46.038879 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:01:46.038880 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:01:46.038880 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:01:46.038931 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:01:46.039188 (+ 257us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:01:46.039189 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:01:46.039226 (+ 37us) client_negotiation.cc:769] Sending connection context
0812 00:01:46.039296 (+ 70us) client_negotiation.cc:240] Negotiation successful
0812 00:01:46.039375 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"mutex_wait_us":34,"thread_start_us":77,"threads_started":1}
I20260812 00:01:46.039496 14256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:46.033629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.65:38791 (local address 127.11.206.126:35071)
0812 00:01:46.033663 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:46.033665 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:46.033797 (+ 132us) server_negotiation.cc:407] Connection header received
0812 00:01:46.033852 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:46.033853 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:46.033861 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:46.033904 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:01:46.034224 (+ 320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:46.034809 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:46.035622 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:46.035868 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:46.035937 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:46.036896 (+ 959us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:01:46.036898 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:01:46.036898 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:01:46.036906 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:01:46.038423 (+ 1517us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:46.038756 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:46.038757 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:46.038757 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:46.038822 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:46.038987 (+ 165us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:46.038988 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:46.038989 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:46.039135 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:01:46.039191 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:46.039332 (+ 141us) server_negotiation.cc:299] Negotiation successful
0812 00:01:46.039412 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
WARNING: no policy specified for kudu/127.11.206.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.66.keytab.
Entry for principal kudu/127.11.206.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.66.keytab.
I20260812 00:01:46.060024 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.66:0
--local_ip_for_outbound_sockets=127.11.206.66
--webserver_interface=127.11.206.66
--webserver_port=0
--tserver_master_addrs=127.11.206.126:35071
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.66.keytab
--principal=kudu/127.11.206.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:44639
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:01:46.142248 14556 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:01:46.142458 14556 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:01:46.142481 14556 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:01:46.143625 14556 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:01:46.143662 14556 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:01:46.143682 14556 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 00:01:46.143698 14556 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.66
I20260812 00:01:46.145103 14556 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:44639
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.66.keytab
--principal=kudu/127.11.206.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.206.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.206.126:35071
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14556
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.66
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:01:46.145300 14556 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:01:46.145514 14556 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:01:46.150501 14564 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:01:46.150568 14565 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:01:46.150516 14556 server_base.cc:1034] running on GCE node
W20260812 00:01:46.150501 14569 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:01:46.150895 14556 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:01:46.151126 14556 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:01:46.152262 14556 hybrid_clock.cc:648] HybridClock initialized: now 1786492906152248 us; error 31 us; skew 500 ppm
Aug 12 00:01:46 dist-test-slave-f0tn krb5kdc[14088](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492906, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:01:46.154735 14556 init.cc:377] Logged in from keytab as kudu/127.11.206.66@KRBTEST.COM (short username kudu)
I20260812 00:01:46.155146 14556 webserver.cc:460] Webserver started at http://127.11.206.66:39045/ using document root <none> and password file <none>
I20260812 00:01:46.155380 14556 fs_manager.cc:359] Metadata directory not provided
I20260812 00:01:46.155427 14556 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:01:46.155555 14556 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:01:46.156623 14556 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/minicluster-data/ts-1/data/instance:
uuid: "65648c86dde64d35be8cce4d1499838a"
format_stamp: "Formatted at 2026-08-12 00:01:46 on dist-test-slave-f0tn"
server_key: "429fff94ebe789e75038d3de47a3cac4"
server_key_iv: "ffb0252e3243df6b542d6dd3bfacd23f"
server_key_version: "encryptionkey@0"
I20260812 00:01:46.156960 14556 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/minicluster-data/ts-1/wal/instance:
uuid: "65648c86dde64d35be8cce4d1499838a"
format_stamp: "Formatted at 2026-08-12 00:01:46 on dist-test-slave-f0tn"
server_key: "429fff94ebe789e75038d3de47a3cac4"
server_key_iv: "ffb0252e3243df6b542d6dd3bfacd23f"
server_key_version: "encryptionkey@0"
I20260812 00:01:46.158308 14556 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 00:01:46.158983 14583 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:46.159133 14556 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:46.159215 14556 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/minicluster-data/ts-1/wal
uuid: "65648c86dde64d35be8cce4d1499838a"
format_stamp: "Formatted at 2026-08-12 00:01:46 on dist-test-slave-f0tn"
server_key: "429fff94ebe789e75038d3de47a3cac4"
server_key_iv: "ffb0252e3243df6b542d6dd3bfacd23f"
server_key_version: "encryptionkey@0"
I20260812 00:01:46.159276 14556 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:01:46.173110 14556 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:01:46.175021 14556 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:01:46.175170 14556 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:01:46.175676 14556 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:01:46.175720 14556 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:46.175751 14556 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:01:46.175770 14556 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 00:01:46 dist-test-slave-f0tn krb5kdc[14088](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492906, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.66@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:01:46.182518 14556 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.66:45863
I20260812 00:01:46.182593 14785 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.66:45863 every 8 connection(s)
I20260812 00:01:46.182962 14556 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
I20260812 00:01:46.184748 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 14556
I20260812 00:01:46.184823 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/minicluster-data/ts-1/wal/instance
I20260812 00:01:46.184980 12089 external_mini_cluster.cc:1428] Setting key 68b5d5bec1cda3cd7a12f9f46d89e0ee
I20260812 00:01:46.185220 14256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:46.176182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.66:55389 (local address 127.11.206.126:35071)
0812 00:01:46.176222 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:46.176224 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:46.176450 (+ 226us) server_negotiation.cc:407] Connection header received
0812 00:01:46.176951 (+ 501us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:46.176953 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:46.176966 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:46.177036 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:01:46.177874 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:46.178625 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:46.179690 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:46.179890 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:46.179947 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:46.182453 (+ 2506us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:01:46.182455 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:01:46.182456 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:01:46.182465 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:01:46.183885 (+ 1420us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:46.184278 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:46.184279 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:46.184280 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:46.184340 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:46.184554 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:46.184555 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:46.184555 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:46.184692 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:01:46.184748 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:46.185046 (+ 298us) server_negotiation.cc:299] Negotiation successful
0812 00:01:46.185131 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260812 00:01:46.185408 14599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:46.176188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:35071 (local address 127.11.206.66:55389)
0812 00:01:46.176340 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0812 00:01:46.176376 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0812 00:01:46.176849 (+ 473us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:01:46.177100 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:01:46.177104 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:01:46.177478 (+ 374us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:01:46.177764 (+ 286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:46.177771 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:46.178740 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:46.178741 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:46.179600 (+ 859us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:46.179603 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:46.179977 (+ 374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:46.179978 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:46.180102 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:46.180567 (+ 465us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:01:46.180577 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:01:46.182342 (+ 1765us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:01:46.183962 (+ 1620us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:01:46.183969 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:01:46.183971 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:01:46.184187 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:01:46.184391 (+ 204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:01:46.184392 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:01:46.184392 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:01:46.184499 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:01:46.184747 (+ 248us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:01:46.184762 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:01:46.184922 (+ 160us) client_negotiation.cc:769] Sending connection context
0812 00:01:46.185013 (+ 91us) client_negotiation.cc:240] Negotiation successful
0812 00:01:46.185174 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":92,"threads_started":1}
I20260812 00:01:46.185796 14790 heartbeater.cc:347] Connected to a master server at 127.11.206.126:35071
I20260812 00:01:46.185873 14790 heartbeater.cc:464] Registering TS with master...
I20260812 00:01:46.186054 14790 heartbeater.cc:511] Master 127.11.206.126:35071 requested a full tablet report, sending...
I20260812 00:01:46.187405 14171 ts_manager.cc:194] Registered new tserver with Master: 65648c86dde64d35be8cce4d1499838a (127.11.206.66:45863)
I20260812 00:01:46.187880 14171 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.206.66@KRBTEST.COM'} at 127.11.206.66:55389
I20260812 00:01:46.192242 14256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:46.186801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.66:46001 (local address 127.11.206.126:35071)
0812 00:01:46.186839 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:46.186841 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:46.186910 (+ 69us) server_negotiation.cc:407] Connection header received
0812 00:01:46.186976 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:46.186977 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:46.186985 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:46.187031 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:01:46.187333 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:46.188028 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:46.188928 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:46.189125 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:46.189177 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:46.190027 (+ 850us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:01:46.190028 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:01:46.190029 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:01:46.190035 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:01:46.191218 (+ 1183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:46.191510 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:46.191511 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:46.191511 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:46.191563 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:46.191720 (+ 157us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:46.191722 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:46.191722 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:46.191872 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:01:46.191930 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:46.192078 (+ 148us) server_negotiation.cc:299] Negotiation successful
0812 00:01:46.192151 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 00:01:46.192267 14797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:46.186733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:35071 (local address 127.11.206.66:46001)
0812 00:01:46.186857 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0812 00:01:46.186867 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:01:46.186924 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:01:46.187035 (+ 111us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:01:46.187036 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:01:46.187197 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:01:46.187266 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:46.187268 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:46.188110 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:46.188111 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:46.188851 (+ 740us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:46.188854 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:46.189183 (+ 329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:46.189184 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:46.189245 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:46.189651 (+ 406us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:01:46.189655 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:01:46.189947 (+ 292us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:01:46.191293 (+ 1346us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:01:46.191294 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:01:46.191294 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:01:46.191450 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:01:46.191614 (+ 164us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:01:46.191615 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:01:46.191615 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:01:46.191672 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:01:46.191931 (+ 259us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:01:46.191932 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:01:46.191975 (+ 43us) client_negotiation.cc:769] Sending connection context
0812 00:01:46.192045 (+ 70us) client_negotiation.cc:240] Negotiation successful
0812 00:01:46.192147 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":72,"threads_started":1}
WARNING: no policy specified for kudu/127.11.206.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.67.keytab.
Entry for principal kudu/127.11.206.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.67.keytab.
I20260812 00:01:46.209645 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.67:0
--local_ip_for_outbound_sockets=127.11.206.67
--webserver_interface=127.11.206.67
--webserver_port=0
--tserver_master_addrs=127.11.206.126:35071
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.67.keytab
--principal=kudu/127.11.206.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:44639
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:01:46.292766 14801 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:01:46.292981 14801 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:01:46.293005 14801 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:01:46.294180 14801 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:01:46.294222 14801 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:01:46.294250 14801 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 00:01:46.294274 14801 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.67
I20260812 00:01:46.295749 14801 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:44639
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.67.keytab
--principal=kudu/127.11.206.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.206.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.206.126:35071
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14801
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.67
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:01:46.295938 14801 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:01:46.296120 14801 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:01:46.300926 14819 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:01:46.300941 14808 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:01:46.300935 14812 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:01:46.301116 14801 server_base.cc:1034] running on GCE node
I20260812 00:01:46.301329 14801 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:01:46.301589 14801 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:01:46.302765 14801 hybrid_clock.cc:648] HybridClock initialized: now 1786492906302747 us; error 33 us; skew 500 ppm
Aug 12 00:01:46 dist-test-slave-f0tn krb5kdc[14088](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492906, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:01:46.305462 14801 init.cc:377] Logged in from keytab as kudu/127.11.206.67@KRBTEST.COM (short username kudu)
I20260812 00:01:46.305927 14801 webserver.cc:460] Webserver started at http://127.11.206.67:41877/ using document root <none> and password file <none>
I20260812 00:01:46.306146 14801 fs_manager.cc:359] Metadata directory not provided
I20260812 00:01:46.306197 14801 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:01:46.306331 14801 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:01:46.307367 14801 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/minicluster-data/ts-2/data/instance:
uuid: "6e9fad10aa064962b1977ea336d81e49"
format_stamp: "Formatted at 2026-08-12 00:01:46 on dist-test-slave-f0tn"
server_key: "136164b5b653322ee8d400b3dbe99a8e"
server_key_iv: "4a82254a155b2c1e2ee855630eff2171"
server_key_version: "encryptionkey@0"
I20260812 00:01:46.307711 14801 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/minicluster-data/ts-2/wal/instance:
uuid: "6e9fad10aa064962b1977ea336d81e49"
format_stamp: "Formatted at 2026-08-12 00:01:46 on dist-test-slave-f0tn"
server_key: "136164b5b653322ee8d400b3dbe99a8e"
server_key_iv: "4a82254a155b2c1e2ee855630eff2171"
server_key_version: "encryptionkey@0"
I20260812 00:01:46.309016 14801 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 00:01:46.309893 14834 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:46.310066 14801 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260812 00:01:46.310164 14801 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/minicluster-data/ts-2/wal
uuid: "6e9fad10aa064962b1977ea336d81e49"
format_stamp: "Formatted at 2026-08-12 00:01:46 on dist-test-slave-f0tn"
server_key: "136164b5b653322ee8d400b3dbe99a8e"
server_key_iv: "4a82254a155b2c1e2ee855630eff2171"
server_key_version: "encryptionkey@0"
I20260812 00:01:46.310232 14801 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:01:46.334851 14801 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:01:46.336796 14801 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:01:46.336938 14801 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:01:46.337486 14801 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:01:46.337530 14801 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:46.337561 14801 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:01:46.337585 14801 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 00:01:46 dist-test-slave-f0tn krb5kdc[14088](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492906, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.67@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:01:46.344659 14801 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.67:44465
I20260812 00:01:46.345214 14801 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
I20260812 00:01:46.345468 15055 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.67:44465 every 8 connection(s)
I20260812 00:01:46.347702 14256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:46.337927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.67:35281 (local address 127.11.206.126:35071)
0812 00:01:46.337968 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:46.337969 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:46.338238 (+ 269us) server_negotiation.cc:407] Connection header received
0812 00:01:46.338771 (+ 533us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:46.338772 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:46.338786 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:46.338858 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:01:46.339510 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:46.340293 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:46.341794 (+ 1501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:46.341992 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:46.342047 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:46.344504 (+ 2457us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:01:46.344506 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:01:46.344506 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:01:46.344514 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:01:46.346398 (+ 1884us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:46.346815 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:46.346816 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:46.346816 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:46.346879 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:46.347093 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:46.347094 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:46.347094 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:46.347214 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:01:46.347269 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:46.347523 (+ 254us) server_negotiation.cc:299] Negotiation successful
0812 00:01:46.347614 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 00:01:46.347868 14848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:46.337939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:35071 (local address 127.11.206.67:35281)
0812 00:01:46.338117 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0812 00:01:46.338155 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 00:01:46.338654 (+ 499us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:01:46.338923 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:01:46.338927 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:01:46.339235 (+ 308us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:01:46.339434 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:46.339440 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:46.340414 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:46.340415 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:46.341693 (+ 1278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:46.341696 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:46.342079 (+ 383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:46.342080 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:46.342215 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:46.342685 (+ 470us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:01:46.342693 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:01:46.344385 (+ 1692us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:01:46.346493 (+ 2108us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:01:46.346499 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:01:46.346501 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:01:46.346744 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:01:46.346935 (+ 191us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:01:46.346935 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:01:46.346936 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:01:46.347035 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:01:46.347269 (+ 234us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:01:46.347275 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:01:46.347408 (+ 133us) client_negotiation.cc:769] Sending connection context
0812 00:01:46.347495 (+ 87us) client_negotiation.cc:240] Negotiation successful
0812 00:01:46.347655 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":78,"threads_started":1}
I20260812 00:01:46.348338 15057 heartbeater.cc:347] Connected to a master server at 127.11.206.126:35071
I20260812 00:01:46.348428 15057 heartbeater.cc:464] Registering TS with master...
I20260812 00:01:46.348613 15057 heartbeater.cc:511] Master 127.11.206.126:35071 requested a full tablet report, sending...
I20260812 00:01:46.348991 14170 ts_manager.cc:194] Registered new tserver with Master: 6e9fad10aa064962b1977ea336d81e49 (127.11.206.67:44465)
I20260812 00:01:46.349458 14170 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.206.67@KRBTEST.COM'} at 127.11.206.67:35281
I20260812 00:01:46.354090 14256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:46.349348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.67:40025 (local address 127.11.206.126:35071)
0812 00:01:46.349408 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:46.349410 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:46.349456 (+ 46us) server_negotiation.cc:407] Connection header received
0812 00:01:46.349525 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:46.349525 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:46.349534 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:46.349588 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:01:46.349967 (+ 379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:46.350526 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:46.351220 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:46.351404 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:46.351463 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:46.352215 (+ 752us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:01:46.352216 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:01:46.352216 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:01:46.352221 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:01:46.353239 (+ 1018us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:46.353560 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:46.353560 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:46.353561 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:46.353605 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:46.353732 (+ 127us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:46.353732 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:46.353732 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:46.353837 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:01:46.353880 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:46.353979 (+ 99us) server_negotiation.cc:299] Negotiation successful
0812 00:01:46.354032 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260812 00:01:46.354099 15066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:46.349259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:35071 (local address 127.11.206.67:40025)
0812 00:01:46.349400 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0812 00:01:46.349411 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:01:46.349472 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:01:46.349632 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:01:46.349633 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:01:46.349836 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:01:46.349894 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:46.349896 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:46.350599 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:46.350599 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:46.351086 (+ 487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:46.351087 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:46.351464 (+ 377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:46.351465 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:46.351515 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:46.351840 (+ 325us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:01:46.351843 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:01:46.352135 (+ 292us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:01:46.353302 (+ 1167us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:01:46.353303 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:01:46.353303 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:01:46.353506 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:01:46.353650 (+ 144us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:01:46.353650 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:01:46.353651 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:01:46.353698 (+ 47us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:01:46.353875 (+ 177us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:01:46.353876 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:01:46.353919 (+ 43us) client_negotiation.cc:769] Sending connection context
0812 00:01:46.353962 (+ 43us) client_negotiation.cc:240] Negotiation successful
0812 00:01:46.354031 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":92,"thread_start_us":63,"threads_started":1}
I20260812 00:01:46.355333 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 14801
I20260812 00:01:46.355430 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/minicluster-data/ts-2/wal/instance
I20260812 00:01:46.355593 12089 external_mini_cluster.cc:1428] Setting key 394b4e9f9c791804c2fe2a99f1c3b0a4
I20260812 00:01:46.356220 12089 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 00:01:46 dist-test-slave-f0tn krb5kdc[14088](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492906, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 00:01:46 dist-test-slave-f0tn krb5kdc[14088](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492906, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:01:46.377372 14256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:46.371298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35578 (local address 127.11.206.126:35071)
0812 00:01:46.371352 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:46.371354 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:46.371363 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:01:46.371389 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:46.371390 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:46.371399 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:46.371447 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:01:46.371973 (+ 526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:46.372461 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:46.373142 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:46.373332 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:46.373424 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:46.375491 (+ 2067us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:01:46.375492 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:01:46.375492 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:01:46.375499 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:01:46.376538 (+ 1039us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:46.376823 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:46.376824 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:46.376824 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:46.376867 (+ 43us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:46.376994 (+ 127us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:46.376995 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:46.376995 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:46.377085 (+ 90us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:01:46.377153 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:46.377248 (+ 95us) server_negotiation.cc:299] Negotiation successful
0812 00:01:46.377305 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260812 00:01:46.378856 14170 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35578:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:01:46.380389 14170 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:01:46.387066 15094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:46.382768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57208 (local address 127.11.206.65:34127)
0812 00:01:46.383084 (+ 316us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:46.383088 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:46.383099 (+ 11us) server_negotiation.cc:407] Connection header received
0812 00:01:46.383154 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:46.383156 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:46.383172 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:46.383277 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:01:46.383429 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:46.384562 (+ 1133us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:46.385890 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:46.386542 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:46.386638 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:46.386699 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:46.386920 (+ 221us) server_negotiation.cc:299] Negotiation successful
0812 00:01:46.386964 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":282,"thread_start_us":91,"threads_started":1}
I20260812 00:01:46.387279 15096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:46.382828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41092 (local address 127.11.206.67:44465)
0812 00:01:46.383002 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:46.383006 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:46.383434 (+ 428us) server_negotiation.cc:407] Connection header received
0812 00:01:46.383495 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:46.383499 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:46.383516 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:46.383605 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:01:46.383809 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:46.384516 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:46.386132 (+ 1616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:46.386856 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:46.386923 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:46.386977 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:46.387129 (+ 152us) server_negotiation.cc:299] Negotiation successful
0812 00:01:46.387179 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":76,"threads_started":1}
I20260812 00:01:46.387080 15092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:46.382661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.65:34127 (local address 127.0.0.1:57208)
0812 00:01:46.382960 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0812 00:01:46.383005 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 00:01:46.383073 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:01:46.383267 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:01:46.383271 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:01:46.383274 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:01:46.383342 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:46.383343 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:46.384634 (+ 1291us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:46.384634 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:46.385796 (+ 1162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:46.385800 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:46.386669 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:46.386670 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:46.386767 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:46.386785 (+ 18us) client_negotiation.cc:769] Sending connection context
0812 00:01:46.386897 (+ 112us) client_negotiation.cc:240] Negotiation successful
0812 00:01:46.386959 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":269,"mutex_wait_us":96,"thread_start_us":79,"threads_started":1}
I20260812 00:01:46.387480 15093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:46.382661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.67:44465 (local address 127.0.0.1:41092)
0812 00:01:46.383366 (+ 705us) negotiation.cc:107] Waiting for socket to connect
0812 00:01:46.383376 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:01:46.383429 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:01:46.383672 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:01:46.383673 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:01:46.383674 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:01:46.383725 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:46.383726 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:46.384616 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:46.384616 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:46.386045 (+ 1429us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:46.386049 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:46.386949 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:46.386950 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:46.387009 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:46.387013 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:01:46.387365 (+ 352us) client_negotiation.cc:240] Negotiation successful
0812 00:01:46.387415 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":685,"mutex_wait_us":71,"thread_start_us":61,"threads_started":1}
I20260812 00:01:46.388025 15098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:46.382865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.66:45863 (local address 127.0.0.1:40192)
0812 00:01:46.383491 (+ 626us) negotiation.cc:107] Waiting for socket to connect
0812 00:01:46.383499 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 00:01:46.383539 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:01:46.383736 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:01:46.383737 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:01:46.383739 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:01:46.383775 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:46.383776 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:46.384827 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:46.384828 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:46.386052 (+ 1224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:46.386054 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:46.387770 (+ 1716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:46.387771 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:46.387835 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:46.387840 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 00:01:46.387907 (+ 67us) client_negotiation.cc:240] Negotiation successful
0812 00:01:46.387947 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":613,"thread_start_us":69,"threads_started":1}
I20260812 00:01:46.388056 15101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:46.382973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40192 (local address 127.11.206.66:45863)
0812 00:01:46.383158 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:46.383163 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:46.383589 (+ 426us) server_negotiation.cc:407] Connection header received
0812 00:01:46.383633 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:46.383635 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:46.383650 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:46.383730 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:01:46.383833 (+ 103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:46.384781 (+ 948us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:46.387014 (+ 2233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:46.387676 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:46.387760 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:46.387820 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:46.387922 (+ 102us) server_negotiation.cc:299] Negotiation successful
0812 00:01:46.387962 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":108,"threads_started":1}
I20260812 00:01:46.388140 14417 tablet_service.cc:1467] Processing CreateTablet for tablet a029b51e540f49daa69e01170162f49b (DEFAULT_TABLE table=test-table [id=06547b98368e4d6eb34b2c0451bd317b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:01:46.388188 14937 tablet_service.cc:1467] Processing CreateTablet for tablet a029b51e540f49daa69e01170162f49b (DEFAULT_TABLE table=test-table [id=06547b98368e4d6eb34b2c0451bd317b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:01:46.388507 14417 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a029b51e540f49daa69e01170162f49b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:01:46.388545 14937 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a029b51e540f49daa69e01170162f49b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:01:46.388587 14667 tablet_service.cc:1467] Processing CreateTablet for tablet a029b51e540f49daa69e01170162f49b (DEFAULT_TABLE table=test-table [id=06547b98368e4d6eb34b2c0451bd317b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:01:46.388890 14667 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a029b51e540f49daa69e01170162f49b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:01:46.391794 15103 tablet_bootstrap.cc:492] T a029b51e540f49daa69e01170162f49b P 55a1716880c7419a90ef5062e0fdb5e8: Bootstrap starting.
I20260812 00:01:46.392190 15104 tablet_bootstrap.cc:492] T a029b51e540f49daa69e01170162f49b P 6e9fad10aa064962b1977ea336d81e49: Bootstrap starting.
I20260812 00:01:46.392650 15103 tablet_bootstrap.cc:654] T a029b51e540f49daa69e01170162f49b P 55a1716880c7419a90ef5062e0fdb5e8: Neither blocks nor log segments found. Creating new log.
I20260812 00:01:46.392900 15106 tablet_bootstrap.cc:492] T a029b51e540f49daa69e01170162f49b P 65648c86dde64d35be8cce4d1499838a: Bootstrap starting.
I20260812 00:01:46.393278 15103 log.cc:824] T a029b51e540f49daa69e01170162f49b P 55a1716880c7419a90ef5062e0fdb5e8: Log is configured to *not* fsync() on all Append() calls
I20260812 00:01:46.393658 15104 tablet_bootstrap.cc:654] T a029b51e540f49daa69e01170162f49b P 6e9fad10aa064962b1977ea336d81e49: Neither blocks nor log segments found. Creating new log.
I20260812 00:01:46.393741 15106 tablet_bootstrap.cc:654] T a029b51e540f49daa69e01170162f49b P 65648c86dde64d35be8cce4d1499838a: Neither blocks nor log segments found. Creating new log.
I20260812 00:01:46.394263 15103 tablet_bootstrap.cc:492] T a029b51e540f49daa69e01170162f49b P 55a1716880c7419a90ef5062e0fdb5e8: No bootstrap required, opened a new log
I20260812 00:01:46.394276 15106 log.cc:824] T a029b51e540f49daa69e01170162f49b P 65648c86dde64d35be8cce4d1499838a: Log is configured to *not* fsync() on all Append() calls
I20260812 00:01:46.394348 15103 ts_tablet_manager.cc:1397] T a029b51e540f49daa69e01170162f49b P 55a1716880c7419a90ef5062e0fdb5e8: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260812 00:01:46.394486 15104 log.cc:824] T a029b51e540f49daa69e01170162f49b P 6e9fad10aa064962b1977ea336d81e49: Log is configured to *not* fsync() on all Append() calls
I20260812 00:01:46.395069 15106 tablet_bootstrap.cc:492] T a029b51e540f49daa69e01170162f49b P 65648c86dde64d35be8cce4d1499838a: No bootstrap required, opened a new log
I20260812 00:01:46.395148 15106 ts_tablet_manager.cc:1397] T a029b51e540f49daa69e01170162f49b P 65648c86dde64d35be8cce4d1499838a: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260812 00:01:46.395707 15104 tablet_bootstrap.cc:492] T a029b51e540f49daa69e01170162f49b P 6e9fad10aa064962b1977ea336d81e49: No bootstrap required, opened a new log
I20260812 00:01:46.395792 15104 ts_tablet_manager.cc:1397] T a029b51e540f49daa69e01170162f49b P 6e9fad10aa064962b1977ea336d81e49: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260812 00:01:46.397405 15106 raft_consensus.cc:348] T a029b51e540f49daa69e01170162f49b P 65648c86dde64d35be8cce4d1499838a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e9fad10aa064962b1977ea336d81e49" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 44465 } } peers { permanent_uuid: "55a1716880c7419a90ef5062e0fdb5e8" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 34127 } } peers { permanent_uuid: "65648c86dde64d35be8cce4d1499838a" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 45863 } }
I20260812 00:01:46.397560 15106 raft_consensus.cc:374] T a029b51e540f49daa69e01170162f49b P 65648c86dde64d35be8cce4d1499838a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:01:46.397593 15106 raft_consensus.cc:729] T a029b51e540f49daa69e01170162f49b P 65648c86dde64d35be8cce4d1499838a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65648c86dde64d35be8cce4d1499838a, State: Initialized, Role: FOLLOWER
I20260812 00:01:46.397588 15103 raft_consensus.cc:348] T a029b51e540f49daa69e01170162f49b P 55a1716880c7419a90ef5062e0fdb5e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e9fad10aa064962b1977ea336d81e49" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 44465 } } peers { permanent_uuid: "55a1716880c7419a90ef5062e0fdb5e8" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 34127 } } peers { permanent_uuid: "65648c86dde64d35be8cce4d1499838a" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 45863 } }
I20260812 00:01:46.397742 15103 raft_consensus.cc:374] T a029b51e540f49daa69e01170162f49b P 55a1716880c7419a90ef5062e0fdb5e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:01:46.397734 15106 consensus_queue.cc:260] T a029b51e540f49daa69e01170162f49b P 65648c86dde64d35be8cce4d1499838a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e9fad10aa064962b1977ea336d81e49" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 44465 } } peers { permanent_uuid: "55a1716880c7419a90ef5062e0fdb5e8" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 34127 } } peers { permanent_uuid: "65648c86dde64d35be8cce4d1499838a" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 45863 } }
I20260812 00:01:46.397789 15103 raft_consensus.cc:729] T a029b51e540f49daa69e01170162f49b P 55a1716880c7419a90ef5062e0fdb5e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55a1716880c7419a90ef5062e0fdb5e8, State: Initialized, Role: FOLLOWER
I20260812 00:01:46.397909 15103 consensus_queue.cc:260] T a029b51e540f49daa69e01170162f49b P 55a1716880c7419a90ef5062e0fdb5e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e9fad10aa064962b1977ea336d81e49" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 44465 } } peers { permanent_uuid: "55a1716880c7419a90ef5062e0fdb5e8" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 34127 } } peers { permanent_uuid: "65648c86dde64d35be8cce4d1499838a" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 45863 } }
I20260812 00:01:46.397996 15106 ts_tablet_manager.cc:1428] T a029b51e540f49daa69e01170162f49b P 65648c86dde64d35be8cce4d1499838a: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260812 00:01:46.398068 14790 heartbeater.cc:503] Master 127.11.206.126:35071 was elected leader, sending a full tablet report...
I20260812 00:01:46.398298 15103 ts_tablet_manager.cc:1428] T a029b51e540f49daa69e01170162f49b P 55a1716880c7419a90ef5062e0fdb5e8: Time spent starting tablet: real 0.004s user 0.000s sys 0.004s
I20260812 00:01:46.398321 14537 heartbeater.cc:503] Master 127.11.206.126:35071 was elected leader, sending a full tablet report...
I20260812 00:01:46.398908 15104 raft_consensus.cc:348] T a029b51e540f49daa69e01170162f49b P 6e9fad10aa064962b1977ea336d81e49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e9fad10aa064962b1977ea336d81e49" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 44465 } } peers { permanent_uuid: "55a1716880c7419a90ef5062e0fdb5e8" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 34127 } } peers { permanent_uuid: "65648c86dde64d35be8cce4d1499838a" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 45863 } }
I20260812 00:01:46.399080 15104 raft_consensus.cc:374] T a029b51e540f49daa69e01170162f49b P 6e9fad10aa064962b1977ea336d81e49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:01:46.399176 15104 raft_consensus.cc:729] T a029b51e540f49daa69e01170162f49b P 6e9fad10aa064962b1977ea336d81e49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e9fad10aa064962b1977ea336d81e49, State: Initialized, Role: FOLLOWER
I20260812 00:01:46.399317 15104 consensus_queue.cc:260] T a029b51e540f49daa69e01170162f49b P 6e9fad10aa064962b1977ea336d81e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e9fad10aa064962b1977ea336d81e49" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 44465 } } peers { permanent_uuid: "55a1716880c7419a90ef5062e0fdb5e8" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 34127 } } peers { permanent_uuid: "65648c86dde64d35be8cce4d1499838a" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 45863 } }
I20260812 00:01:46.399696 15104 ts_tablet_manager.cc:1428] T a029b51e540f49daa69e01170162f49b P 6e9fad10aa064962b1977ea336d81e49: Time spent starting tablet: real 0.004s user 0.001s sys 0.003s
I20260812 00:01:46.399762 15057 heartbeater.cc:503] Master 127.11.206.126:35071 was elected leader, sending a full tablet report...
W20260812 00:01:46.433717 14791 tablet.cc:2369] T a029b51e540f49daa69e01170162f49b P 65648c86dde64d35be8cce4d1499838a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 00:01:46.529572 14539 tablet.cc:2369] T a029b51e540f49daa69e01170162f49b P 55a1716880c7419a90ef5062e0fdb5e8: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 00:01:46.596738 15058 tablet.cc:2369] T a029b51e540f49daa69e01170162f49b P 6e9fad10aa064962b1977ea336d81e49: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:01:46.665683 15117 raft_consensus.cc:482] T a029b51e540f49daa69e01170162f49b P 55a1716880c7419a90ef5062e0fdb5e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:01:46.665848 15117 raft_consensus.cc:504] T a029b51e540f49daa69e01170162f49b P 55a1716880c7419a90ef5062e0fdb5e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e9fad10aa064962b1977ea336d81e49" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 44465 } } peers { permanent_uuid: "55a1716880c7419a90ef5062e0fdb5e8" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 34127 } } peers { permanent_uuid: "65648c86dde64d35be8cce4d1499838a" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 45863 } }
I20260812 00:01:46.666282 15117 leader_election.cc:288] T a029b51e540f49daa69e01170162f49b P 55a1716880c7419a90ef5062e0fdb5e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e9fad10aa064962b1977ea336d81e49 (127.11.206.67:44465), 65648c86dde64d35be8cce4d1499838a (127.11.206.66:45863)
I20260812 00:01:46.670506 15101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:46.666781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.65:37557 (local address 127.11.206.66:45863)
0812 00:01:46.666850 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:46.666852 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:46.666862 (+ 10us) server_negotiation.cc:407] Connection header received
0812 00:01:46.666916 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:46.666917 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:46.666926 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:46.666975 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:01:46.667187 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:46.667970 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:46.669506 (+ 1536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:46.670072 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:46.670157 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:46.670169 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:46.670399 (+ 230us) server_negotiation.cc:299] Negotiation successful
0812 00:01:46.670444 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260812 00:01:46.670506 15096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:46.666597 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.65:39611 (local address 127.11.206.67:44465)
0812 00:01:46.666649 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:46.666651 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:46.666685 (+ 34us) server_negotiation.cc:407] Connection header received
0812 00:01:46.666859 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:46.666861 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:46.666872 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:46.666925 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:01:46.667204 (+ 279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:46.667982 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:46.669506 (+ 1524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:46.670084 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:46.670191 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:46.670199 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:46.670382 (+ 183us) server_negotiation.cc:299] Negotiation successful
0812 00:01:46.670430 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260812 00:01:46.670535 15120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:46.666488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.67:44465 (local address 127.11.206.65:39611)
0812 00:01:46.666615 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0812 00:01:46.666627 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 00:01:46.666704 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:01:46.666942 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:01:46.666943 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:01:46.666945 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:01:46.667125 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:46.667127 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:46.668075 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:46.668076 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:46.669419 (+ 1343us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:46.669423 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:46.670208 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:46.670208 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:46.670287 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:46.670315 (+ 28us) client_negotiation.cc:769] Sending connection context
0812 00:01:46.670373 (+ 58us) client_negotiation.cc:240] Negotiation successful
0812 00:01:46.670424 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"mutex_wait_us":57,"thread_start_us":70,"threads_started":1}
I20260812 00:01:46.670588 15121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:46.666671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.66:45863 (local address 127.11.206.65:37557)
0812 00:01:46.666794 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0812 00:01:46.666804 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:01:46.666870 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:01:46.666981 (+ 111us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:01:46.666982 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:01:46.666983 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:01:46.667095 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:46.667098 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:46.668075 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:46.668076 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:46.669419 (+ 1343us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:46.669423 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:46.670164 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:46.670165 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:46.670343 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:46.670346 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:01:46.670392 (+ 46us) client_negotiation.cc:240] Negotiation successful
0812 00:01:46.670424 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"mutex_wait_us":33,"thread_start_us":54,"threads_started":1}
I20260812 00:01:46.670915 14981 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a029b51e540f49daa69e01170162f49b" candidate_uuid: "55a1716880c7419a90ef5062e0fdb5e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e9fad10aa064962b1977ea336d81e49" is_pre_election: true
I20260812 00:01:46.671088 14981 raft_consensus.cc:2454] T a029b51e540f49daa69e01170162f49b P 6e9fad10aa064962b1977ea336d81e49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55a1716880c7419a90ef5062e0fdb5e8 in term 0.
I20260812 00:01:46.671077 14705 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a029b51e540f49daa69e01170162f49b" candidate_uuid: "55a1716880c7419a90ef5062e0fdb5e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65648c86dde64d35be8cce4d1499838a" is_pre_election: true
I20260812 00:01:46.671247 14705 raft_consensus.cc:2454] T a029b51e540f49daa69e01170162f49b P 65648c86dde64d35be8cce4d1499838a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55a1716880c7419a90ef5062e0fdb5e8 in term 0.
I20260812 00:01:46.671355 14327 leader_election.cc:302] T a029b51e540f49daa69e01170162f49b P 55a1716880c7419a90ef5062e0fdb5e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55a1716880c7419a90ef5062e0fdb5e8, 6e9fad10aa064962b1977ea336d81e49; no voters:
I20260812 00:01:46.671482 15117 raft_consensus.cc:2781] T a029b51e540f49daa69e01170162f49b P 55a1716880c7419a90ef5062e0fdb5e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:01:46.671537 15117 raft_consensus.cc:482] T a029b51e540f49daa69e01170162f49b P 55a1716880c7419a90ef5062e0fdb5e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:01:46.671566 15117 raft_consensus.cc:3037] T a029b51e540f49daa69e01170162f49b P 55a1716880c7419a90ef5062e0fdb5e8 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:01:46.672658 15117 raft_consensus.cc:504] T a029b51e540f49daa69e01170162f49b P 55a1716880c7419a90ef5062e0fdb5e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e9fad10aa064962b1977ea336d81e49" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 44465 } } peers { permanent_uuid: "55a1716880c7419a90ef5062e0fdb5e8" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 34127 } } peers { permanent_uuid: "65648c86dde64d35be8cce4d1499838a" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 45863 } }
I20260812 00:01:46.672775 15117 leader_election.cc:288] T a029b51e540f49daa69e01170162f49b P 55a1716880c7419a90ef5062e0fdb5e8 [CANDIDATE]: Term 1 election: Requested vote from peers 6e9fad10aa064962b1977ea336d81e49 (127.11.206.67:44465), 65648c86dde64d35be8cce4d1499838a (127.11.206.66:45863)
I20260812 00:01:46.672937 14981 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a029b51e540f49daa69e01170162f49b" candidate_uuid: "55a1716880c7419a90ef5062e0fdb5e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e9fad10aa064962b1977ea336d81e49"
I20260812 00:01:46.672950 14705 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a029b51e540f49daa69e01170162f49b" candidate_uuid: "55a1716880c7419a90ef5062e0fdb5e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65648c86dde64d35be8cce4d1499838a"
I20260812 00:01:46.673012 14981 raft_consensus.cc:3037] T a029b51e540f49daa69e01170162f49b P 6e9fad10aa064962b1977ea336d81e49 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:01:46.673019 14705 raft_consensus.cc:3037] T a029b51e540f49daa69e01170162f49b P 65648c86dde64d35be8cce4d1499838a [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:01:46.673933 14981 raft_consensus.cc:2454] T a029b51e540f49daa69e01170162f49b P 6e9fad10aa064962b1977ea336d81e49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55a1716880c7419a90ef5062e0fdb5e8 in term 1.
I20260812 00:01:46.674041 14705 raft_consensus.cc:2454] T a029b51e540f49daa69e01170162f49b P 65648c86dde64d35be8cce4d1499838a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55a1716880c7419a90ef5062e0fdb5e8 in term 1.
I20260812 00:01:46.674098 14327 leader_election.cc:302] T a029b51e540f49daa69e01170162f49b P 55a1716880c7419a90ef5062e0fdb5e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55a1716880c7419a90ef5062e0fdb5e8, 6e9fad10aa064962b1977ea336d81e49; no voters:
I20260812 00:01:46.674198 15117 raft_consensus.cc:2781] T a029b51e540f49daa69e01170162f49b P 55a1716880c7419a90ef5062e0fdb5e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:01:46.674336 15117 raft_consensus.cc:686] T a029b51e540f49daa69e01170162f49b P 55a1716880c7419a90ef5062e0fdb5e8 [term 1 LEADER]: Becoming Leader. State: Replica: 55a1716880c7419a90ef5062e0fdb5e8, State: Running, Role: LEADER
I20260812 00:01:46.674430 15117 consensus_queue.cc:237] T a029b51e540f49daa69e01170162f49b P 55a1716880c7419a90ef5062e0fdb5e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e9fad10aa064962b1977ea336d81e49" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 44465 } } peers { permanent_uuid: "55a1716880c7419a90ef5062e0fdb5e8" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 34127 } } peers { permanent_uuid: "65648c86dde64d35be8cce4d1499838a" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 45863 } }
I20260812 00:01:46.675274 14170 catalog_manager.cc:5495] T a029b51e540f49daa69e01170162f49b P 55a1716880c7419a90ef5062e0fdb5e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 55a1716880c7419a90ef5062e0fdb5e8 (127.11.206.65). New cstate: current_term: 1 leader_uuid: "55a1716880c7419a90ef5062e0fdb5e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e9fad10aa064962b1977ea336d81e49" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 44465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55a1716880c7419a90ef5062e0fdb5e8" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 34127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65648c86dde64d35be8cce4d1499838a" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 45863 } health_report { overall_health: UNKNOWN } } }
I20260812 00:01:46.743499 15094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:46.741302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57218 (local address 127.11.206.65:34127)
0812 00:01:46.741354 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:46.741356 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:46.741364 (+ 8us) server_negotiation.cc:407] Connection header received
0812 00:01:46.741421 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:46.741422 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:46.741442 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:46.741496 (+ 54us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:01:46.741642 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:46.742117 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:46.742862 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:46.743036 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:46.743076 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:46.743229 (+ 153us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:01:46.743324 (+ 95us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:01:46.743377 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:46.743407 (+ 30us) server_negotiation.cc:299] Negotiation successful
0812 00:01:46.743425 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260812 00:01:46.745410 14981 raft_consensus.cc:1261] T a029b51e540f49daa69e01170162f49b P 6e9fad10aa064962b1977ea336d81e49 [term 1 FOLLOWER]: Refusing update from remote peer 55a1716880c7419a90ef5062e0fdb5e8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:01:46.745433 14705 raft_consensus.cc:1261] T a029b51e540f49daa69e01170162f49b P 65648c86dde64d35be8cce4d1499838a [term 1 FOLLOWER]: Refusing update from remote peer 55a1716880c7419a90ef5062e0fdb5e8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:01:46.745730 15117 consensus_queue.cc:1035] T a029b51e540f49daa69e01170162f49b P 55a1716880c7419a90ef5062e0fdb5e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65648c86dde64d35be8cce4d1499838a" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 45863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:01:46.745893 15124 consensus_queue.cc:1035] T a029b51e540f49daa69e01170162f49b P 55a1716880c7419a90ef5062e0fdb5e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e9fad10aa064962b1977ea336d81e49" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 44465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:01:46.748792 15133 mvcc.cc:205] Tried to move back new op lower bound from 7317474946026565632 to 7317474945739137024. Current Snapshot: MvccSnapshot[applied={T|T < 7317474946026565632}]
I20260812 00:01:46.748646 15132 mvcc.cc:205] Tried to move back new op lower bound from 7317474946026565632 to 7317474945739137024. Current Snapshot: MvccSnapshot[applied={T|T < 7317474946026565632}]
I20260812 00:01:46.753433 14171 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35578:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:01:46.753571 14171 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35578:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:01:46.754434 14171 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6356127de1274c789efd271bae36d0d9: Sending DeleteTablet for 3 replicas of tablet a029b51e540f49daa69e01170162f49b
I20260812 00:01:46.754993 14667 tablet_service.cc:1514] Processing DeleteTablet for tablet a029b51e540f49daa69e01170162f49b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:01:46 UTC) from {username='kudu', principal='kudu/127.11.206.126@KRBTEST.COM'} at 127.0.0.1:40192
I20260812 00:01:46.754979 14417 tablet_service.cc:1514] Processing DeleteTablet for tablet a029b51e540f49daa69e01170162f49b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:01:46 UTC) from {username='kudu', principal='kudu/127.11.206.126@KRBTEST.COM'} at 127.0.0.1:57208
I20260812 00:01:46.755111 14937 tablet_service.cc:1514] Processing DeleteTablet for tablet a029b51e540f49daa69e01170162f49b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:01:46 UTC) from {username='kudu', principal='kudu/127.11.206.126@KRBTEST.COM'} at 127.0.0.1:41092
I20260812 00:01:46.755405 15143 tablet_replica.cc:330] T a029b51e540f49daa69e01170162f49b P 55a1716880c7419a90ef5062e0fdb5e8: stopping tablet replica
I20260812 00:01:46.755491 15142 tablet_replica.cc:330] T a029b51e540f49daa69e01170162f49b P 65648c86dde64d35be8cce4d1499838a: stopping tablet replica
I20260812 00:01:46.755564 15143 raft_consensus.cc:2229] T a029b51e540f49daa69e01170162f49b P 55a1716880c7419a90ef5062e0fdb5e8 [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:01:46.755615 14171 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35578:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 00:01:46.755699 15143 raft_consensus.cc:2258] T a029b51e540f49daa69e01170162f49b P 55a1716880c7419a90ef5062e0fdb5e8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260812 00:01:46.755759 14171 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:01:46.756246 15144 tablet_replica.cc:330] T a029b51e540f49daa69e01170162f49b P 6e9fad10aa064962b1977ea336d81e49: stopping tablet replica
I20260812 00:01:46.756248 15143 ts_tablet_manager.cc:1905] T a029b51e540f49daa69e01170162f49b P 55a1716880c7419a90ef5062e0fdb5e8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:01:46.756441 15144 raft_consensus.cc:2229] T a029b51e540f49daa69e01170162f49b P 6e9fad10aa064962b1977ea336d81e49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:01:46.756651 15144 raft_consensus.cc:2258] T a029b51e540f49daa69e01170162f49b P 6e9fad10aa064962b1977ea336d81e49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:01:46.757126 14417 tablet_service.cc:1467] Processing CreateTablet for tablet 46f90fa067844cc6944a4d057ec71c3f (DEFAULT_TABLE table=test-table [id=3bfe275556784001979e67023d989567]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:01:46.757130 14667 tablet_service.cc:1467] Processing CreateTablet for tablet 46f90fa067844cc6944a4d057ec71c3f (DEFAULT_TABLE table=test-table [id=3bfe275556784001979e67023d989567]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:01:46.757241 15144 ts_tablet_manager.cc:1905] T a029b51e540f49daa69e01170162f49b P 6e9fad10aa064962b1977ea336d81e49: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:01:46.757257 14667 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 46f90fa067844cc6944a4d057ec71c3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:01:46.757309 14417 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 46f90fa067844cc6944a4d057ec71c3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:01:46.758843 15144 ts_tablet_manager.cc:1918] T a029b51e540f49daa69e01170162f49b P 6e9fad10aa064962b1977ea336d81e49: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:01:46.758863 15106 tablet_bootstrap.cc:492] T 46f90fa067844cc6944a4d057ec71c3f P 65648c86dde64d35be8cce4d1499838a: Bootstrap starting.
I20260812 00:01:46.758908 15144 log.cc:1196] T a029b51e540f49daa69e01170162f49b P 6e9fad10aa064962b1977ea336d81e49: Deleting WAL directory at /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/minicluster-data/ts-2/wal/wals/a029b51e540f49daa69e01170162f49b
I20260812 00:01:46.758993 15103 tablet_bootstrap.cc:492] T 46f90fa067844cc6944a4d057ec71c3f P 55a1716880c7419a90ef5062e0fdb5e8: Bootstrap starting.
I20260812 00:01:46.759173 15144 ts_tablet_manager.cc:1939] T a029b51e540f49daa69e01170162f49b P 6e9fad10aa064962b1977ea336d81e49: Deleting consensus metadata
I20260812 00:01:46.759308 15106 tablet_bootstrap.cc:654] T 46f90fa067844cc6944a4d057ec71c3f P 65648c86dde64d35be8cce4d1499838a: Neither blocks nor log segments found. Creating new log.
I20260812 00:01:46.759754 15103 tablet_bootstrap.cc:654] T 46f90fa067844cc6944a4d057ec71c3f P 55a1716880c7419a90ef5062e0fdb5e8: Neither blocks nor log segments found. Creating new log.
I20260812 00:01:46.759681 14142 catalog_manager.cc:4841] TS 6e9fad10aa064962b1977ea336d81e49 (127.11.206.67:44465): tablet a029b51e540f49daa69e01170162f49b (table test-table [id=06547b98368e4d6eb34b2c0451bd317b]) successfully deleted
I20260812 00:01:46.760025 15106 tablet_bootstrap.cc:492] T 46f90fa067844cc6944a4d057ec71c3f P 65648c86dde64d35be8cce4d1499838a: No bootstrap required, opened a new log
I20260812 00:01:46.760066 15106 ts_tablet_manager.cc:1397] T 46f90fa067844cc6944a4d057ec71c3f P 65648c86dde64d35be8cce4d1499838a: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260812 00:01:46.760268 14937 tablet_service.cc:1467] Processing CreateTablet for tablet 46f90fa067844cc6944a4d057ec71c3f (DEFAULT_TABLE table=test-table [id=3bfe275556784001979e67023d989567]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:01:46.760357 14937 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 46f90fa067844cc6944a4d057ec71c3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:01:46.760349 15106 raft_consensus.cc:348] T 46f90fa067844cc6944a4d057ec71c3f P 65648c86dde64d35be8cce4d1499838a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55a1716880c7419a90ef5062e0fdb5e8" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 34127 } } peers { permanent_uuid: "65648c86dde64d35be8cce4d1499838a" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 45863 } } peers { permanent_uuid: "6e9fad10aa064962b1977ea336d81e49" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 44465 } }
I20260812 00:01:46.760425 15106 raft_consensus.cc:374] T 46f90fa067844cc6944a4d057ec71c3f P 65648c86dde64d35be8cce4d1499838a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:01:46.760448 15106 raft_consensus.cc:729] T 46f90fa067844cc6944a4d057ec71c3f P 65648c86dde64d35be8cce4d1499838a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65648c86dde64d35be8cce4d1499838a, State: Initialized, Role: FOLLOWER
I20260812 00:01:46.760454 15143 ts_tablet_manager.cc:1918] T a029b51e540f49daa69e01170162f49b P 55a1716880c7419a90ef5062e0fdb5e8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:01:46.760514 15143 log.cc:1196] T a029b51e540f49daa69e01170162f49b P 55a1716880c7419a90ef5062e0fdb5e8: Deleting WAL directory at /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/minicluster-data/ts-0/wal/wals/a029b51e540f49daa69e01170162f49b
I20260812 00:01:46.760493 15106 consensus_queue.cc:260] T 46f90fa067844cc6944a4d057ec71c3f P 65648c86dde64d35be8cce4d1499838a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55a1716880c7419a90ef5062e0fdb5e8" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 34127 } } peers { permanent_uuid: "65648c86dde64d35be8cce4d1499838a" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 45863 } } peers { permanent_uuid: "6e9fad10aa064962b1977ea336d81e49" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 44465 } }
I20260812 00:01:46.760636 15106 ts_tablet_manager.cc:1428] T 46f90fa067844cc6944a4d057ec71c3f P 65648c86dde64d35be8cce4d1499838a: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260812 00:01:46.760787 15143 ts_tablet_manager.cc:1939] T a029b51e540f49daa69e01170162f49b P 55a1716880c7419a90ef5062e0fdb5e8: Deleting consensus metadata
I20260812 00:01:46.761453 15104 tablet_bootstrap.cc:492] T 46f90fa067844cc6944a4d057ec71c3f P 6e9fad10aa064962b1977ea336d81e49: Bootstrap starting.
I20260812 00:01:46.762020 14143 catalog_manager.cc:4841] TS 55a1716880c7419a90ef5062e0fdb5e8 (127.11.206.65:34127): tablet a029b51e540f49daa69e01170162f49b (table test-table [id=06547b98368e4d6eb34b2c0451bd317b]) successfully deleted
I20260812 00:01:46.762322 15104 tablet_bootstrap.cc:654] T 46f90fa067844cc6944a4d057ec71c3f P 6e9fad10aa064962b1977ea336d81e49: Neither blocks nor log segments found. Creating new log.
I20260812 00:01:46.762581 15103 tablet_bootstrap.cc:492] T 46f90fa067844cc6944a4d057ec71c3f P 55a1716880c7419a90ef5062e0fdb5e8: No bootstrap required, opened a new log
I20260812 00:01:46.762638 15103 ts_tablet_manager.cc:1397] T 46f90fa067844cc6944a4d057ec71c3f P 55a1716880c7419a90ef5062e0fdb5e8: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.001s
I20260812 00:01:46.762920 15103 raft_consensus.cc:348] T 46f90fa067844cc6944a4d057ec71c3f P 55a1716880c7419a90ef5062e0fdb5e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55a1716880c7419a90ef5062e0fdb5e8" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 34127 } } peers { permanent_uuid: "65648c86dde64d35be8cce4d1499838a" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 45863 } } peers { permanent_uuid: "6e9fad10aa064962b1977ea336d81e49" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 44465 } }
I20260812 00:01:46.762998 15103 raft_consensus.cc:374] T 46f90fa067844cc6944a4d057ec71c3f P 55a1716880c7419a90ef5062e0fdb5e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:01:46.763020 15103 raft_consensus.cc:729] T 46f90fa067844cc6944a4d057ec71c3f P 55a1716880c7419a90ef5062e0fdb5e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55a1716880c7419a90ef5062e0fdb5e8, State: Initialized, Role: FOLLOWER
I20260812 00:01:46.763060 15103 consensus_queue.cc:260] T 46f90fa067844cc6944a4d057ec71c3f P 55a1716880c7419a90ef5062e0fdb5e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55a1716880c7419a90ef5062e0fdb5e8" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 34127 } } peers { permanent_uuid: "65648c86dde64d35be8cce4d1499838a" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 45863 } } peers { permanent_uuid: "6e9fad10aa064962b1977ea336d81e49" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 44465 } }
I20260812 00:01:46.763136 15103 ts_tablet_manager.cc:1428] T 46f90fa067844cc6944a4d057ec71c3f P 55a1716880c7419a90ef5062e0fdb5e8: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:46.763270 15104 tablet_bootstrap.cc:492] T 46f90fa067844cc6944a4d057ec71c3f P 6e9fad10aa064962b1977ea336d81e49: No bootstrap required, opened a new log
I20260812 00:01:46.763307 15104 ts_tablet_manager.cc:1397] T 46f90fa067844cc6944a4d057ec71c3f P 6e9fad10aa064962b1977ea336d81e49: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20260812 00:01:46.763541 15104 raft_consensus.cc:348] T 46f90fa067844cc6944a4d057ec71c3f P 6e9fad10aa064962b1977ea336d81e49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55a1716880c7419a90ef5062e0fdb5e8" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 34127 } } peers { permanent_uuid: "65648c86dde64d35be8cce4d1499838a" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 45863 } } peers { permanent_uuid: "6e9fad10aa064962b1977ea336d81e49" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 44465 } }
I20260812 00:01:46.756083 15142 raft_consensus.cc:2229] T a029b51e540f49daa69e01170162f49b P 65648c86dde64d35be8cce4d1499838a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:01:46.763638 15104 raft_consensus.cc:374] T 46f90fa067844cc6944a4d057ec71c3f P 6e9fad10aa064962b1977ea336d81e49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:01:46.763670 15104 raft_consensus.cc:729] T 46f90fa067844cc6944a4d057ec71c3f P 6e9fad10aa064962b1977ea336d81e49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e9fad10aa064962b1977ea336d81e49, State: Initialized, Role: FOLLOWER
I20260812 00:01:46.763710 15104 consensus_queue.cc:260] T 46f90fa067844cc6944a4d057ec71c3f P 6e9fad10aa064962b1977ea336d81e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55a1716880c7419a90ef5062e0fdb5e8" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 34127 } } peers { permanent_uuid: "65648c86dde64d35be8cce4d1499838a" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 45863 } } peers { permanent_uuid: "6e9fad10aa064962b1977ea336d81e49" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 44465 } }
I20260812 00:01:46.763821 15104 ts_tablet_manager.cc:1428] T 46f90fa067844cc6944a4d057ec71c3f P 6e9fad10aa064962b1977ea336d81e49: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:46.764039 15142 raft_consensus.cc:2258] T a029b51e540f49daa69e01170162f49b P 65648c86dde64d35be8cce4d1499838a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:01:46.764456 15142 ts_tablet_manager.cc:1905] T a029b51e540f49daa69e01170162f49b P 65648c86dde64d35be8cce4d1499838a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:01:46.765990 15142 ts_tablet_manager.cc:1918] T a029b51e540f49daa69e01170162f49b P 65648c86dde64d35be8cce4d1499838a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:01:46.766059 15142 log.cc:1196] T a029b51e540f49daa69e01170162f49b P 65648c86dde64d35be8cce4d1499838a: Deleting WAL directory at /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/minicluster-data/ts-1/wal/wals/a029b51e540f49daa69e01170162f49b
I20260812 00:01:46.766263 15142 ts_tablet_manager.cc:1939] T a029b51e540f49daa69e01170162f49b P 65648c86dde64d35be8cce4d1499838a: Deleting consensus metadata
I20260812 00:01:46.766726 14142 catalog_manager.cc:4841] TS 65648c86dde64d35be8cce4d1499838a (127.11.206.66:45863): tablet a029b51e540f49daa69e01170162f49b (table test-table [id=06547b98368e4d6eb34b2c0451bd317b]) successfully deleted
I20260812 00:01:46.926813 15124 raft_consensus.cc:482] T 46f90fa067844cc6944a4d057ec71c3f P 55a1716880c7419a90ef5062e0fdb5e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:01:46.926919 15124 raft_consensus.cc:504] T 46f90fa067844cc6944a4d057ec71c3f P 55a1716880c7419a90ef5062e0fdb5e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55a1716880c7419a90ef5062e0fdb5e8" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 34127 } } peers { permanent_uuid: "65648c86dde64d35be8cce4d1499838a" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 45863 } } peers { permanent_uuid: "6e9fad10aa064962b1977ea336d81e49" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 44465 } }
I20260812 00:01:46.927060 15124 leader_election.cc:288] T 46f90fa067844cc6944a4d057ec71c3f P 55a1716880c7419a90ef5062e0fdb5e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65648c86dde64d35be8cce4d1499838a (127.11.206.66:45863), 6e9fad10aa064962b1977ea336d81e49 (127.11.206.67:44465)
I20260812 00:01:46.927362 14705 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46f90fa067844cc6944a4d057ec71c3f" candidate_uuid: "55a1716880c7419a90ef5062e0fdb5e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65648c86dde64d35be8cce4d1499838a" is_pre_election: true
I20260812 00:01:46.927381 14981 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46f90fa067844cc6944a4d057ec71c3f" candidate_uuid: "55a1716880c7419a90ef5062e0fdb5e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e9fad10aa064962b1977ea336d81e49" is_pre_election: true
I20260812 00:01:46.927469 14981 raft_consensus.cc:2454] T 46f90fa067844cc6944a4d057ec71c3f P 6e9fad10aa064962b1977ea336d81e49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55a1716880c7419a90ef5062e0fdb5e8 in term 0.
I20260812 00:01:46.927469 14705 raft_consensus.cc:2454] T 46f90fa067844cc6944a4d057ec71c3f P 65648c86dde64d35be8cce4d1499838a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55a1716880c7419a90ef5062e0fdb5e8 in term 0.
I20260812 00:01:46.927630 14327 leader_election.cc:302] T 46f90fa067844cc6944a4d057ec71c3f P 55a1716880c7419a90ef5062e0fdb5e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55a1716880c7419a90ef5062e0fdb5e8, 6e9fad10aa064962b1977ea336d81e49; no voters:
I20260812 00:01:46.927726 15124 raft_consensus.cc:2781] T 46f90fa067844cc6944a4d057ec71c3f P 55a1716880c7419a90ef5062e0fdb5e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:01:46.927768 15124 raft_consensus.cc:482] T 46f90fa067844cc6944a4d057ec71c3f P 55a1716880c7419a90ef5062e0fdb5e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:01:46.927788 15124 raft_consensus.cc:3037] T 46f90fa067844cc6944a4d057ec71c3f P 55a1716880c7419a90ef5062e0fdb5e8 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:01:46.928494 15124 raft_consensus.cc:504] T 46f90fa067844cc6944a4d057ec71c3f P 55a1716880c7419a90ef5062e0fdb5e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55a1716880c7419a90ef5062e0fdb5e8" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 34127 } } peers { permanent_uuid: "65648c86dde64d35be8cce4d1499838a" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 45863 } } peers { permanent_uuid: "6e9fad10aa064962b1977ea336d81e49" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 44465 } }
I20260812 00:01:46.928599 15124 leader_election.cc:288] T 46f90fa067844cc6944a4d057ec71c3f P 55a1716880c7419a90ef5062e0fdb5e8 [CANDIDATE]: Term 1 election: Requested vote from peers 65648c86dde64d35be8cce4d1499838a (127.11.206.66:45863), 6e9fad10aa064962b1977ea336d81e49 (127.11.206.67:44465)
I20260812 00:01:46.928776 14705 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46f90fa067844cc6944a4d057ec71c3f" candidate_uuid: "55a1716880c7419a90ef5062e0fdb5e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65648c86dde64d35be8cce4d1499838a"
I20260812 00:01:46.928802 14981 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46f90fa067844cc6944a4d057ec71c3f" candidate_uuid: "55a1716880c7419a90ef5062e0fdb5e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e9fad10aa064962b1977ea336d81e49"
I20260812 00:01:46.928857 14705 raft_consensus.cc:3037] T 46f90fa067844cc6944a4d057ec71c3f P 65648c86dde64d35be8cce4d1499838a [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:01:46.928861 14981 raft_consensus.cc:3037] T 46f90fa067844cc6944a4d057ec71c3f P 6e9fad10aa064962b1977ea336d81e49 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:01:46.929647 14981 raft_consensus.cc:2454] T 46f90fa067844cc6944a4d057ec71c3f P 6e9fad10aa064962b1977ea336d81e49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55a1716880c7419a90ef5062e0fdb5e8 in term 1.
I20260812 00:01:46.929754 14705 raft_consensus.cc:2454] T 46f90fa067844cc6944a4d057ec71c3f P 65648c86dde64d35be8cce4d1499838a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55a1716880c7419a90ef5062e0fdb5e8 in term 1.
I20260812 00:01:46.929817 14327 leader_election.cc:302] T 46f90fa067844cc6944a4d057ec71c3f P 55a1716880c7419a90ef5062e0fdb5e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55a1716880c7419a90ef5062e0fdb5e8, 6e9fad10aa064962b1977ea336d81e49; no voters:
I20260812 00:01:46.929940 15124 raft_consensus.cc:2781] T 46f90fa067844cc6944a4d057ec71c3f P 55a1716880c7419a90ef5062e0fdb5e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:01:46.929994 15124 raft_consensus.cc:686] T 46f90fa067844cc6944a4d057ec71c3f P 55a1716880c7419a90ef5062e0fdb5e8 [term 1 LEADER]: Becoming Leader. State: Replica: 55a1716880c7419a90ef5062e0fdb5e8, State: Running, Role: LEADER
I20260812 00:01:46.930044 15124 consensus_queue.cc:237] T 46f90fa067844cc6944a4d057ec71c3f P 55a1716880c7419a90ef5062e0fdb5e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55a1716880c7419a90ef5062e0fdb5e8" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 34127 } } peers { permanent_uuid: "65648c86dde64d35be8cce4d1499838a" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 45863 } } peers { permanent_uuid: "6e9fad10aa064962b1977ea336d81e49" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 44465 } }
I20260812 00:01:46.930642 14170 catalog_manager.cc:5495] T 46f90fa067844cc6944a4d057ec71c3f P 55a1716880c7419a90ef5062e0fdb5e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 55a1716880c7419a90ef5062e0fdb5e8 (127.11.206.65). New cstate: current_term: 1 leader_uuid: "55a1716880c7419a90ef5062e0fdb5e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55a1716880c7419a90ef5062e0fdb5e8" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 34127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65648c86dde64d35be8cce4d1499838a" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 45863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e9fad10aa064962b1977ea336d81e49" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 44465 } health_report { overall_health: UNKNOWN } } }
Aug 12 00:01:46 dist-test-slave-f0tn krb5kdc[14088](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492905, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.126@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:01:46.964234 15157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:46.957992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:35071 (local address 127.0.0.1:35584)
0812 00:01:46.958143 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0812 00:01:46.958155 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 00:01:46.958223 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:01:46.958349 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:01:46.958349 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:01:46.958666 (+ 317us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:01:46.958714 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:46.958715 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:46.959325 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:46.959326 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:46.959873 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:46.959874 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:46.960158 (+ 284us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:46.960158 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:46.960193 (+ 35us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:46.960630 (+ 437us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:01:46.960634 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:01:46.962029 (+ 1395us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:01:46.963379 (+ 1350us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:01:46.963386 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:01:46.963388 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:01:46.963575 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:01:46.963726 (+ 151us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:01:46.963726 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:01:46.963726 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:01:46.963777 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:01:46.963946 (+ 169us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:01:46.963951 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:01:46.963990 (+ 39us) client_negotiation.cc:769] Sending connection context
0812 00:01:46.964038 (+ 48us) client_negotiation.cc:240] Negotiation successful
0812 00:01:46.964128 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":77,"threads_started":1}
I20260812 00:01:46.964282 15159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:46.958055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35584 (local address 127.11.206.126:35071)
0812 00:01:46.958187 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:46.958189 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:46.958215 (+ 26us) server_negotiation.cc:407] Connection header received
0812 00:01:46.958272 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:46.958273 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:46.958282 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:46.958338 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:01:46.958767 (+ 429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:46.959266 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:46.959930 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:46.960111 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:46.960153 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:46.962114 (+ 1961us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:01:46.962115 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:01:46.962115 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:01:46.962121 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:01:46.963313 (+ 1192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:46.963629 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:46.963630 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:46.963630 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:46.963677 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:46.963814 (+ 137us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:46.963815 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:46.963815 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:46.963907 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:01:46.963951 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:46.964059 (+ 108us) server_negotiation.cc:299] Negotiation successful
0812 00:01:46.964173 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":50,"server-negotiator.queue_time_us":111,"thread_start_us":117,"threads_started":1}
I20260812 00:01:46.966116 14170 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.11.206.126@KRBTEST.COM'} at 127.0.0.1:35584:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260812 00:01:46.966398 14170 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:01:46.967705 14417 tablet_service.cc:1467] Processing CreateTablet for tablet 86e8198115f74d73af573695a790b969 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=2ba77d13345d47c5a722010f9fda93de]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 00:01:46.967730 14667 tablet_service.cc:1467] Processing CreateTablet for tablet 86e8198115f74d73af573695a790b969 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=2ba77d13345d47c5a722010f9fda93de]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 00:01:46.967793 14937 tablet_service.cc:1467] Processing CreateTablet for tablet 86e8198115f74d73af573695a790b969 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=2ba77d13345d47c5a722010f9fda93de]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 00:01:46.967927 14937 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 86e8198115f74d73af573695a790b969. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:01:46.967926 14667 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 86e8198115f74d73af573695a790b969. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:01:46.967927 14417 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 86e8198115f74d73af573695a790b969. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:01:46.969054 15103 tablet_bootstrap.cc:492] T 86e8198115f74d73af573695a790b969 P 55a1716880c7419a90ef5062e0fdb5e8: Bootstrap starting.
I20260812 00:01:46.969429 15103 tablet_bootstrap.cc:654] T 86e8198115f74d73af573695a790b969 P 55a1716880c7419a90ef5062e0fdb5e8: Neither blocks nor log segments found. Creating new log.
I20260812 00:01:46.969544 15106 tablet_bootstrap.cc:492] T 86e8198115f74d73af573695a790b969 P 65648c86dde64d35be8cce4d1499838a: Bootstrap starting.
I20260812 00:01:46.969551 15104 tablet_bootstrap.cc:492] T 86e8198115f74d73af573695a790b969 P 6e9fad10aa064962b1977ea336d81e49: Bootstrap starting.
I20260812 00:01:46.970221 15103 tablet_bootstrap.cc:492] T 86e8198115f74d73af573695a790b969 P 55a1716880c7419a90ef5062e0fdb5e8: No bootstrap required, opened a new log
I20260812 00:01:46.970284 15103 ts_tablet_manager.cc:1397] T 86e8198115f74d73af573695a790b969 P 55a1716880c7419a90ef5062e0fdb5e8: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260812 00:01:46.970294 15104 tablet_bootstrap.cc:654] T 86e8198115f74d73af573695a790b969 P 6e9fad10aa064962b1977ea336d81e49: Neither blocks nor log segments found. Creating new log.
I20260812 00:01:46.970425 15106 tablet_bootstrap.cc:654] T 86e8198115f74d73af573695a790b969 P 65648c86dde64d35be8cce4d1499838a: Neither blocks nor log segments found. Creating new log.
I20260812 00:01:46.970414 15103 raft_consensus.cc:348] T 86e8198115f74d73af573695a790b969 P 55a1716880c7419a90ef5062e0fdb5e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55a1716880c7419a90ef5062e0fdb5e8" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 34127 } } peers { permanent_uuid: "65648c86dde64d35be8cce4d1499838a" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 45863 } } peers { permanent_uuid: "6e9fad10aa064962b1977ea336d81e49" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 44465 } }
I20260812 00:01:46.970481 15103 raft_consensus.cc:374] T 86e8198115f74d73af573695a790b969 P 55a1716880c7419a90ef5062e0fdb5e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:01:46.970501 15103 raft_consensus.cc:729] T 86e8198115f74d73af573695a790b969 P 55a1716880c7419a90ef5062e0fdb5e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55a1716880c7419a90ef5062e0fdb5e8, State: Initialized, Role: FOLLOWER
I20260812 00:01:46.970551 15103 consensus_queue.cc:260] T 86e8198115f74d73af573695a790b969 P 55a1716880c7419a90ef5062e0fdb5e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55a1716880c7419a90ef5062e0fdb5e8" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 34127 } } peers { permanent_uuid: "65648c86dde64d35be8cce4d1499838a" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 45863 } } peers { permanent_uuid: "6e9fad10aa064962b1977ea336d81e49" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 44465 } }
I20260812 00:01:46.970649 15103 ts_tablet_manager.cc:1428] T 86e8198115f74d73af573695a790b969 P 55a1716880c7419a90ef5062e0fdb5e8: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:46.970681 15124 tablet_replica.cc:439] T 86e8198115f74d73af573695a790b969 P 55a1716880c7419a90ef5062e0fdb5e8: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55a1716880c7419a90ef5062e0fdb5e8" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 34127 } } peers { permanent_uuid: "65648c86dde64d35be8cce4d1499838a" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 45863 } } peers { permanent_uuid: "6e9fad10aa064962b1977ea336d81e49" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 44465 } } }
I20260812 00:01:46.970773 15124 tablet_replica.cc:442] T 86e8198115f74d73af573695a790b969 P 55a1716880c7419a90ef5062e0fdb5e8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:01:46.971185 15104 tablet_bootstrap.cc:492] T 86e8198115f74d73af573695a790b969 P 6e9fad10aa064962b1977ea336d81e49: No bootstrap required, opened a new log
I20260812 00:01:46.971238 15104 ts_tablet_manager.cc:1397] T 86e8198115f74d73af573695a790b969 P 6e9fad10aa064962b1977ea336d81e49: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20260812 00:01:46.971333 15106 tablet_bootstrap.cc:492] T 86e8198115f74d73af573695a790b969 P 65648c86dde64d35be8cce4d1499838a: No bootstrap required, opened a new log
I20260812 00:01:46.971382 15106 ts_tablet_manager.cc:1397] T 86e8198115f74d73af573695a790b969 P 65648c86dde64d35be8cce4d1499838a: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20260812 00:01:46.971546 15106 raft_consensus.cc:348] T 86e8198115f74d73af573695a790b969 P 65648c86dde64d35be8cce4d1499838a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55a1716880c7419a90ef5062e0fdb5e8" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 34127 } } peers { permanent_uuid: "65648c86dde64d35be8cce4d1499838a" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 45863 } } peers { permanent_uuid: "6e9fad10aa064962b1977ea336d81e49" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 44465 } }
I20260812 00:01:46.971602 15106 raft_consensus.cc:374] T 86e8198115f74d73af573695a790b969 P 65648c86dde64d35be8cce4d1499838a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:01:46.971570 15104 raft_consensus.cc:348] T 86e8198115f74d73af573695a790b969 P 6e9fad10aa064962b1977ea336d81e49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55a1716880c7419a90ef5062e0fdb5e8" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 34127 } } peers { permanent_uuid: "65648c86dde64d35be8cce4d1499838a" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 45863 } } peers { permanent_uuid: "6e9fad10aa064962b1977ea336d81e49" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 44465 } }
I20260812 00:01:46.971621 15106 raft_consensus.cc:729] T 86e8198115f74d73af573695a790b969 P 65648c86dde64d35be8cce4d1499838a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65648c86dde64d35be8cce4d1499838a, State: Initialized, Role: FOLLOWER
I20260812 00:01:46.971626 15104 raft_consensus.cc:374] T 86e8198115f74d73af573695a790b969 P 6e9fad10aa064962b1977ea336d81e49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:01:46.971639 15104 raft_consensus.cc:729] T 86e8198115f74d73af573695a790b969 P 6e9fad10aa064962b1977ea336d81e49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e9fad10aa064962b1977ea336d81e49, State: Initialized, Role: FOLLOWER
I20260812 00:01:46.971659 15106 consensus_queue.cc:260] T 86e8198115f74d73af573695a790b969 P 65648c86dde64d35be8cce4d1499838a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55a1716880c7419a90ef5062e0fdb5e8" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 34127 } } peers { permanent_uuid: "65648c86dde64d35be8cce4d1499838a" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 45863 } } peers { permanent_uuid: "6e9fad10aa064962b1977ea336d81e49" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 44465 } }
I20260812 00:01:46.971688 15104 consensus_queue.cc:260] T 86e8198115f74d73af573695a790b969 P 6e9fad10aa064962b1977ea336d81e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55a1716880c7419a90ef5062e0fdb5e8" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 34127 } } peers { permanent_uuid: "65648c86dde64d35be8cce4d1499838a" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 45863 } } peers { permanent_uuid: "6e9fad10aa064962b1977ea336d81e49" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 44465 } }
I20260812 00:01:46.971746 15106 ts_tablet_manager.cc:1428] T 86e8198115f74d73af573695a790b969 P 65648c86dde64d35be8cce4d1499838a: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:46.971781 15104 ts_tablet_manager.cc:1428] T 86e8198115f74d73af573695a790b969 P 6e9fad10aa064962b1977ea336d81e49: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260812 00:01:46.971823 15119 tablet_replica.cc:439] T 86e8198115f74d73af573695a790b969 P 6e9fad10aa064962b1977ea336d81e49: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55a1716880c7419a90ef5062e0fdb5e8" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 34127 } } peers { permanent_uuid: "65648c86dde64d35be8cce4d1499838a" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 45863 } } peers { permanent_uuid: "6e9fad10aa064962b1977ea336d81e49" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 44465 } } }
I20260812 00:01:46.971885 15112 tablet_replica.cc:439] T 86e8198115f74d73af573695a790b969 P 65648c86dde64d35be8cce4d1499838a: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55a1716880c7419a90ef5062e0fdb5e8" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 34127 } } peers { permanent_uuid: "65648c86dde64d35be8cce4d1499838a" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 45863 } } peers { permanent_uuid: "6e9fad10aa064962b1977ea336d81e49" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 44465 } } }
I20260812 00:01:46.971951 15112 tablet_replica.cc:442] T 86e8198115f74d73af573695a790b969 P 65648c86dde64d35be8cce4d1499838a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:01:46.971952 15119 tablet_replica.cc:442] T 86e8198115f74d73af573695a790b969 P 6e9fad10aa064962b1977ea336d81e49: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:01:47.268708 15124 raft_consensus.cc:482] T 86e8198115f74d73af573695a790b969 P 55a1716880c7419a90ef5062e0fdb5e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:01:47.268822 15124 raft_consensus.cc:504] T 86e8198115f74d73af573695a790b969 P 55a1716880c7419a90ef5062e0fdb5e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55a1716880c7419a90ef5062e0fdb5e8" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 34127 } } peers { permanent_uuid: "65648c86dde64d35be8cce4d1499838a" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 45863 } } peers { permanent_uuid: "6e9fad10aa064962b1977ea336d81e49" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 44465 } }
I20260812 00:01:47.268958 15124 leader_election.cc:288] T 86e8198115f74d73af573695a790b969 P 55a1716880c7419a90ef5062e0fdb5e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65648c86dde64d35be8cce4d1499838a (127.11.206.66:45863), 6e9fad10aa064962b1977ea336d81e49 (127.11.206.67:44465)
I20260812 00:01:47.269217 14705 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86e8198115f74d73af573695a790b969" candidate_uuid: "55a1716880c7419a90ef5062e0fdb5e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65648c86dde64d35be8cce4d1499838a" is_pre_election: true
I20260812 00:01:47.269232 14981 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86e8198115f74d73af573695a790b969" candidate_uuid: "55a1716880c7419a90ef5062e0fdb5e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e9fad10aa064962b1977ea336d81e49" is_pre_election: true
I20260812 00:01:47.269321 14981 raft_consensus.cc:2454] T 86e8198115f74d73af573695a790b969 P 6e9fad10aa064962b1977ea336d81e49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55a1716880c7419a90ef5062e0fdb5e8 in term 0.
I20260812 00:01:47.269325 14705 raft_consensus.cc:2454] T 86e8198115f74d73af573695a790b969 P 65648c86dde64d35be8cce4d1499838a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55a1716880c7419a90ef5062e0fdb5e8 in term 0.
I20260812 00:01:47.269505 14327 leader_election.cc:302] T 86e8198115f74d73af573695a790b969 P 55a1716880c7419a90ef5062e0fdb5e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55a1716880c7419a90ef5062e0fdb5e8, 6e9fad10aa064962b1977ea336d81e49; no voters:
I20260812 00:01:47.269630 15124 raft_consensus.cc:2781] T 86e8198115f74d73af573695a790b969 P 55a1716880c7419a90ef5062e0fdb5e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:01:47.269682 15124 raft_consensus.cc:482] T 86e8198115f74d73af573695a790b969 P 55a1716880c7419a90ef5062e0fdb5e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:01:47.269703 15124 raft_consensus.cc:3037] T 86e8198115f74d73af573695a790b969 P 55a1716880c7419a90ef5062e0fdb5e8 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:01:47.270440 15124 raft_consensus.cc:504] T 86e8198115f74d73af573695a790b969 P 55a1716880c7419a90ef5062e0fdb5e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55a1716880c7419a90ef5062e0fdb5e8" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 34127 } } peers { permanent_uuid: "65648c86dde64d35be8cce4d1499838a" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 45863 } } peers { permanent_uuid: "6e9fad10aa064962b1977ea336d81e49" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 44465 } }
I20260812 00:01:47.270560 15124 leader_election.cc:288] T 86e8198115f74d73af573695a790b969 P 55a1716880c7419a90ef5062e0fdb5e8 [CANDIDATE]: Term 1 election: Requested vote from peers 65648c86dde64d35be8cce4d1499838a (127.11.206.66:45863), 6e9fad10aa064962b1977ea336d81e49 (127.11.206.67:44465)
I20260812 00:01:47.270744 14981 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86e8198115f74d73af573695a790b969" candidate_uuid: "55a1716880c7419a90ef5062e0fdb5e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e9fad10aa064962b1977ea336d81e49"
I20260812 00:01:47.270746 14705 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86e8198115f74d73af573695a790b969" candidate_uuid: "55a1716880c7419a90ef5062e0fdb5e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65648c86dde64d35be8cce4d1499838a"
I20260812 00:01:47.270823 14705 raft_consensus.cc:3037] T 86e8198115f74d73af573695a790b969 P 65648c86dde64d35be8cce4d1499838a [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:01:47.270825 14981 raft_consensus.cc:3037] T 86e8198115f74d73af573695a790b969 P 6e9fad10aa064962b1977ea336d81e49 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:01:47.271411 14981 raft_consensus.cc:2454] T 86e8198115f74d73af573695a790b969 P 6e9fad10aa064962b1977ea336d81e49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55a1716880c7419a90ef5062e0fdb5e8 in term 1.
I20260812 00:01:47.271415 14705 raft_consensus.cc:2454] T 86e8198115f74d73af573695a790b969 P 65648c86dde64d35be8cce4d1499838a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55a1716880c7419a90ef5062e0fdb5e8 in term 1.
I20260812 00:01:47.271584 14327 leader_election.cc:302] T 86e8198115f74d73af573695a790b969 P 55a1716880c7419a90ef5062e0fdb5e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55a1716880c7419a90ef5062e0fdb5e8, 6e9fad10aa064962b1977ea336d81e49; no voters:
I20260812 00:01:47.271690 15124 raft_consensus.cc:2781] T 86e8198115f74d73af573695a790b969 P 55a1716880c7419a90ef5062e0fdb5e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:01:47.271771 15124 raft_consensus.cc:686] T 86e8198115f74d73af573695a790b969 P 55a1716880c7419a90ef5062e0fdb5e8 [term 1 LEADER]: Becoming Leader. State: Replica: 55a1716880c7419a90ef5062e0fdb5e8, State: Running, Role: LEADER
I20260812 00:01:47.271821 15124 consensus_queue.cc:237] T 86e8198115f74d73af573695a790b969 P 55a1716880c7419a90ef5062e0fdb5e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55a1716880c7419a90ef5062e0fdb5e8" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 34127 } } peers { permanent_uuid: "65648c86dde64d35be8cce4d1499838a" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 45863 } } peers { permanent_uuid: "6e9fad10aa064962b1977ea336d81e49" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 44465 } }
I20260812 00:01:47.272089 15117 tablet_replica.cc:439] T 86e8198115f74d73af573695a790b969 P 55a1716880c7419a90ef5062e0fdb5e8: TxnStatusTablet state changed. Reason: New leader 55a1716880c7419a90ef5062e0fdb5e8. Latest consensus state: current_term: 1 leader_uuid: "55a1716880c7419a90ef5062e0fdb5e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55a1716880c7419a90ef5062e0fdb5e8" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 34127 } } peers { permanent_uuid: "65648c86dde64d35be8cce4d1499838a" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 45863 } } peers { permanent_uuid: "6e9fad10aa064962b1977ea336d81e49" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 44465 } } }
I20260812 00:01:47.272166 15117 tablet_replica.cc:442] T 86e8198115f74d73af573695a790b969 P 55a1716880c7419a90ef5062e0fdb5e8: This TxnStatusTablet replica's current role is: LEADER
I20260812 00:01:47.272301 15167 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260812 00:01:47.272408 15167 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260812 00:01:47.272475 14171 catalog_manager.cc:5495] T 86e8198115f74d73af573695a790b969 P 55a1716880c7419a90ef5062e0fdb5e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 55a1716880c7419a90ef5062e0fdb5e8 (127.11.206.65). New cstate: current_term: 1 leader_uuid: "55a1716880c7419a90ef5062e0fdb5e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55a1716880c7419a90ef5062e0fdb5e8" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 34127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65648c86dde64d35be8cce4d1499838a" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 45863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e9fad10aa064962b1977ea336d81e49" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 44465 } health_report { overall_health: UNKNOWN } } }
I20260812 00:01:47.326102 15172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:47.323418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57224 (local address 127.11.206.65:34127)
0812 00:01:47.323551 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:47.323553 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:47.323562 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:01:47.323585 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:47.323586 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:47.323595 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:47.323653 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:01:47.323801 (+ 148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:47.324280 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:47.325361 (+ 1081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:47.325599 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:47.325645 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:47.325872 (+ 227us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:01:47.325903 (+ 31us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:01:47.325934 (+ 31us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:47.326015 (+ 81us) server_negotiation.cc:299] Negotiation successful
0812 00:01:47.326033 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98,"thread_start_us":58,"threads_started":1}
I20260812 00:01:47.326151 15157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:47.323351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.65:34127 (local address 127.0.0.1:57224)
0812 00:01:47.323437 (+ 86us) negotiation.cc:107] Waiting for socket to connect
0812 00:01:47.323452 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 00:01:47.323510 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:01:47.323670 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:01:47.323670 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:01:47.323672 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 00:01:47.323730 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:47.323733 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:47.324360 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:47.324361 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:47.325276 (+ 915us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:47.325280 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:47.325676 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:47.325677 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:47.325749 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:47.325782 (+ 33us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 00:01:47.325956 (+ 174us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 00:01:47.325963 (+ 7us) client_negotiation.cc:769] Sending connection context
0812 00:01:47.326014 (+ 51us) client_negotiation.cc:240] Negotiation successful
0812 00:01:47.326070 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40}
I20260812 00:01:47.327299 14705 raft_consensus.cc:1261] T 86e8198115f74d73af573695a790b969 P 65648c86dde64d35be8cce4d1499838a [term 1 FOLLOWER]: Refusing update from remote peer 55a1716880c7419a90ef5062e0fdb5e8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:01:47.327311 14981 raft_consensus.cc:1261] T 86e8198115f74d73af573695a790b969 P 6e9fad10aa064962b1977ea336d81e49 [term 1 FOLLOWER]: Refusing update from remote peer 55a1716880c7419a90ef5062e0fdb5e8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:01:47.327550 15124 consensus_queue.cc:1035] T 86e8198115f74d73af573695a790b969 P 55a1716880c7419a90ef5062e0fdb5e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65648c86dde64d35be8cce4d1499838a" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 45863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:01:47.327672 15117 consensus_queue.cc:1035] T 86e8198115f74d73af573695a790b969 P 55a1716880c7419a90ef5062e0fdb5e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e9fad10aa064962b1977ea336d81e49" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 44465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:01:47.328173 15119 tablet_replica.cc:439] T 86e8198115f74d73af573695a790b969 P 6e9fad10aa064962b1977ea336d81e49: TxnStatusTablet state changed. Reason: New leader 55a1716880c7419a90ef5062e0fdb5e8. Latest consensus state: current_term: 1 leader_uuid: "55a1716880c7419a90ef5062e0fdb5e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55a1716880c7419a90ef5062e0fdb5e8" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 34127 } } peers { permanent_uuid: "65648c86dde64d35be8cce4d1499838a" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 45863 } } peers { permanent_uuid: "6e9fad10aa064962b1977ea336d81e49" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 44465 } } }
I20260812 00:01:47.328176 15112 tablet_replica.cc:439] T 86e8198115f74d73af573695a790b969 P 65648c86dde64d35be8cce4d1499838a: TxnStatusTablet state changed. Reason: New leader 55a1716880c7419a90ef5062e0fdb5e8. Latest consensus state: current_term: 1 leader_uuid: "55a1716880c7419a90ef5062e0fdb5e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55a1716880c7419a90ef5062e0fdb5e8" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 34127 } } peers { permanent_uuid: "65648c86dde64d35be8cce4d1499838a" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 45863 } } peers { permanent_uuid: "6e9fad10aa064962b1977ea336d81e49" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 44465 } } }
I20260812 00:01:47.328279 15112 tablet_replica.cc:442] T 86e8198115f74d73af573695a790b969 P 65648c86dde64d35be8cce4d1499838a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:01:47.328277 15119 tablet_replica.cc:442] T 86e8198115f74d73af573695a790b969 P 6e9fad10aa064962b1977ea336d81e49: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:01:47.329217 15117 tablet_replica.cc:439] T 86e8198115f74d73af573695a790b969 P 55a1716880c7419a90ef5062e0fdb5e8: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "55a1716880c7419a90ef5062e0fdb5e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55a1716880c7419a90ef5062e0fdb5e8" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 34127 } } peers { permanent_uuid: "65648c86dde64d35be8cce4d1499838a" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 45863 } } peers { permanent_uuid: "6e9fad10aa064962b1977ea336d81e49" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 44465 } } }
I20260812 00:01:47.329312 15117 tablet_replica.cc:442] T 86e8198115f74d73af573695a790b969 P 55a1716880c7419a90ef5062e0fdb5e8: This TxnStatusTablet replica's current role is: LEADER
I20260812 00:01:47.329246 15124 tablet_replica.cc:439] T 86e8198115f74d73af573695a790b969 P 55a1716880c7419a90ef5062e0fdb5e8: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "55a1716880c7419a90ef5062e0fdb5e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55a1716880c7419a90ef5062e0fdb5e8" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 34127 } } peers { permanent_uuid: "65648c86dde64d35be8cce4d1499838a" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 45863 } } peers { permanent_uuid: "6e9fad10aa064962b1977ea336d81e49" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 44465 } } }
I20260812 00:01:47.329447 15124 tablet_replica.cc:442] T 86e8198115f74d73af573695a790b969 P 55a1716880c7419a90ef5062e0fdb5e8: This TxnStatusTablet replica's current role is: LEADER
I20260812 00:01:47.329430 15173 mvcc.cc:205] Tried to move back new op lower bound from 7317474948410798080 to 7317474948185755648. Current Snapshot: MvccSnapshot[applied={T|T < 7317474948410798080}]
I20260812 00:01:47.329598 15119 tablet_replica.cc:439] T 86e8198115f74d73af573695a790b969 P 6e9fad10aa064962b1977ea336d81e49: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "55a1716880c7419a90ef5062e0fdb5e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55a1716880c7419a90ef5062e0fdb5e8" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 34127 } } peers { permanent_uuid: "65648c86dde64d35be8cce4d1499838a" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 45863 } } peers { permanent_uuid: "6e9fad10aa064962b1977ea336d81e49" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 44465 } } }
I20260812 00:01:47.329691 15119 tablet_replica.cc:442] T 86e8198115f74d73af573695a790b969 P 6e9fad10aa064962b1977ea336d81e49: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:01:47.329833 15112 tablet_replica.cc:439] T 86e8198115f74d73af573695a790b969 P 65648c86dde64d35be8cce4d1499838a: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "55a1716880c7419a90ef5062e0fdb5e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55a1716880c7419a90ef5062e0fdb5e8" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 34127 } } peers { permanent_uuid: "65648c86dde64d35be8cce4d1499838a" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 45863 } } peers { permanent_uuid: "6e9fad10aa064962b1977ea336d81e49" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 44465 } } }
I20260812 00:01:47.329909 15112 tablet_replica.cc:442] T 86e8198115f74d73af573695a790b969 P 65648c86dde64d35be8cce4d1499838a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:01:47.336673 15172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:47.334100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.65:52517 (local address 127.11.206.65:34127)
0812 00:01:47.334141 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:47.334143 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:47.334254 (+ 111us) server_negotiation.cc:407] Connection header received
0812 00:01:47.334328 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:47.334328 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:47.334336 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:47.334380 (+ 44us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:01:47.334516 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:47.334969 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:47.336040 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:47.336224 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:47.336268 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:47.336458 (+ 190us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:01:47.336482 (+ 24us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:01:47.336515 (+ 33us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:47.336582 (+ 67us) server_negotiation.cc:299] Negotiation successful
0812 00:01:47.336599 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 00:01:47.336794 15188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:47.334023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.65:34127 (local address 127.11.206.65:52517)
0812 00:01:47.334191 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0812 00:01:47.334203 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 00:01:47.334272 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:01:47.334400 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:01:47.334400 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:01:47.334402 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 00:01:47.334457 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:47.334459 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:47.335042 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:47.335043 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:47.335958 (+ 915us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:47.335960 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:47.336297 (+ 337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:47.336298 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:47.336359 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:47.336378 (+ 19us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 00:01:47.336530 (+ 152us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 00:01:47.336532 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 00:01:47.336581 (+ 49us) client_negotiation.cc:240] Negotiation successful
0812 00:01:47.336630 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":85,"threads_started":1}
I20260812 00:01:47.339049 14705 raft_consensus.cc:1261] T 46f90fa067844cc6944a4d057ec71c3f P 65648c86dde64d35be8cce4d1499838a [term 1 FOLLOWER]: Refusing update from remote peer 55a1716880c7419a90ef5062e0fdb5e8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:01:47.339226 14981 raft_consensus.cc:1261] T 46f90fa067844cc6944a4d057ec71c3f P 6e9fad10aa064962b1977ea336d81e49 [term 1 FOLLOWER]: Refusing update from remote peer 55a1716880c7419a90ef5062e0fdb5e8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:01:47.339316 15182 consensus_queue.cc:1035] T 46f90fa067844cc6944a4d057ec71c3f P 55a1716880c7419a90ef5062e0fdb5e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65648c86dde64d35be8cce4d1499838a" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 45863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:01:47.339425 15124 consensus_queue.cc:1035] T 46f90fa067844cc6944a4d057ec71c3f P 55a1716880c7419a90ef5062e0fdb5e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e9fad10aa064962b1977ea336d81e49" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 44465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:01:47.361945 14170 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35578:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:01:47.362074 14170 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35578:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:01:47.362669 14170 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6356127de1274c789efd271bae36d0d9: Sending DeleteTablet for 3 replicas of tablet 46f90fa067844cc6944a4d057ec71c3f
I20260812 00:01:47.362982 14937 tablet_service.cc:1514] Processing DeleteTablet for tablet 46f90fa067844cc6944a4d057ec71c3f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:01:47 UTC) from {username='kudu', principal='kudu/127.11.206.126@KRBTEST.COM'} at 127.0.0.1:41092
I20260812 00:01:47.363030 14667 tablet_service.cc:1514] Processing DeleteTablet for tablet 46f90fa067844cc6944a4d057ec71c3f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:01:47 UTC) from {username='kudu', principal='kudu/127.11.206.126@KRBTEST.COM'} at 127.0.0.1:40192
I20260812 00:01:47.363258 14417 tablet_service.cc:1514] Processing DeleteTablet for tablet 46f90fa067844cc6944a4d057ec71c3f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:01:47 UTC) from {username='kudu', principal='kudu/127.11.206.126@KRBTEST.COM'} at 127.0.0.1:57208
I20260812 00:01:47.363513 15196 tablet_replica.cc:330] T 46f90fa067844cc6944a4d057ec71c3f P 55a1716880c7419a90ef5062e0fdb5e8: stopping tablet replica
I20260812 00:01:47.363534 15192 tablet_replica.cc:330] T 46f90fa067844cc6944a4d057ec71c3f P 65648c86dde64d35be8cce4d1499838a: stopping tablet replica
I20260812 00:01:47.363591 15192 raft_consensus.cc:2229] T 46f90fa067844cc6944a4d057ec71c3f P 65648c86dde64d35be8cce4d1499838a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:01:47.363636 15192 raft_consensus.cc:2258] T 46f90fa067844cc6944a4d057ec71c3f P 65648c86dde64d35be8cce4d1499838a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:01:47.363775 15193 tablet_replica.cc:330] T 46f90fa067844cc6944a4d057ec71c3f P 6e9fad10aa064962b1977ea336d81e49: stopping tablet replica
I20260812 00:01:47.363775 15196 raft_consensus.cc:2229] T 46f90fa067844cc6944a4d057ec71c3f P 55a1716880c7419a90ef5062e0fdb5e8 [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:01:47.363840 15193 raft_consensus.cc:2229] T 46f90fa067844cc6944a4d057ec71c3f P 6e9fad10aa064962b1977ea336d81e49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:01:47.363881 15193 raft_consensus.cc:2258] T 46f90fa067844cc6944a4d057ec71c3f P 6e9fad10aa064962b1977ea336d81e49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:01:47.363977 15196 raft_consensus.cc:2258] T 46f90fa067844cc6944a4d057ec71c3f P 55a1716880c7419a90ef5062e0fdb5e8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:01:47.364169 15192 ts_tablet_manager.cc:1905] T 46f90fa067844cc6944a4d057ec71c3f P 65648c86dde64d35be8cce4d1499838a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:01:47.364338 15196 ts_tablet_manager.cc:1905] T 46f90fa067844cc6944a4d057ec71c3f P 55a1716880c7419a90ef5062e0fdb5e8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:01:47.365625 15193 ts_tablet_manager.cc:1905] T 46f90fa067844cc6944a4d057ec71c3f P 6e9fad10aa064962b1977ea336d81e49: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:01:47.366297 15196 ts_tablet_manager.cc:1918] T 46f90fa067844cc6944a4d057ec71c3f P 55a1716880c7419a90ef5062e0fdb5e8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 00:01:47.366410 15196 log.cc:1196] T 46f90fa067844cc6944a4d057ec71c3f P 55a1716880c7419a90ef5062e0fdb5e8: Deleting WAL directory at /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/minicluster-data/ts-0/wal/wals/46f90fa067844cc6944a4d057ec71c3f
I20260812 00:01:47.366721 15196 ts_tablet_manager.cc:1939] T 46f90fa067844cc6944a4d057ec71c3f P 55a1716880c7419a90ef5062e0fdb5e8: Deleting consensus metadata
I20260812 00:01:47.367280 14143 catalog_manager.cc:4841] TS 55a1716880c7419a90ef5062e0fdb5e8 (127.11.206.65:34127): tablet 46f90fa067844cc6944a4d057ec71c3f (table test-table [id=3bfe275556784001979e67023d989567]) successfully deleted
I20260812 00:01:47.367333 15193 ts_tablet_manager.cc:1918] T 46f90fa067844cc6944a4d057ec71c3f P 6e9fad10aa064962b1977ea336d81e49: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 00:01:47.367383 15193 log.cc:1196] T 46f90fa067844cc6944a4d057ec71c3f P 6e9fad10aa064962b1977ea336d81e49: Deleting WAL directory at /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/minicluster-data/ts-2/wal/wals/46f90fa067844cc6944a4d057ec71c3f
I20260812 00:01:47.367566 15193 ts_tablet_manager.cc:1939] T 46f90fa067844cc6944a4d057ec71c3f P 6e9fad10aa064962b1977ea336d81e49: Deleting consensus metadata
I20260812 00:01:47.368062 14142 catalog_manager.cc:4841] TS 6e9fad10aa064962b1977ea336d81e49 (127.11.206.67:44465): tablet 46f90fa067844cc6944a4d057ec71c3f (table test-table [id=3bfe275556784001979e67023d989567]) successfully deleted
I20260812 00:01:47.368475 15192 ts_tablet_manager.cc:1918] T 46f90fa067844cc6944a4d057ec71c3f P 65648c86dde64d35be8cce4d1499838a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 00:01:47.368538 15192 log.cc:1196] T 46f90fa067844cc6944a4d057ec71c3f P 65648c86dde64d35be8cce4d1499838a: Deleting WAL directory at /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786492899949492-12089-0/minicluster-data/ts-1/wal/wals/46f90fa067844cc6944a4d057ec71c3f
I20260812 00:01:47.368731 15192 ts_tablet_manager.cc:1939] T 46f90fa067844cc6944a4d057ec71c3f P 65648c86dde64d35be8cce4d1499838a: Deleting consensus metadata
Aug 12 00:01:47 dist-test-slave-f0tn krb5kdc[14088](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492906, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.11.206.65@KRBTEST.COM
I20260812 00:01:47.369077 14142 catalog_manager.cc:4841] TS 65648c86dde64d35be8cce4d1499838a (127.11.206.66:45863): tablet 46f90fa067844cc6944a4d057ec71c3f (table test-table [id=3bfe275556784001979e67023d989567]) successfully deleted
I20260812 00:01:47.372341 15172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:47.363645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57226 (local address 127.11.206.65:34127)
0812 00:01:47.363690 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:47.363692 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:47.363877 (+ 185us) server_negotiation.cc:407] Connection header received
0812 00:01:47.363970 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:47.363970 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:47.363981 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:47.364008 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:01:47.364746 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:47.365457 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:47.366422 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:47.366695 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:47.366741 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:47.369487 (+ 2746us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:01:47.369496 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:01:47.369496 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:01:47.369504 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:01:47.371178 (+ 1674us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:47.371494 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:47.371498 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:47.371499 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:47.371573 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:47.371766 (+ 193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:47.371767 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:47.371767 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:47.371930 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:01:47.372091 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:47.372127 (+ 36us) server_negotiation.cc:299] Negotiation successful
0812 00:01:47.372216 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
W20260812 00:01:47.372618 14529 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57226
I20260812 00:01:47.379902 15159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:47.373687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35586 (local address 127.11.206.126:35071)
0812 00:01:47.373746 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:47.373748 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:47.373821 (+ 73us) server_negotiation.cc:407] Connection header received
0812 00:01:47.373890 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:47.373891 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:47.373902 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:47.373946 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:01:47.374522 (+ 576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:47.375017 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:47.375962 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:47.376152 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:47.376193 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:47.377557 (+ 1364us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:01:47.377558 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:01:47.377558 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:01:47.377565 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:01:47.378878 (+ 1313us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:47.379255 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:47.379256 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:47.379257 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:47.379306 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:47.379474 (+ 168us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:47.379475 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:47.379475 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:47.379573 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:01:47.379643 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:47.379760 (+ 117us) server_negotiation.cc:299] Negotiation successful
0812 00:01:47.379828 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
W20260812 00:01:47.380152 14170 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35586
I20260812 00:01:47.380664 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 14296
I20260812 00:01:47.403501 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 14556
I20260812 00:01:47.419482 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 14801
I20260812 00:01:47.432860 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 14113
2026-08-12T00:01:47Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (3054 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:01:47 dist-test-slave-f0tn krb5kdc[15210](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:01:47 dist-test-slave-f0tn krb5kdc[15210](info): set up 2 sockets
Aug 12 00:01:47 dist-test-slave-f0tn krb5kdc[15210](info): commencing operation
krb5kdc: starting...
W20260812 00:01:48.629781 12089 mini_kdc.cc:121] Time spent starting KDC: real 1.171s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/krb5kdc/test-user.keytab.
Aug 12 00:01:48 dist-test-slave-f0tn krb5kdc[15210](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492908, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:01:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:01:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.206.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab.
Entry for principal kudu/127.11.206.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab.
I20260812 00:01:48.748456 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:36401
--webserver_interface=127.11.206.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab
--principal=kudu/127.11.206.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:38749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.206.126:36401
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:01:48.830457 15234 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:01:48.830677 15234 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:01:48.830698 15234 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:01:48.831789 15234 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:01:48.831823 15234 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260812 00:01:48.831835 15234 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:01:48.831846 15234 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:01:48.831857 15234 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:01:48.831868 15234 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:01:48.833312 15234 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:38749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.206.126:36401
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab
--principal=kudu/127.11.206.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:36401
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.206.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15234
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:01:48.833544 15234 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:01:48.833738 15234 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:01:48.838476 15250 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:01:48.838490 15248 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:01:48.838497 15245 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:01:48.838670 15234 server_base.cc:1034] running on GCE node
I20260812 00:01:48.838958 15234 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:01:48.839227 15234 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:01:48.840397 15234 hybrid_clock.cc:648] HybridClock initialized: now 1786492908840374 us; error 33 us; skew 500 ppm
Aug 12 00:01:48 dist-test-slave-f0tn krb5kdc[15210](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492908, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:01:48.845731 15234 init.cc:377] Logged in from keytab as kudu/127.11.206.126@KRBTEST.COM (short username kudu)
I20260812 00:01:48.846169 15234 webserver.cc:460] Webserver started at http://127.11.206.126:45021/ using document root <none> and password file <none>
I20260812 00:01:48.846367 15234 fs_manager.cc:359] Metadata directory not provided
I20260812 00:01:48.846410 15234 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:01:48.846506 15234 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:01:48.847565 15234 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/minicluster-data/master-0/data/instance:
uuid: "86fa27d7db434987b0eecd62069fcf05"
format_stamp: "Formatted at 2026-08-12 00:01:48 on dist-test-slave-f0tn"
server_key: "24c9f8daf0fdb0d6ff51326fe607f8a5"
server_key_iv: "ed05d79bbbde573eb00a015547e67505"
server_key_version: "encryptionkey@0"
I20260812 00:01:48.847883 15234 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/minicluster-data/master-0/wal/instance:
uuid: "86fa27d7db434987b0eecd62069fcf05"
format_stamp: "Formatted at 2026-08-12 00:01:48 on dist-test-slave-f0tn"
server_key: "24c9f8daf0fdb0d6ff51326fe607f8a5"
server_key_iv: "ed05d79bbbde573eb00a015547e67505"
server_key_version: "encryptionkey@0"
I20260812 00:01:48.849215 15234 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 00:01:48.850049 15261 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:48.850381 15234 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:01:48.850471 15234 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/minicluster-data/master-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/minicluster-data/master-0/wal
uuid: "86fa27d7db434987b0eecd62069fcf05"
format_stamp: "Formatted at 2026-08-12 00:01:48 on dist-test-slave-f0tn"
server_key: "24c9f8daf0fdb0d6ff51326fe607f8a5"
server_key_iv: "ed05d79bbbde573eb00a015547e67505"
server_key_version: "encryptionkey@0"
I20260812 00:01:48.850553 15234 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:01:48.865721 15234 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:01:48.867738 15234 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:01:48.867879 15234 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:01:48.872651 15234 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.126:36401
I20260812 00:01:48.872700 15354 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.126:36401 every 8 connection(s)
I20260812 00:01:48.873008 15234 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
I20260812 00:01:48.873724 15355 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:01:48.873724 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 15234
I20260812 00:01:48.873791 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/minicluster-data/master-0/wal/instance
I20260812 00:01:48.873941 12089 external_mini_cluster.cc:1428] Setting key 0ee3d2f0dad79afcd57b1845cc2dd28f
I20260812 00:01:48.877015 15355 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 86fa27d7db434987b0eecd62069fcf05: Bootstrap starting.
I20260812 00:01:48.877730 15355 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 86fa27d7db434987b0eecd62069fcf05: Neither blocks nor log segments found. Creating new log.
I20260812 00:01:48.878005 15355 log.cc:824] T 00000000000000000000000000000000 P 86fa27d7db434987b0eecd62069fcf05: Log is configured to *not* fsync() on all Append() calls
I20260812 00:01:48.878793 15355 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 86fa27d7db434987b0eecd62069fcf05: No bootstrap required, opened a new log
Aug 12 00:01:48 dist-test-slave-f0tn krb5kdc[15210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492908, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:01:48.880926 15355 raft_consensus.cc:348] T 00000000000000000000000000000000 P 86fa27d7db434987b0eecd62069fcf05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86fa27d7db434987b0eecd62069fcf05" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 36401 } }
I20260812 00:01:48.881101 15355 raft_consensus.cc:374] T 00000000000000000000000000000000 P 86fa27d7db434987b0eecd62069fcf05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:01:48.881138 15355 raft_consensus.cc:729] T 00000000000000000000000000000000 P 86fa27d7db434987b0eecd62069fcf05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86fa27d7db434987b0eecd62069fcf05, State: Initialized, Role: FOLLOWER
I20260812 00:01:48.881273 15355 consensus_queue.cc:260] T 00000000000000000000000000000000 P 86fa27d7db434987b0eecd62069fcf05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86fa27d7db434987b0eecd62069fcf05" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 36401 } }
I20260812 00:01:48.881347 15355 raft_consensus.cc:388] T 00000000000000000000000000000000 P 86fa27d7db434987b0eecd62069fcf05 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:01:48.881400 15355 raft_consensus.cc:482] T 00000000000000000000000000000000 P 86fa27d7db434987b0eecd62069fcf05 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:01:48.881451 15355 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 86fa27d7db434987b0eecd62069fcf05 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:01:48.882144 15355 raft_consensus.cc:504] T 00000000000000000000000000000000 P 86fa27d7db434987b0eecd62069fcf05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86fa27d7db434987b0eecd62069fcf05" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 36401 } }
I20260812 00:01:48.882261 15355 leader_election.cc:302] T 00000000000000000000000000000000 P 86fa27d7db434987b0eecd62069fcf05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 86fa27d7db434987b0eecd62069fcf05; no voters:
I20260812 00:01:48.882439 15355 leader_election.cc:288] T 00000000000000000000000000000000 P 86fa27d7db434987b0eecd62069fcf05 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:01:48.882484 15362 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 86fa27d7db434987b0eecd62069fcf05 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:01:48.882660 15362 raft_consensus.cc:686] T 00000000000000000000000000000000 P 86fa27d7db434987b0eecd62069fcf05 [term 1 LEADER]: Becoming Leader. State: Replica: 86fa27d7db434987b0eecd62069fcf05, State: Running, Role: LEADER
I20260812 00:01:48.882747 15355 sys_catalog.cc:564] T 00000000000000000000000000000000 P 86fa27d7db434987b0eecd62069fcf05 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:01:48.882826 15362 consensus_queue.cc:237] T 00000000000000000000000000000000 P 86fa27d7db434987b0eecd62069fcf05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86fa27d7db434987b0eecd62069fcf05" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 36401 } }
I20260812 00:01:48.883173 15365 sys_catalog.cc:455] T 00000000000000000000000000000000 P 86fa27d7db434987b0eecd62069fcf05 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 86fa27d7db434987b0eecd62069fcf05. Latest consensus state: current_term: 1 leader_uuid: "86fa27d7db434987b0eecd62069fcf05" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86fa27d7db434987b0eecd62069fcf05" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 36401 } } }
I20260812 00:01:48.883327 15365 sys_catalog.cc:458] T 00000000000000000000000000000000 P 86fa27d7db434987b0eecd62069fcf05 [sys.catalog]: This master's current role is: LEADER
I20260812 00:01:48.883759 15368 sys_catalog.cc:455] T 00000000000000000000000000000000 P 86fa27d7db434987b0eecd62069fcf05 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "86fa27d7db434987b0eecd62069fcf05" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86fa27d7db434987b0eecd62069fcf05" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 36401 } } }
I20260812 00:01:48.883903 15368 sys_catalog.cc:458] T 00000000000000000000000000000000 P 86fa27d7db434987b0eecd62069fcf05 [sys.catalog]: This master's current role is: LEADER
W20260812 00:01:48.884619 15396 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 86fa27d7db434987b0eecd62069fcf05: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 00:01:48.884722 15396 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 00:01:48.884800 15380 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:01:48.884954 15380 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:01:48.885252 15360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:48.874482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46670 (local address 127.11.206.126:36401)
0812 00:01:48.874669 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:48.874679 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:48.874712 (+ 33us) server_negotiation.cc:407] Connection header received
0812 00:01:48.875193 (+ 481us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:48.875203 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:48.875269 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:48.875427 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:01:48.876068 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:48.877489 (+ 1421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:48.878319 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:48.878905 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:48.879017 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:48.881668 (+ 2651us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:01:48.881673 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:01:48.881673 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:01:48.881685 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:01:48.883652 (+ 1967us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:48.884081 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:48.884084 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:48.884084 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:48.884188 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:48.884404 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:48.884405 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:48.884405 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:48.884649 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:01:48.884793 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:48.884925 (+ 132us) server_negotiation.cc:299] Negotiation successful
0812 00:01:48.885058 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":78,"threads_started":1}
I20260812 00:01:48.886492 15380 catalog_manager.cc:1347] Generated new cluster ID: 52666d347bf5484bb8a6bdd522453177
I20260812 00:01:48.886543 15380 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:01:48.897487 15380 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:01:48.897990 15380 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:01:48.911578 15380 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 86fa27d7db434987b0eecd62069fcf05: Generated new TSK 0
I20260812 00:01:48.911798 15380 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.206.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.65.keytab.
Entry for principal kudu/127.11.206.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.65.keytab.
I20260812 00:01:48.937366 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.65:0
--local_ip_for_outbound_sockets=127.11.206.65
--webserver_interface=127.11.206.65
--webserver_port=0
--tserver_master_addrs=127.11.206.126:36401
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.65.keytab
--principal=kudu/127.11.206.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:38749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:01:49.018579 15405 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:01:49.018774 15405 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:01:49.018797 15405 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:01:49.019891 15405 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:01:49.019934 15405 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:01:49.019953 15405 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 00:01:49.019964 15405 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 00:01:49.019984 15405 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.65
I20260812 00:01:49.021456 15405 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:38749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.65.keytab
--principal=kudu/127.11.206.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.206.65
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.206.126:36401
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15405
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.65
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:01:49.021680 15405 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:01:49.021927 15405 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:01:49.026842 15411 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:01:49.026847 15414 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:01:49.026854 15412 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:01:49.027045 15405 server_base.cc:1034] running on GCE node
I20260812 00:01:49.027313 15405 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:01:49.027523 15405 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:01:49.028671 15405 hybrid_clock.cc:648] HybridClock initialized: now 1786492909028660 us; error 31 us; skew 500 ppm
Aug 12 00:01:49 dist-test-slave-f0tn krb5kdc[15210](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492909, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:01:49.031214 15405 init.cc:377] Logged in from keytab as kudu/127.11.206.65@KRBTEST.COM (short username kudu)
I20260812 00:01:49.031646 15405 webserver.cc:460] Webserver started at http://127.11.206.65:43597/ using document root <none> and password file <none>
I20260812 00:01:49.031877 15405 fs_manager.cc:359] Metadata directory not provided
I20260812 00:01:49.031929 15405 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:01:49.032050 15405 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:01:49.033070 15405 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/minicluster-data/ts-0/data/instance:
uuid: "0c90a6832042427d895ba4af46755543"
format_stamp: "Formatted at 2026-08-12 00:01:49 on dist-test-slave-f0tn"
server_key: "185228ec6bd3a91e09d9fc30248fa411"
server_key_iv: "8dbac35c46172e2b27de860c276f1715"
server_key_version: "encryptionkey@0"
I20260812 00:01:49.033444 15405 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/minicluster-data/ts-0/wal/instance:
uuid: "0c90a6832042427d895ba4af46755543"
format_stamp: "Formatted at 2026-08-12 00:01:49 on dist-test-slave-f0tn"
server_key: "185228ec6bd3a91e09d9fc30248fa411"
server_key_iv: "8dbac35c46172e2b27de860c276f1715"
server_key_version: "encryptionkey@0"
I20260812 00:01:49.034696 15405 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:01:49.035401 15424 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:49.035555 15405 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:01:49.035641 15405 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/minicluster-data/ts-0/wal
uuid: "0c90a6832042427d895ba4af46755543"
format_stamp: "Formatted at 2026-08-12 00:01:49 on dist-test-slave-f0tn"
server_key: "185228ec6bd3a91e09d9fc30248fa411"
server_key_iv: "8dbac35c46172e2b27de860c276f1715"
server_key_version: "encryptionkey@0"
I20260812 00:01:49.035708 15405 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:01:49.049657 15405 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:01:49.051604 15405 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:01:49.051741 15405 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:01:49.052284 15405 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:01:49.052325 15405 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:49.052356 15405 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:01:49.052373 15405 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:49.058771 15405 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.65:33327
Aug 12 00:01:49 dist-test-slave-f0tn krb5kdc[15210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492909, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.65@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:01:49.058894 15616 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.65:33327 every 8 connection(s)
I20260812 00:01:49.059152 15405 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
I20260812 00:01:49.061867 15360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:49.052725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.65:52735 (local address 127.11.206.126:36401)
0812 00:01:49.052774 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:49.052776 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:49.053002 (+ 226us) server_negotiation.cc:407] Connection header received
0812 00:01:49.053633 (+ 631us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:49.053634 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:49.053646 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:49.053696 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:01:49.054406 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:49.055175 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:49.056674 (+ 1499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:49.056938 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:49.056998 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:49.059371 (+ 2373us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:01:49.059373 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:01:49.059373 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:01:49.059381 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:01:49.060592 (+ 1211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:49.060941 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:49.060942 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:49.060943 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:49.061004 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:49.061217 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:49.061218 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:49.061218 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:49.061334 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:01:49.061405 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:49.061660 (+ 255us) server_negotiation.cc:299] Negotiation successful
0812 00:01:49.061759 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260812 00:01:49.062002 15438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:49.052724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:36401 (local address 127.11.206.65:52735)
0812 00:01:49.052887 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0812 00:01:49.052923 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0812 00:01:49.053521 (+ 598us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:01:49.053792 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:01:49.053813 (+ 21us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:01:49.054081 (+ 268us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:01:49.054270 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:49.054276 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:49.055268 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:49.055269 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:49.056563 (+ 1294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:49.056567 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:49.057013 (+ 446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:49.057014 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:49.057152 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:49.057679 (+ 527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:01:49.057690 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:01:49.059269 (+ 1579us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:01:49.060664 (+ 1395us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:01:49.060671 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:01:49.060674 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:01:49.060877 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:01:49.061063 (+ 186us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:01:49.061064 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:01:49.061064 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:01:49.061163 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:01:49.061402 (+ 239us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:01:49.061408 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:01:49.061544 (+ 136us) client_negotiation.cc:769] Sending connection context
0812 00:01:49.061632 (+ 88us) client_negotiation.cc:240] Negotiation successful
0812 00:01:49.061797 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":95,"threads_started":1}
I20260812 00:01:49.062403 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 15405
I20260812 00:01:49.062494 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/minicluster-data/ts-0/wal/instance
I20260812 00:01:49.062690 12089 external_mini_cluster.cc:1428] Setting key 327802c641f9833423f3d61a0ea58e3b
I20260812 00:01:49.063807 15618 heartbeater.cc:347] Connected to a master server at 127.11.206.126:36401
I20260812 00:01:49.063894 15618 heartbeater.cc:464] Registering TS with master...
I20260812 00:01:49.065410 15618 heartbeater.cc:511] Master 127.11.206.126:36401 requested a full tablet report, sending...
I20260812 00:01:49.065945 15287 ts_manager.cc:194] Registered new tserver with Master: 0c90a6832042427d895ba4af46755543 (127.11.206.65:33327)
I20260812 00:01:49.066792 15287 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.206.65@KRBTEST.COM'} at 127.11.206.65:52735
I20260812 00:01:49.069049 15626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:49.063531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:36401 (local address 127.11.206.65:37555)
0812 00:01:49.063668 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0812 00:01:49.063679 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:01:49.063734 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:01:49.063947 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:01:49.063948 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:01:49.064110 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:01:49.064157 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:49.064158 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:49.064774 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:49.064774 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:49.065333 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:49.065335 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:49.065776 (+ 441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:49.065777 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:49.065843 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:49.066208 (+ 365us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:01:49.066212 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:01:49.066464 (+ 252us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:01:49.068151 (+ 1687us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:01:49.068152 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:01:49.068152 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:01:49.068309 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:01:49.068472 (+ 163us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:01:49.068473 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:01:49.068474 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:01:49.068530 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:01:49.068738 (+ 208us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:01:49.068739 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:01:49.068793 (+ 54us) client_negotiation.cc:769] Sending connection context
0812 00:01:49.068851 (+ 58us) client_negotiation.cc:240] Negotiation successful
0812 00:01:49.068946 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":71,"threads_started":1}
I20260812 00:01:49.069036 15360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:49.063490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.65:37555 (local address 127.11.206.126:36401)
0812 00:01:49.063524 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:49.063526 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:49.063734 (+ 208us) server_negotiation.cc:407] Connection header received
0812 00:01:49.063850 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:49.063851 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:49.063860 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:49.063906 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:01:49.064228 (+ 322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:49.064692 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:49.065440 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:49.065721 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:49.065777 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:49.066542 (+ 765us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:01:49.066543 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:01:49.066544 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:01:49.066550 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:01:49.068077 (+ 1527us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:49.068367 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:49.068368 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:49.068368 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:49.068421 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:49.068585 (+ 164us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:49.068586 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:49.068587 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:49.068686 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:01:49.068740 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:49.068879 (+ 139us) server_negotiation.cc:299] Negotiation successful
0812 00:01:49.068947 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
WARNING: no policy specified for kudu/127.11.206.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.66.keytab.
Entry for principal kudu/127.11.206.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.66.keytab.
I20260812 00:01:49.087787 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.66:0
--local_ip_for_outbound_sockets=127.11.206.66
--webserver_interface=127.11.206.66
--webserver_port=0
--tserver_master_addrs=127.11.206.126:36401
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.66.keytab
--principal=kudu/127.11.206.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:38749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:01:49.170128 15631 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:01:49.170339 15631 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:01:49.170363 15631 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:01:49.171478 15631 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:01:49.171519 15631 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:01:49.171540 15631 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 00:01:49.171553 15631 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 00:01:49.171581 15631 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.66
I20260812 00:01:49.173066 15631 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:38749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.66.keytab
--principal=kudu/127.11.206.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.206.66
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.206.126:36401
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15631
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.66
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:01:49.173287 15631 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:01:49.173520 15631 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:01:49.178301 15645 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:01:49.178309 15650 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:01:49.178390 15654 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:01:49.178577 15631 server_base.cc:1034] running on GCE node
I20260812 00:01:49.178752 15631 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:01:49.178962 15631 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:01:49.180105 15631 hybrid_clock.cc:648] HybridClock initialized: now 1786492909180087 us; error 29 us; skew 500 ppm
Aug 12 00:01:49 dist-test-slave-f0tn krb5kdc[15210](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492909, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:01:49.182634 15631 init.cc:377] Logged in from keytab as kudu/127.11.206.66@KRBTEST.COM (short username kudu)
I20260812 00:01:49.183058 15631 webserver.cc:460] Webserver started at http://127.11.206.66:40479/ using document root <none> and password file <none>
I20260812 00:01:49.183229 15631 fs_manager.cc:359] Metadata directory not provided
I20260812 00:01:49.183267 15631 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:01:49.183359 15631 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:01:49.184412 15631 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/minicluster-data/ts-1/data/instance:
uuid: "4330d5ecb7e44e15b7d3e55c671748d3"
format_stamp: "Formatted at 2026-08-12 00:01:49 on dist-test-slave-f0tn"
server_key: "00ff02fdabed309de448f4d22551f7d6"
server_key_iv: "91521609b7a797737e5f98400128de2d"
server_key_version: "encryptionkey@0"
I20260812 00:01:49.184762 15631 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/minicluster-data/ts-1/wal/instance:
uuid: "4330d5ecb7e44e15b7d3e55c671748d3"
format_stamp: "Formatted at 2026-08-12 00:01:49 on dist-test-slave-f0tn"
server_key: "00ff02fdabed309de448f4d22551f7d6"
server_key_iv: "91521609b7a797737e5f98400128de2d"
server_key_version: "encryptionkey@0"
I20260812 00:01:49.186079 15631 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:01:49.186779 15665 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:49.186965 15631 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:01:49.187060 15631 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/minicluster-data/ts-1/wal
uuid: "4330d5ecb7e44e15b7d3e55c671748d3"
format_stamp: "Formatted at 2026-08-12 00:01:49 on dist-test-slave-f0tn"
server_key: "00ff02fdabed309de448f4d22551f7d6"
server_key_iv: "91521609b7a797737e5f98400128de2d"
server_key_version: "encryptionkey@0"
I20260812 00:01:49.187112 15631 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:01:49.197118 15631 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:01:49.199286 15631 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:01:49.199402 15631 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:01:49.199867 15631 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:01:49.199906 15631 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:49.199937 15631 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:01:49.199951 15631 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:49.206235 15631 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.66:35565
I20260812 00:01:49.206307 15856 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.66:35565 every 8 connection(s)
I20260812 00:01:49.206643 15631 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
Aug 12 00:01:49 dist-test-slave-f0tn krb5kdc[15210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492909, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.66@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:01:49.210243 15360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:49.200401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.66:39121 (local address 127.11.206.126:36401)
0812 00:01:49.200448 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:49.200449 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:49.200674 (+ 225us) server_negotiation.cc:407] Connection header received
0812 00:01:49.201260 (+ 586us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:49.201261 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:49.201277 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:49.201343 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:01:49.202258 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:49.203051 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:49.204547 (+ 1496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:49.204857 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:49.204941 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:49.207620 (+ 2679us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:01:49.207621 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:01:49.207621 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:01:49.207631 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:01:49.208890 (+ 1259us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:49.209290 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:49.209291 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:49.209292 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:49.209350 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:49.209601 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:49.209602 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:49.209602 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:49.209725 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:01:49.209782 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:49.210057 (+ 275us) server_negotiation.cc:299] Negotiation successful
0812 00:01:49.210148 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 00:01:49.210436 15680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:49.200400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:36401 (local address 127.11.206.66:39121)
0812 00:01:49.200554 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0812 00:01:49.200592 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 00:01:49.201127 (+ 535us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:01:49.201481 (+ 354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:01:49.201487 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:01:49.201866 (+ 379us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:01:49.202151 (+ 285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:49.202158 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:49.203142 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:49.203143 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:49.204445 (+ 1302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:49.204448 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:49.204976 (+ 528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:49.204977 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:49.205136 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:49.205770 (+ 634us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:01:49.205782 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:01:49.207519 (+ 1737us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:01:49.208972 (+ 1453us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:01:49.208980 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:01:49.208983 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:01:49.209219 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:01:49.209429 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:01:49.209430 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:01:49.209430 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:01:49.209544 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:01:49.209782 (+ 238us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:01:49.209789 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:01:49.209937 (+ 148us) client_negotiation.cc:769] Sending connection context
0812 00:01:49.210038 (+ 101us) client_negotiation.cc:240] Negotiation successful
0812 00:01:49.210210 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":89,"threads_started":1}
I20260812 00:01:49.210947 15857 heartbeater.cc:347] Connected to a master server at 127.11.206.126:36401
I20260812 00:01:49.211071 15857 heartbeater.cc:464] Registering TS with master...
I20260812 00:01:49.211285 15857 heartbeater.cc:511] Master 127.11.206.126:36401 requested a full tablet report, sending...
I20260812 00:01:49.211665 15292 ts_manager.cc:194] Registered new tserver with Master: 4330d5ecb7e44e15b7d3e55c671748d3 (127.11.206.66:35565)
I20260812 00:01:49.212142 15292 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.206.66@KRBTEST.COM'} at 127.11.206.66:39121
I20260812 00:01:49.212667 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 15631
I20260812 00:01:49.212764 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/minicluster-data/ts-1/wal/instance
I20260812 00:01:49.212967 12089 external_mini_cluster.cc:1428] Setting key 2ad528d781c71ab7ce62def80f7bddfc
I20260812 00:01:49.217865 15360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:49.212272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.66:35105 (local address 127.11.206.126:36401)
0812 00:01:49.212312 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:49.212314 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:49.212348 (+ 34us) server_negotiation.cc:407] Connection header received
0812 00:01:49.212420 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:49.212421 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:49.212430 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:49.212471 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:01:49.212798 (+ 327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:49.213434 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:49.214145 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:49.214347 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:49.214400 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:49.215306 (+ 906us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:01:49.215308 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:01:49.215308 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:01:49.215315 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:01:49.216629 (+ 1314us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:49.216957 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:49.216958 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:49.216958 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:49.217016 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:49.217245 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:49.217246 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:49.217247 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:49.217467 (+ 220us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:01:49.217532 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:49.217685 (+ 153us) server_negotiation.cc:299] Negotiation successful
0812 00:01:49.217769 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260812 00:01:49.217870 15864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:49.212127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:36401 (local address 127.11.206.66:35105)
0812 00:01:49.212288 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0812 00:01:49.212301 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 00:01:49.212366 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:01:49.212485 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:01:49.212486 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:01:49.212654 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:01:49.212711 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:49.212712 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:49.213511 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:49.213512 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:49.214070 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:49.214072 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:49.214405 (+ 333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:49.214406 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:49.214482 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:49.214915 (+ 433us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:01:49.214921 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:01:49.215223 (+ 302us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:01:49.216705 (+ 1482us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:01:49.216706 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:01:49.216706 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:01:49.216894 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:01:49.217116 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:01:49.217117 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:01:49.217117 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:01:49.217187 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:01:49.217538 (+ 351us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:01:49.217539 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:01:49.217591 (+ 52us) client_negotiation.cc:769] Sending connection context
0812 00:01:49.217651 (+ 60us) client_negotiation.cc:240] Negotiation successful
0812 00:01:49.217766 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":78,"threads_started":1}
WARNING: no policy specified for kudu/127.11.206.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.67.keytab.
Entry for principal kudu/127.11.206.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.67.keytab.
I20260812 00:01:49.237710 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.67:0
--local_ip_for_outbound_sockets=127.11.206.67
--webserver_interface=127.11.206.67
--webserver_port=0
--tserver_master_addrs=127.11.206.126:36401
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.67.keytab
--principal=kudu/127.11.206.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:38749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:01:49.321089 15868 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:01:49.321295 15868 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:01:49.321318 15868 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:01:49.322491 15868 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:01:49.322535 15868 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:01:49.322553 15868 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 00:01:49.322567 15868 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 00:01:49.322592 15868 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.67
I20260812 00:01:49.324028 15868 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:38749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.67.keytab
--principal=kudu/127.11.206.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.206.67
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.206.126:36401
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15868
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.67
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:01:49.324239 15868 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:01:49.324430 15868 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:01:49.329445 15883 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:01:49.329452 15880 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:01:49.329452 15881 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:01:49.329526 15868 server_base.cc:1034] running on GCE node
I20260812 00:01:49.329825 15868 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:01:49.330053 15868 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:01:49.331194 15868 hybrid_clock.cc:648] HybridClock initialized: now 1786492909331177 us; error 35 us; skew 500 ppm
Aug 12 00:01:49 dist-test-slave-f0tn krb5kdc[15210](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492909, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:01:49.333776 15868 init.cc:377] Logged in from keytab as kudu/127.11.206.67@KRBTEST.COM (short username kudu)
I20260812 00:01:49.334189 15868 webserver.cc:460] Webserver started at http://127.11.206.67:45191/ using document root <none> and password file <none>
I20260812 00:01:49.334383 15868 fs_manager.cc:359] Metadata directory not provided
I20260812 00:01:49.334424 15868 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:01:49.334513 15868 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:01:49.335538 15868 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/minicluster-data/ts-2/data/instance:
uuid: "243e9aadc9a5494fa5c49ad9050297e0"
format_stamp: "Formatted at 2026-08-12 00:01:49 on dist-test-slave-f0tn"
server_key: "be6619587a93c50b4036b9f23d88724e"
server_key_iv: "bf3849795a7408aec0ec3fcd4d154175"
server_key_version: "encryptionkey@0"
I20260812 00:01:49.335850 15868 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/minicluster-data/ts-2/wal/instance:
uuid: "243e9aadc9a5494fa5c49ad9050297e0"
format_stamp: "Formatted at 2026-08-12 00:01:49 on dist-test-slave-f0tn"
server_key: "be6619587a93c50b4036b9f23d88724e"
server_key_iv: "bf3849795a7408aec0ec3fcd4d154175"
server_key_version: "encryptionkey@0"
I20260812 00:01:49.337066 15868 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 00:01:49.337805 15898 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:49.337939 15868 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:49.338019 15868 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/minicluster-data/ts-2/wal
uuid: "243e9aadc9a5494fa5c49ad9050297e0"
format_stamp: "Formatted at 2026-08-12 00:01:49 on dist-test-slave-f0tn"
server_key: "be6619587a93c50b4036b9f23d88724e"
server_key_iv: "bf3849795a7408aec0ec3fcd4d154175"
server_key_version: "encryptionkey@0"
I20260812 00:01:49.338089 15868 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:01:49.353430 15868 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:01:49.356070 15868 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:01:49.356230 15868 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:01:49.356890 15868 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:01:49.356945 15868 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:49.356976 15868 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:01:49.356994 15868 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:49.364042 15868 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.67:41863
I20260812 00:01:49.364156 16077 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.67:41863 every 8 connection(s)
Aug 12 00:01:49 dist-test-slave-f0tn krb5kdc[15210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492909, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.67@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:01:49.364477 15868 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
I20260812 00:01:49.367498 15360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:49.357306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.67:38935 (local address 127.11.206.126:36401)
0812 00:01:49.357355 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:49.357357 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:49.357592 (+ 235us) server_negotiation.cc:407] Connection header received
0812 00:01:49.358148 (+ 556us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:49.358149 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:49.358162 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:49.358232 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:01:49.359218 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:49.360021 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:49.361657 (+ 1636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:49.361985 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:49.362059 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:49.364771 (+ 2712us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:01:49.364773 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:01:49.364773 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:01:49.364782 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:01:49.366194 (+ 1412us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:49.366582 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:49.366583 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:49.366583 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:49.366647 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:49.366873 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:49.366874 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:49.366875 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:49.366997 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:01:49.367054 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:49.367321 (+ 267us) server_negotiation.cc:299] Negotiation successful
0812 00:01:49.367406 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 00:01:49.367676 15912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:49.357293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:36401 (local address 127.11.206.67:38935)
0812 00:01:49.357463 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0812 00:01:49.357505 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 00:01:49.358045 (+ 540us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:01:49.358385 (+ 340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:01:49.358390 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:01:49.358775 (+ 385us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:01:49.359109 (+ 334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:49.359116 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:49.360142 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:49.360143 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:49.361570 (+ 1427us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:49.361574 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:49.362075 (+ 501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:49.362076 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:49.362237 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:49.362867 (+ 630us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:01:49.362878 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:01:49.364672 (+ 1794us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:01:49.366283 (+ 1611us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:01:49.366291 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:01:49.366293 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:01:49.366511 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:01:49.366701 (+ 190us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:01:49.366702 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:01:49.366702 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:01:49.366816 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:01:49.367051 (+ 235us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:01:49.367058 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:01:49.367199 (+ 141us) client_negotiation.cc:769] Sending connection context
0812 00:01:49.367293 (+ 94us) client_negotiation.cc:240] Negotiation successful
0812 00:01:49.367458 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":99,"threads_started":1}
I20260812 00:01:49.368216 16080 heartbeater.cc:347] Connected to a master server at 127.11.206.126:36401
I20260812 00:01:49.368302 16080 heartbeater.cc:464] Registering TS with master...
I20260812 00:01:49.368470 16080 heartbeater.cc:511] Master 127.11.206.126:36401 requested a full tablet report, sending...
I20260812 00:01:49.368852 15287 ts_manager.cc:194] Registered new tserver with Master: 243e9aadc9a5494fa5c49ad9050297e0 (127.11.206.67:41863)
I20260812 00:01:49.369231 15287 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.206.67@KRBTEST.COM'} at 127.11.206.67:38935
I20260812 00:01:49.372865 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 15868
I20260812 00:01:49.372960 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/minicluster-data/ts-2/wal/instance
I20260812 00:01:49.373157 12089 external_mini_cluster.cc:1428] Setting key 944c337250b9ef216a1c93d817a25864
I20260812 00:01:49.374055 12089 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:01:49.374590 15360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:49.369291 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.67:39227 (local address 127.11.206.126:36401)
0812 00:01:49.369422 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:49.369424 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:49.369531 (+ 107us) server_negotiation.cc:407] Connection header received
0812 00:01:49.369606 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:49.369607 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:49.369617 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:49.369658 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:01:49.369992 (+ 334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:49.370452 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:49.371100 (+ 648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:49.371275 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:49.371318 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:49.372157 (+ 839us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:01:49.372158 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:01:49.372158 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:01:49.372164 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:01:49.373464 (+ 1300us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:49.373807 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:49.373808 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:49.373809 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:49.373871 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:49.374162 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:49.374163 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:49.374163 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:49.374284 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:01:49.374335 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:49.374475 (+ 140us) server_negotiation.cc:299] Negotiation successful
0812 00:01:49.374531 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103}
I20260812 00:01:49.374653 16091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:49.369220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:36401 (local address 127.11.206.67:39227)
0812 00:01:49.369471 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0812 00:01:49.369481 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:01:49.369556 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:01:49.369672 (+ 116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:01:49.369673 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:01:49.369866 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:01:49.369920 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:49.369923 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:49.370524 (+ 601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:49.370524 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:49.371013 (+ 489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:49.371014 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:49.371352 (+ 338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:49.371353 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:49.371422 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:49.371766 (+ 344us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:01:49.371770 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:01:49.372031 (+ 261us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:01:49.373522 (+ 1491us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:01:49.373523 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:01:49.373523 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:01:49.373730 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:01:49.373958 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:01:49.373959 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:01:49.373960 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:01:49.374036 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:01:49.374339 (+ 303us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:01:49.374340 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:01:49.374388 (+ 48us) client_negotiation.cc:769] Sending connection context
0812 00:01:49.374456 (+ 68us) client_negotiation.cc:240] Negotiation successful
0812 00:01:49.374562 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":88,"threads_started":1}
Aug 12 00:01:49 dist-test-slave-f0tn krb5kdc[15210](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492909, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 00:01:49 dist-test-slave-f0tn krb5kdc[15210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492909, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:01:49.396993 15360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:49.390455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46686 (local address 127.11.206.126:36401)
0812 00:01:49.390512 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:49.390514 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:49.390522 (+ 8us) server_negotiation.cc:407] Connection header received
0812 00:01:49.390554 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:49.390555 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:49.390564 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:49.390612 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:01:49.391213 (+ 601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:49.391722 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:49.392442 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:49.392624 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:49.392669 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:49.394812 (+ 2143us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:01:49.394813 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:01:49.394813 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:01:49.394820 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:01:49.396051 (+ 1231us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:49.396359 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:49.396359 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:49.396359 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:49.396407 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:49.396537 (+ 130us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:49.396537 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:49.396538 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:49.396634 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:01:49.396702 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:49.396867 (+ 165us) server_negotiation.cc:299] Negotiation successful
0812 00:01:49.396925 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260812 00:01:49.398571 15287 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46686:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:01:49.400151 15287 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:01:49.406605 16112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:49.402662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45684 (local address 127.11.206.65:33327)
0812 00:01:49.402819 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:49.402824 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:49.402835 (+ 11us) server_negotiation.cc:407] Connection header received
0812 00:01:49.402875 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:49.402877 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:49.402891 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:49.403139 (+ 248us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:01:49.403209 (+ 70us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:49.404313 (+ 1104us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:49.405528 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:49.406053 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:49.406126 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:49.406193 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:49.406443 (+ 250us) server_negotiation.cc:299] Negotiation successful
0812 00:01:49.406489 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":74,"threads_started":1}
I20260812 00:01:49.406603 16104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:49.402287 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.65:33327 (local address 127.0.0.1:45684)
0812 00:01:49.402424 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0812 00:01:49.402466 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 00:01:49.402531 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:01:49.403001 (+ 470us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:01:49.403002 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:01:49.403004 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:01:49.403062 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:49.403063 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:49.404399 (+ 1336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:49.404400 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:49.405444 (+ 1044us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:49.405447 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:49.406141 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:49.406142 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:49.406320 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:49.406335 (+ 15us) client_negotiation.cc:769] Sending connection context
0812 00:01:49.406401 (+ 66us) client_negotiation.cc:240] Negotiation successful
0812 00:01:49.406507 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":58,"threads_started":1}
I20260812 00:01:49.406701 16111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:49.402290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.67:41863 (local address 127.0.0.1:43678)
0812 00:01:49.402596 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0812 00:01:49.402605 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:01:49.402665 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:01:49.402851 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:01:49.402854 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:01:49.402856 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:01:49.402924 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:49.402926 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:49.404059 (+ 1133us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:49.404060 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:49.405296 (+ 1236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:49.405299 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:49.406383 (+ 1084us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:49.406385 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:49.406467 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:49.406486 (+ 19us) client_negotiation.cc:769] Sending connection context
0812 00:01:49.406535 (+ 49us) client_negotiation.cc:240] Negotiation successful
0812 00:01:49.406580 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":292,"thread_start_us":72,"threads_started":1}
I20260812 00:01:49.407066 16114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:49.402918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38606 (local address 127.11.206.66:35565)
0812 00:01:49.403147 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:49.403152 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:49.403298 (+ 146us) server_negotiation.cc:407] Connection header received
0812 00:01:49.403337 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:49.403339 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:49.403353 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:49.403423 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:01:49.403560 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:49.404565 (+ 1005us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:49.405632 (+ 1067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:49.406342 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:49.406409 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:49.406464 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:49.406922 (+ 458us) server_negotiation.cc:299] Negotiation successful
0812 00:01:49.406970 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":199,"thread_start_us":82,"threads_started":1}
I20260812 00:01:49.406692 16108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:49.402391 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43678 (local address 127.11.206.67:41863)
0812 00:01:49.402538 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:49.402543 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:49.402673 (+ 130us) server_negotiation.cc:407] Connection header received
0812 00:01:49.402737 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:49.402739 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:49.402763 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:49.402833 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:01:49.403062 (+ 229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:49.403987 (+ 925us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:49.405409 (+ 1422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:49.406148 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:49.406240 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:49.406342 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:49.406554 (+ 212us) server_negotiation.cc:299] Negotiation successful
0812 00:01:49.406594 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":80,"threads_started":1}
I20260812 00:01:49.406978 16105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:49.402510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.66:35565 (local address 127.0.0.1:38606)
0812 00:01:49.403191 (+ 681us) negotiation.cc:107] Waiting for socket to connect
0812 00:01:49.403201 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:01:49.403249 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:01:49.403439 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:01:49.403440 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:01:49.403442 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:01:49.403486 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:49.403488 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:49.404637 (+ 1149us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:49.404638 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:49.405543 (+ 905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:49.405546 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:49.406753 (+ 1207us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:49.406754 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:49.406821 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:49.406826 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 00:01:49.406876 (+ 50us) client_negotiation.cc:240] Negotiation successful
0812 00:01:49.406916 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":669,"thread_start_us":55,"threads_started":1}
I20260812 00:01:49.407639 15499 tablet_service.cc:1467] Processing CreateTablet for tablet 54055ba0f7b54b26bf3da677ce960879 (DEFAULT_TABLE table=test-table [id=250b69934db44214ad0441e49e91cbf5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:01:49.408001 15499 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 54055ba0f7b54b26bf3da677ce960879. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:01:49.407950 15977 tablet_service.cc:1467] Processing CreateTablet for tablet 54055ba0f7b54b26bf3da677ce960879 (DEFAULT_TABLE table=test-table [id=250b69934db44214ad0441e49e91cbf5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:01:49.407950 15756 tablet_service.cc:1467] Processing CreateTablet for tablet 54055ba0f7b54b26bf3da677ce960879 (DEFAULT_TABLE table=test-table [id=250b69934db44214ad0441e49e91cbf5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:01:49.408296 15977 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 54055ba0f7b54b26bf3da677ce960879. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:01:49.408296 15756 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 54055ba0f7b54b26bf3da677ce960879. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:01:49.411087 16115 tablet_bootstrap.cc:492] T 54055ba0f7b54b26bf3da677ce960879 P 0c90a6832042427d895ba4af46755543: Bootstrap starting.
I20260812 00:01:49.411494 16118 tablet_bootstrap.cc:492] T 54055ba0f7b54b26bf3da677ce960879 P 243e9aadc9a5494fa5c49ad9050297e0: Bootstrap starting.
I20260812 00:01:49.411936 16115 tablet_bootstrap.cc:654] T 54055ba0f7b54b26bf3da677ce960879 P 0c90a6832042427d895ba4af46755543: Neither blocks nor log segments found. Creating new log.
I20260812 00:01:49.411940 16119 tablet_bootstrap.cc:492] T 54055ba0f7b54b26bf3da677ce960879 P 4330d5ecb7e44e15b7d3e55c671748d3: Bootstrap starting.
I20260812 00:01:49.412544 16118 tablet_bootstrap.cc:654] T 54055ba0f7b54b26bf3da677ce960879 P 243e9aadc9a5494fa5c49ad9050297e0: Neither blocks nor log segments found. Creating new log.
I20260812 00:01:49.412549 16115 log.cc:824] T 54055ba0f7b54b26bf3da677ce960879 P 0c90a6832042427d895ba4af46755543: Log is configured to *not* fsync() on all Append() calls
I20260812 00:01:49.412590 16119 tablet_bootstrap.cc:654] T 54055ba0f7b54b26bf3da677ce960879 P 4330d5ecb7e44e15b7d3e55c671748d3: Neither blocks nor log segments found. Creating new log.
I20260812 00:01:49.412894 16118 log.cc:824] T 54055ba0f7b54b26bf3da677ce960879 P 243e9aadc9a5494fa5c49ad9050297e0: Log is configured to *not* fsync() on all Append() calls
I20260812 00:01:49.412904 16119 log.cc:824] T 54055ba0f7b54b26bf3da677ce960879 P 4330d5ecb7e44e15b7d3e55c671748d3: Log is configured to *not* fsync() on all Append() calls
I20260812 00:01:49.413352 16115 tablet_bootstrap.cc:492] T 54055ba0f7b54b26bf3da677ce960879 P 0c90a6832042427d895ba4af46755543: No bootstrap required, opened a new log
I20260812 00:01:49.413479 16115 ts_tablet_manager.cc:1397] T 54055ba0f7b54b26bf3da677ce960879 P 0c90a6832042427d895ba4af46755543: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 00:01:49.413604 16118 tablet_bootstrap.cc:492] T 54055ba0f7b54b26bf3da677ce960879 P 243e9aadc9a5494fa5c49ad9050297e0: No bootstrap required, opened a new log
I20260812 00:01:49.413673 16118 ts_tablet_manager.cc:1397] T 54055ba0f7b54b26bf3da677ce960879 P 243e9aadc9a5494fa5c49ad9050297e0: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 00:01:49.414088 16119 tablet_bootstrap.cc:492] T 54055ba0f7b54b26bf3da677ce960879 P 4330d5ecb7e44e15b7d3e55c671748d3: No bootstrap required, opened a new log
I20260812 00:01:49.414147 16119 ts_tablet_manager.cc:1397] T 54055ba0f7b54b26bf3da677ce960879 P 4330d5ecb7e44e15b7d3e55c671748d3: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 00:01:49.415447 16119 raft_consensus.cc:348] T 54055ba0f7b54b26bf3da677ce960879 P 4330d5ecb7e44e15b7d3e55c671748d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "243e9aadc9a5494fa5c49ad9050297e0" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 41863 } } peers { permanent_uuid: "4330d5ecb7e44e15b7d3e55c671748d3" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 35565 } } peers { permanent_uuid: "0c90a6832042427d895ba4af46755543" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 33327 } }
I20260812 00:01:49.415580 16119 raft_consensus.cc:374] T 54055ba0f7b54b26bf3da677ce960879 P 4330d5ecb7e44e15b7d3e55c671748d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:01:49.415611 16119 raft_consensus.cc:729] T 54055ba0f7b54b26bf3da677ce960879 P 4330d5ecb7e44e15b7d3e55c671748d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4330d5ecb7e44e15b7d3e55c671748d3, State: Initialized, Role: FOLLOWER
I20260812 00:01:49.415531 16115 raft_consensus.cc:348] T 54055ba0f7b54b26bf3da677ce960879 P 0c90a6832042427d895ba4af46755543 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "243e9aadc9a5494fa5c49ad9050297e0" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 41863 } } peers { permanent_uuid: "4330d5ecb7e44e15b7d3e55c671748d3" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 35565 } } peers { permanent_uuid: "0c90a6832042427d895ba4af46755543" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 33327 } }
I20260812 00:01:49.415514 16118 raft_consensus.cc:348] T 54055ba0f7b54b26bf3da677ce960879 P 243e9aadc9a5494fa5c49ad9050297e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "243e9aadc9a5494fa5c49ad9050297e0" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 41863 } } peers { permanent_uuid: "4330d5ecb7e44e15b7d3e55c671748d3" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 35565 } } peers { permanent_uuid: "0c90a6832042427d895ba4af46755543" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 33327 } }
I20260812 00:01:49.415671 16115 raft_consensus.cc:374] T 54055ba0f7b54b26bf3da677ce960879 P 0c90a6832042427d895ba4af46755543 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:01:49.415706 16115 raft_consensus.cc:729] T 54055ba0f7b54b26bf3da677ce960879 P 0c90a6832042427d895ba4af46755543 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c90a6832042427d895ba4af46755543, State: Initialized, Role: FOLLOWER
I20260812 00:01:49.415671 16118 raft_consensus.cc:374] T 54055ba0f7b54b26bf3da677ce960879 P 243e9aadc9a5494fa5c49ad9050297e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:01:49.415728 16119 consensus_queue.cc:260] T 54055ba0f7b54b26bf3da677ce960879 P 4330d5ecb7e44e15b7d3e55c671748d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "243e9aadc9a5494fa5c49ad9050297e0" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 41863 } } peers { permanent_uuid: "4330d5ecb7e44e15b7d3e55c671748d3" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 35565 } } peers { permanent_uuid: "0c90a6832042427d895ba4af46755543" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 33327 } }
I20260812 00:01:49.415762 16118 raft_consensus.cc:729] T 54055ba0f7b54b26bf3da677ce960879 P 243e9aadc9a5494fa5c49ad9050297e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 243e9aadc9a5494fa5c49ad9050297e0, State: Initialized, Role: FOLLOWER
I20260812 00:01:49.415827 16115 consensus_queue.cc:260] T 54055ba0f7b54b26bf3da677ce960879 P 0c90a6832042427d895ba4af46755543 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "243e9aadc9a5494fa5c49ad9050297e0" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 41863 } } peers { permanent_uuid: "4330d5ecb7e44e15b7d3e55c671748d3" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 35565 } } peers { permanent_uuid: "0c90a6832042427d895ba4af46755543" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 33327 } }
I20260812 00:01:49.415907 16118 consensus_queue.cc:260] T 54055ba0f7b54b26bf3da677ce960879 P 243e9aadc9a5494fa5c49ad9050297e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "243e9aadc9a5494fa5c49ad9050297e0" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 41863 } } peers { permanent_uuid: "4330d5ecb7e44e15b7d3e55c671748d3" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 35565 } } peers { permanent_uuid: "0c90a6832042427d895ba4af46755543" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 33327 } }
I20260812 00:01:49.415988 16119 ts_tablet_manager.cc:1428] T 54055ba0f7b54b26bf3da677ce960879 P 4330d5ecb7e44e15b7d3e55c671748d3: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 00:01:49.416110 16115 ts_tablet_manager.cc:1428] T 54055ba0f7b54b26bf3da677ce960879 P 0c90a6832042427d895ba4af46755543: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260812 00:01:49.416143 15857 heartbeater.cc:503] Master 127.11.206.126:36401 was elected leader, sending a full tablet report...
I20260812 00:01:49.416249 15618 heartbeater.cc:503] Master 127.11.206.126:36401 was elected leader, sending a full tablet report...
I20260812 00:01:49.416481 16118 ts_tablet_manager.cc:1428] T 54055ba0f7b54b26bf3da677ce960879 P 243e9aadc9a5494fa5c49ad9050297e0: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260812 00:01:49.416602 16080 heartbeater.cc:503] Master 127.11.206.126:36401 was elected leader, sending a full tablet report...
W20260812 00:01:49.457298 15858 tablet.cc:2369] T 54055ba0f7b54b26bf3da677ce960879 P 4330d5ecb7e44e15b7d3e55c671748d3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:01:49.487421 16130 raft_consensus.cc:482] T 54055ba0f7b54b26bf3da677ce960879 P 243e9aadc9a5494fa5c49ad9050297e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:01:49.487581 16130 raft_consensus.cc:504] T 54055ba0f7b54b26bf3da677ce960879 P 243e9aadc9a5494fa5c49ad9050297e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "243e9aadc9a5494fa5c49ad9050297e0" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 41863 } } peers { permanent_uuid: "4330d5ecb7e44e15b7d3e55c671748d3" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 35565 } } peers { permanent_uuid: "0c90a6832042427d895ba4af46755543" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 33327 } }
I20260812 00:01:49.487952 16130 leader_election.cc:288] T 54055ba0f7b54b26bf3da677ce960879 P 243e9aadc9a5494fa5c49ad9050297e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4330d5ecb7e44e15b7d3e55c671748d3 (127.11.206.66:35565), 0c90a6832042427d895ba4af46755543 (127.11.206.65:33327)
I20260812 00:01:49.491026 16133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:49.488190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.65:33327 (local address 127.11.206.67:37425)
0812 00:01:49.488403 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0812 00:01:49.488415 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 00:01:49.488474 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:01:49.488601 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:01:49.488601 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:01:49.488603 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:01:49.488670 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:49.488672 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:49.489363 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:49.489364 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:49.490252 (+ 888us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:49.490255 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:49.490776 (+ 521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:49.490777 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:49.490850 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:49.490855 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 00:01:49.490901 (+ 46us) client_negotiation.cc:240] Negotiation successful
0812 00:01:49.490939 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":196,"mutex_wait_us":25,"thread_start_us":131,"threads_started":1}
I20260812 00:01:49.491053 16112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:49.488279 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.67:37425 (local address 127.11.206.65:33327)
0812 00:01:49.488328 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:49.488330 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:49.488486 (+ 156us) server_negotiation.cc:407] Connection header received
0812 00:01:49.488520 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:49.488521 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:49.488531 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:49.488588 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:01:49.488730 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:49.489280 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:49.490331 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:49.490700 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:49.490756 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:49.490763 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:49.490920 (+ 157us) server_negotiation.cc:299] Negotiation successful
0812 00:01:49.490954 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260812 00:01:49.491148 15912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:49.488188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.66:35565 (local address 127.11.206.67:34497)
0812 00:01:49.488261 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0812 00:01:49.488273 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 00:01:49.488320 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:01:49.488486 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:01:49.488487 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:01:49.488489 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:01:49.488594 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:49.488596 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:49.489340 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:49.489341 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:49.490253 (+ 912us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:49.490255 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:49.490920 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:49.490921 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:49.490999 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:49.491003 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:01:49.491051 (+ 48us) client_negotiation.cc:240] Negotiation successful
0812 00:01:49.491087 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47,"mutex_wait_us":2}
I20260812 00:01:49.491334 16114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:49.488279 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.67:34497 (local address 127.11.206.66:35565)
0812 00:01:49.488326 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:49.488328 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:49.488340 (+ 12us) server_negotiation.cc:407] Connection header received
0812 00:01:49.488377 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:49.488378 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:49.488387 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:49.488468 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:01:49.488670 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:49.489263 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:49.490333 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:49.490833 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:49.490923 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:49.490930 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:49.491234 (+ 304us) server_negotiation.cc:299] Negotiation successful
0812 00:01:49.491276 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 00:01:49.491428 15536 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54055ba0f7b54b26bf3da677ce960879" candidate_uuid: "243e9aadc9a5494fa5c49ad9050297e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c90a6832042427d895ba4af46755543" is_pre_election: true
I20260812 00:01:49.491591 15536 raft_consensus.cc:2454] T 54055ba0f7b54b26bf3da677ce960879 P 0c90a6832042427d895ba4af46755543 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 243e9aadc9a5494fa5c49ad9050297e0 in term 0.
I20260812 00:01:49.491602 15785 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54055ba0f7b54b26bf3da677ce960879" candidate_uuid: "243e9aadc9a5494fa5c49ad9050297e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4330d5ecb7e44e15b7d3e55c671748d3" is_pre_election: true
I20260812 00:01:49.491742 15785 raft_consensus.cc:2454] T 54055ba0f7b54b26bf3da677ce960879 P 4330d5ecb7e44e15b7d3e55c671748d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 243e9aadc9a5494fa5c49ad9050297e0 in term 0.
I20260812 00:01:49.491819 15900 leader_election.cc:302] T 54055ba0f7b54b26bf3da677ce960879 P 243e9aadc9a5494fa5c49ad9050297e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c90a6832042427d895ba4af46755543, 243e9aadc9a5494fa5c49ad9050297e0; no voters:
I20260812 00:01:49.491950 16130 raft_consensus.cc:2781] T 54055ba0f7b54b26bf3da677ce960879 P 243e9aadc9a5494fa5c49ad9050297e0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:01:49.491997 16130 raft_consensus.cc:482] T 54055ba0f7b54b26bf3da677ce960879 P 243e9aadc9a5494fa5c49ad9050297e0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:01:49.492017 16130 raft_consensus.cc:3037] T 54055ba0f7b54b26bf3da677ce960879 P 243e9aadc9a5494fa5c49ad9050297e0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:01:49.492717 16130 raft_consensus.cc:504] T 54055ba0f7b54b26bf3da677ce960879 P 243e9aadc9a5494fa5c49ad9050297e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "243e9aadc9a5494fa5c49ad9050297e0" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 41863 } } peers { permanent_uuid: "4330d5ecb7e44e15b7d3e55c671748d3" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 35565 } } peers { permanent_uuid: "0c90a6832042427d895ba4af46755543" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 33327 } }
I20260812 00:01:49.492848 16130 leader_election.cc:288] T 54055ba0f7b54b26bf3da677ce960879 P 243e9aadc9a5494fa5c49ad9050297e0 [CANDIDATE]: Term 1 election: Requested vote from peers 4330d5ecb7e44e15b7d3e55c671748d3 (127.11.206.66:35565), 0c90a6832042427d895ba4af46755543 (127.11.206.65:33327)
I20260812 00:01:49.493017 15785 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54055ba0f7b54b26bf3da677ce960879" candidate_uuid: "243e9aadc9a5494fa5c49ad9050297e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4330d5ecb7e44e15b7d3e55c671748d3"
I20260812 00:01:49.493009 15536 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54055ba0f7b54b26bf3da677ce960879" candidate_uuid: "243e9aadc9a5494fa5c49ad9050297e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c90a6832042427d895ba4af46755543"
I20260812 00:01:49.493103 15785 raft_consensus.cc:3037] T 54055ba0f7b54b26bf3da677ce960879 P 4330d5ecb7e44e15b7d3e55c671748d3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:01:49.493115 15536 raft_consensus.cc:3037] T 54055ba0f7b54b26bf3da677ce960879 P 0c90a6832042427d895ba4af46755543 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:01:49.494019 15785 raft_consensus.cc:2454] T 54055ba0f7b54b26bf3da677ce960879 P 4330d5ecb7e44e15b7d3e55c671748d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 243e9aadc9a5494fa5c49ad9050297e0 in term 1.
I20260812 00:01:49.494019 15536 raft_consensus.cc:2454] T 54055ba0f7b54b26bf3da677ce960879 P 0c90a6832042427d895ba4af46755543 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 243e9aadc9a5494fa5c49ad9050297e0 in term 1.
I20260812 00:01:49.494177 15900 leader_election.cc:302] T 54055ba0f7b54b26bf3da677ce960879 P 243e9aadc9a5494fa5c49ad9050297e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c90a6832042427d895ba4af46755543, 243e9aadc9a5494fa5c49ad9050297e0; no voters:
I20260812 00:01:49.494305 16130 raft_consensus.cc:2781] T 54055ba0f7b54b26bf3da677ce960879 P 243e9aadc9a5494fa5c49ad9050297e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:01:49.494465 16130 raft_consensus.cc:686] T 54055ba0f7b54b26bf3da677ce960879 P 243e9aadc9a5494fa5c49ad9050297e0 [term 1 LEADER]: Becoming Leader. State: Replica: 243e9aadc9a5494fa5c49ad9050297e0, State: Running, Role: LEADER
I20260812 00:01:49.494578 16130 consensus_queue.cc:237] T 54055ba0f7b54b26bf3da677ce960879 P 243e9aadc9a5494fa5c49ad9050297e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "243e9aadc9a5494fa5c49ad9050297e0" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 41863 } } peers { permanent_uuid: "4330d5ecb7e44e15b7d3e55c671748d3" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 35565 } } peers { permanent_uuid: "0c90a6832042427d895ba4af46755543" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 33327 } }
I20260812 00:01:49.495427 15287 catalog_manager.cc:5495] T 54055ba0f7b54b26bf3da677ce960879 P 243e9aadc9a5494fa5c49ad9050297e0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 243e9aadc9a5494fa5c49ad9050297e0 (127.11.206.67). New cstate: current_term: 1 leader_uuid: "243e9aadc9a5494fa5c49ad9050297e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "243e9aadc9a5494fa5c49ad9050297e0" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 41863 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4330d5ecb7e44e15b7d3e55c671748d3" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 35565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c90a6832042427d895ba4af46755543" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 33327 } health_report { overall_health: UNKNOWN } } }
Aug 12 00:01:49 dist-test-slave-f0tn krb5kdc[15210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492908, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.126@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:01:49.552726 15360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:49.546244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46698 (local address 127.11.206.126:36401)
0812 00:01:49.546320 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:49.546322 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:49.546401 (+ 79us) server_negotiation.cc:407] Connection header received
0812 00:01:49.546478 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:49.546478 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:49.546488 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:49.546536 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:01:49.547003 (+ 467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:49.547480 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:49.548202 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:49.548369 (+ 167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:49.548408 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:49.550394 (+ 1986us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:01:49.550396 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:01:49.550396 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:01:49.550402 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:01:49.551622 (+ 1220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:49.551978 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:49.551978 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:49.551979 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:49.552025 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:49.552225 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:49.552225 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:49.552225 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:49.552317 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:01:49.552360 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:49.552560 (+ 200us) server_negotiation.cc:299] Negotiation successful
0812 00:01:49.552638 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260812 00:01:49.552845 16144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:49.546144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:36401 (local address 127.0.0.1:46698)
0812 00:01:49.546328 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0812 00:01:49.546339 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:01:49.546424 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:01:49.546559 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:01:49.546560 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:01:49.546884 (+ 324us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:01:49.546941 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:49.546943 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:49.547572 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:49.547573 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:49.548138 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:49.548140 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:49.548412 (+ 272us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:49.548413 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:49.548452 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:49.548925 (+ 473us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:01:49.548930 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:01:49.550316 (+ 1386us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:01:49.551705 (+ 1389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:01:49.551713 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:01:49.551715 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:01:49.551912 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:01:49.552099 (+ 187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:01:49.552100 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:01:49.552100 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:01:49.552166 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:01:49.552401 (+ 235us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:01:49.552414 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:01:49.552469 (+ 55us) client_negotiation.cc:769] Sending connection context
0812 00:01:49.552544 (+ 75us) client_negotiation.cc:240] Negotiation successful
0812 00:01:49.552719 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"mutex_wait_us":59,"thread_start_us":83,"threads_started":1}
I20260812 00:01:49.554854 15287 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.11.206.126@KRBTEST.COM'} at 127.0.0.1:46698:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260812 00:01:49.555074 15287 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:01:49.556598 15499 tablet_service.cc:1467] Processing CreateTablet for tablet 71f9cbf54c764f95a992c2700cd9d117 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=3e5d037289e1468798a1f18f21b35c32]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 00:01:49.556591 15756 tablet_service.cc:1467] Processing CreateTablet for tablet 71f9cbf54c764f95a992c2700cd9d117 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=3e5d037289e1468798a1f18f21b35c32]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 00:01:49.556782 15756 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 71f9cbf54c764f95a992c2700cd9d117. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:01:49.556782 15499 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 71f9cbf54c764f95a992c2700cd9d117. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:01:49.557816 15977 tablet_service.cc:1467] Processing CreateTablet for tablet 71f9cbf54c764f95a992c2700cd9d117 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=3e5d037289e1468798a1f18f21b35c32]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 00:01:49.557986 15977 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 71f9cbf54c764f95a992c2700cd9d117. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:01:49.558393 16115 tablet_bootstrap.cc:492] T 71f9cbf54c764f95a992c2700cd9d117 P 0c90a6832042427d895ba4af46755543: Bootstrap starting.
I20260812 00:01:49.559082 16115 tablet_bootstrap.cc:654] T 71f9cbf54c764f95a992c2700cd9d117 P 0c90a6832042427d895ba4af46755543: Neither blocks nor log segments found. Creating new log.
I20260812 00:01:49.559456 16119 tablet_bootstrap.cc:492] T 71f9cbf54c764f95a992c2700cd9d117 P 4330d5ecb7e44e15b7d3e55c671748d3: Bootstrap starting.
I20260812 00:01:49.559473 16118 tablet_bootstrap.cc:492] T 71f9cbf54c764f95a992c2700cd9d117 P 243e9aadc9a5494fa5c49ad9050297e0: Bootstrap starting.
I20260812 00:01:49.559892 16118 tablet_bootstrap.cc:654] T 71f9cbf54c764f95a992c2700cd9d117 P 243e9aadc9a5494fa5c49ad9050297e0: Neither blocks nor log segments found. Creating new log.
I20260812 00:01:49.559892 16115 tablet_bootstrap.cc:492] T 71f9cbf54c764f95a992c2700cd9d117 P 0c90a6832042427d895ba4af46755543: No bootstrap required, opened a new log
W20260812 00:01:49.559871 15619 tablet.cc:2369] T 54055ba0f7b54b26bf3da677ce960879 P 0c90a6832042427d895ba4af46755543: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:01:49.560117 16115 ts_tablet_manager.cc:1397] T 71f9cbf54c764f95a992c2700cd9d117 P 0c90a6832042427d895ba4af46755543: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 00:01:49.560289 16115 raft_consensus.cc:348] T 71f9cbf54c764f95a992c2700cd9d117 P 0c90a6832042427d895ba4af46755543 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c90a6832042427d895ba4af46755543" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 33327 } } peers { permanent_uuid: "4330d5ecb7e44e15b7d3e55c671748d3" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 35565 } } peers { permanent_uuid: "243e9aadc9a5494fa5c49ad9050297e0" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 41863 } }
I20260812 00:01:49.560361 16115 raft_consensus.cc:374] T 71f9cbf54c764f95a992c2700cd9d117 P 0c90a6832042427d895ba4af46755543 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:01:49.560379 16115 raft_consensus.cc:729] T 71f9cbf54c764f95a992c2700cd9d117 P 0c90a6832042427d895ba4af46755543 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c90a6832042427d895ba4af46755543, State: Initialized, Role: FOLLOWER
I20260812 00:01:49.560400 16119 tablet_bootstrap.cc:654] T 71f9cbf54c764f95a992c2700cd9d117 P 4330d5ecb7e44e15b7d3e55c671748d3: Neither blocks nor log segments found. Creating new log.
I20260812 00:01:49.560424 16115 consensus_queue.cc:260] T 71f9cbf54c764f95a992c2700cd9d117 P 0c90a6832042427d895ba4af46755543 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c90a6832042427d895ba4af46755543" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 33327 } } peers { permanent_uuid: "4330d5ecb7e44e15b7d3e55c671748d3" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 35565 } } peers { permanent_uuid: "243e9aadc9a5494fa5c49ad9050297e0" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 41863 } }
I20260812 00:01:49.560515 16115 ts_tablet_manager.cc:1428] T 71f9cbf54c764f95a992c2700cd9d117 P 0c90a6832042427d895ba4af46755543: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:49.560592 16129 tablet_replica.cc:439] T 71f9cbf54c764f95a992c2700cd9d117 P 0c90a6832042427d895ba4af46755543: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c90a6832042427d895ba4af46755543" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 33327 } } peers { permanent_uuid: "4330d5ecb7e44e15b7d3e55c671748d3" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 35565 } } peers { permanent_uuid: "243e9aadc9a5494fa5c49ad9050297e0" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 41863 } } }
I20260812 00:01:49.560701 16129 tablet_replica.cc:442] T 71f9cbf54c764f95a992c2700cd9d117 P 0c90a6832042427d895ba4af46755543: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:01:49.560892 16118 tablet_bootstrap.cc:492] T 71f9cbf54c764f95a992c2700cd9d117 P 243e9aadc9a5494fa5c49ad9050297e0: No bootstrap required, opened a new log
I20260812 00:01:49.560945 16118 ts_tablet_manager.cc:1397] T 71f9cbf54c764f95a992c2700cd9d117 P 243e9aadc9a5494fa5c49ad9050297e0: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260812 00:01:49.561094 16118 raft_consensus.cc:348] T 71f9cbf54c764f95a992c2700cd9d117 P 243e9aadc9a5494fa5c49ad9050297e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c90a6832042427d895ba4af46755543" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 33327 } } peers { permanent_uuid: "4330d5ecb7e44e15b7d3e55c671748d3" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 35565 } } peers { permanent_uuid: "243e9aadc9a5494fa5c49ad9050297e0" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 41863 } }
I20260812 00:01:49.561167 16118 raft_consensus.cc:374] T 71f9cbf54c764f95a992c2700cd9d117 P 243e9aadc9a5494fa5c49ad9050297e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:01:49.561192 16118 raft_consensus.cc:729] T 71f9cbf54c764f95a992c2700cd9d117 P 243e9aadc9a5494fa5c49ad9050297e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 243e9aadc9a5494fa5c49ad9050297e0, State: Initialized, Role: FOLLOWER
I20260812 00:01:49.561208 16119 tablet_bootstrap.cc:492] T 71f9cbf54c764f95a992c2700cd9d117 P 4330d5ecb7e44e15b7d3e55c671748d3: No bootstrap required, opened a new log
I20260812 00:01:49.561231 16118 consensus_queue.cc:260] T 71f9cbf54c764f95a992c2700cd9d117 P 243e9aadc9a5494fa5c49ad9050297e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c90a6832042427d895ba4af46755543" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 33327 } } peers { permanent_uuid: "4330d5ecb7e44e15b7d3e55c671748d3" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 35565 } } peers { permanent_uuid: "243e9aadc9a5494fa5c49ad9050297e0" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 41863 } }
I20260812 00:01:49.561271 16119 ts_tablet_manager.cc:1397] T 71f9cbf54c764f95a992c2700cd9d117 P 4330d5ecb7e44e15b7d3e55c671748d3: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 00:01:49.561332 16118 ts_tablet_manager.cc:1428] T 71f9cbf54c764f95a992c2700cd9d117 P 243e9aadc9a5494fa5c49ad9050297e0: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:49.561368 16130 tablet_replica.cc:439] T 71f9cbf54c764f95a992c2700cd9d117 P 243e9aadc9a5494fa5c49ad9050297e0: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c90a6832042427d895ba4af46755543" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 33327 } } peers { permanent_uuid: "4330d5ecb7e44e15b7d3e55c671748d3" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 35565 } } peers { permanent_uuid: "243e9aadc9a5494fa5c49ad9050297e0" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 41863 } } }
I20260812 00:01:49.561439 16119 raft_consensus.cc:348] T 71f9cbf54c764f95a992c2700cd9d117 P 4330d5ecb7e44e15b7d3e55c671748d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c90a6832042427d895ba4af46755543" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 33327 } } peers { permanent_uuid: "4330d5ecb7e44e15b7d3e55c671748d3" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 35565 } } peers { permanent_uuid: "243e9aadc9a5494fa5c49ad9050297e0" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 41863 } }
I20260812 00:01:49.561481 16130 tablet_replica.cc:442] T 71f9cbf54c764f95a992c2700cd9d117 P 243e9aadc9a5494fa5c49ad9050297e0: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:01:49.561502 16119 raft_consensus.cc:374] T 71f9cbf54c764f95a992c2700cd9d117 P 4330d5ecb7e44e15b7d3e55c671748d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:01:49.561523 16119 raft_consensus.cc:729] T 71f9cbf54c764f95a992c2700cd9d117 P 4330d5ecb7e44e15b7d3e55c671748d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4330d5ecb7e44e15b7d3e55c671748d3, State: Initialized, Role: FOLLOWER
I20260812 00:01:49.561573 16119 consensus_queue.cc:260] T 71f9cbf54c764f95a992c2700cd9d117 P 4330d5ecb7e44e15b7d3e55c671748d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c90a6832042427d895ba4af46755543" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 33327 } } peers { permanent_uuid: "4330d5ecb7e44e15b7d3e55c671748d3" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 35565 } } peers { permanent_uuid: "243e9aadc9a5494fa5c49ad9050297e0" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 41863 } }
I20260812 00:01:49.561656 16119 ts_tablet_manager.cc:1428] T 71f9cbf54c764f95a992c2700cd9d117 P 4330d5ecb7e44e15b7d3e55c671748d3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:49.561748 16128 tablet_replica.cc:439] T 71f9cbf54c764f95a992c2700cd9d117 P 4330d5ecb7e44e15b7d3e55c671748d3: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c90a6832042427d895ba4af46755543" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 33327 } } peers { permanent_uuid: "4330d5ecb7e44e15b7d3e55c671748d3" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 35565 } } peers { permanent_uuid: "243e9aadc9a5494fa5c49ad9050297e0" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 41863 } } }
I20260812 00:01:49.561864 16128 tablet_replica.cc:442] T 71f9cbf54c764f95a992c2700cd9d117 P 4330d5ecb7e44e15b7d3e55c671748d3: This TxnStatusTablet replica's current role is: FOLLOWER
W20260812 00:01:49.615347 16081 tablet.cc:2369] T 54055ba0f7b54b26bf3da677ce960879 P 243e9aadc9a5494fa5c49ad9050297e0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:01:49.728705 16129 raft_consensus.cc:482] T 71f9cbf54c764f95a992c2700cd9d117 P 0c90a6832042427d895ba4af46755543 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:01:49.728816 16129 raft_consensus.cc:504] T 71f9cbf54c764f95a992c2700cd9d117 P 0c90a6832042427d895ba4af46755543 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c90a6832042427d895ba4af46755543" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 33327 } } peers { permanent_uuid: "4330d5ecb7e44e15b7d3e55c671748d3" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 35565 } } peers { permanent_uuid: "243e9aadc9a5494fa5c49ad9050297e0" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 41863 } }
I20260812 00:01:49.729166 16129 leader_election.cc:288] T 71f9cbf54c764f95a992c2700cd9d117 P 0c90a6832042427d895ba4af46755543 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4330d5ecb7e44e15b7d3e55c671748d3 (127.11.206.66:35565), 243e9aadc9a5494fa5c49ad9050297e0 (127.11.206.67:41863)
I20260812 00:01:49.733048 16114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:49.729434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.65:56317 (local address 127.11.206.66:35565)
0812 00:01:49.729496 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:49.729498 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:49.729596 (+ 98us) server_negotiation.cc:407] Connection header received
0812 00:01:49.729712 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:49.729713 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:49.729724 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:49.729788 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:01:49.729924 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:49.730690 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:49.732125 (+ 1435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:49.732696 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:49.732760 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:49.732769 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:49.732938 (+ 169us) server_negotiation.cc:299] Negotiation successful
0812 00:01:49.732974 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260812 00:01:49.733048 16108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:49.729638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.65:55269 (local address 127.11.206.67:41863)
0812 00:01:49.729689 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:49.729691 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:49.729702 (+ 11us) server_negotiation.cc:407] Connection header received
0812 00:01:49.729764 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:49.729765 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:49.729773 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:49.729823 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:01:49.729937 (+ 114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:49.730679 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:49.732126 (+ 1447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:49.732684 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:49.732760 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:49.732769 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:49.732935 (+ 166us) server_negotiation.cc:299] Negotiation successful
0812 00:01:49.732974 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260812 00:01:49.733080 16151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:49.729348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.66:35565 (local address 127.11.206.65:56317)
0812 00:01:49.729500 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0812 00:01:49.729511 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:01:49.729606 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:01:49.729798 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:01:49.729799 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:01:49.729801 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:01:49.729865 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:49.729867 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:49.730764 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:49.730765 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:49.732036 (+ 1271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:49.732041 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:49.732771 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:49.732772 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:49.732860 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:49.732865 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 00:01:49.732924 (+ 59us) client_negotiation.cc:240] Negotiation successful
0812 00:01:49.732987 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"mutex_wait_us":44,"thread_start_us":89,"threads_started":1}
I20260812 00:01:49.733103 16154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:49.729556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.67:41863 (local address 127.11.206.65:55269)
0812 00:01:49.729656 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0812 00:01:49.729665 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:01:49.729709 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:01:49.729829 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:01:49.729830 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:01:49.729832 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:01:49.729881 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:49.729882 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:49.730764 (+ 882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:49.730765 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:49.732045 (+ 1280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:49.732047 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:49.732773 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:49.732773 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:49.732860 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:49.732867 (+ 7us) client_negotiation.cc:769] Sending connection context
0812 00:01:49.732924 (+ 57us) client_negotiation.cc:240] Negotiation successful
0812 00:01:49.732987 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":86,"mutex_wait_us":83,"thread_start_us":46,"threads_started":1}
I20260812 00:01:49.733417 15785 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71f9cbf54c764f95a992c2700cd9d117" candidate_uuid: "0c90a6832042427d895ba4af46755543" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4330d5ecb7e44e15b7d3e55c671748d3" is_pre_election: true
I20260812 00:01:49.733521 15785 raft_consensus.cc:2454] T 71f9cbf54c764f95a992c2700cd9d117 P 4330d5ecb7e44e15b7d3e55c671748d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c90a6832042427d895ba4af46755543 in term 0.
I20260812 00:01:49.733510 16013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71f9cbf54c764f95a992c2700cd9d117" candidate_uuid: "0c90a6832042427d895ba4af46755543" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "243e9aadc9a5494fa5c49ad9050297e0" is_pre_election: true
I20260812 00:01:49.733671 16013 raft_consensus.cc:2454] T 71f9cbf54c764f95a992c2700cd9d117 P 243e9aadc9a5494fa5c49ad9050297e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c90a6832042427d895ba4af46755543 in term 0.
I20260812 00:01:49.733726 15427 leader_election.cc:302] T 71f9cbf54c764f95a992c2700cd9d117 P 0c90a6832042427d895ba4af46755543 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c90a6832042427d895ba4af46755543, 4330d5ecb7e44e15b7d3e55c671748d3; no voters:
I20260812 00:01:49.733892 16129 raft_consensus.cc:2781] T 71f9cbf54c764f95a992c2700cd9d117 P 0c90a6832042427d895ba4af46755543 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:01:49.733934 16129 raft_consensus.cc:482] T 71f9cbf54c764f95a992c2700cd9d117 P 0c90a6832042427d895ba4af46755543 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:01:49.733955 16129 raft_consensus.cc:3037] T 71f9cbf54c764f95a992c2700cd9d117 P 0c90a6832042427d895ba4af46755543 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:01:49.734668 16129 raft_consensus.cc:504] T 71f9cbf54c764f95a992c2700cd9d117 P 0c90a6832042427d895ba4af46755543 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c90a6832042427d895ba4af46755543" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 33327 } } peers { permanent_uuid: "4330d5ecb7e44e15b7d3e55c671748d3" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 35565 } } peers { permanent_uuid: "243e9aadc9a5494fa5c49ad9050297e0" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 41863 } }
I20260812 00:01:49.734791 16129 leader_election.cc:288] T 71f9cbf54c764f95a992c2700cd9d117 P 0c90a6832042427d895ba4af46755543 [CANDIDATE]: Term 1 election: Requested vote from peers 4330d5ecb7e44e15b7d3e55c671748d3 (127.11.206.66:35565), 243e9aadc9a5494fa5c49ad9050297e0 (127.11.206.67:41863)
I20260812 00:01:49.734980 15785 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71f9cbf54c764f95a992c2700cd9d117" candidate_uuid: "0c90a6832042427d895ba4af46755543" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4330d5ecb7e44e15b7d3e55c671748d3"
I20260812 00:01:49.735000 16013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71f9cbf54c764f95a992c2700cd9d117" candidate_uuid: "0c90a6832042427d895ba4af46755543" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "243e9aadc9a5494fa5c49ad9050297e0"
I20260812 00:01:49.735070 16013 raft_consensus.cc:3037] T 71f9cbf54c764f95a992c2700cd9d117 P 243e9aadc9a5494fa5c49ad9050297e0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:01:49.735095 15785 raft_consensus.cc:3037] T 71f9cbf54c764f95a992c2700cd9d117 P 4330d5ecb7e44e15b7d3e55c671748d3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:01:49.735713 16013 raft_consensus.cc:2454] T 71f9cbf54c764f95a992c2700cd9d117 P 243e9aadc9a5494fa5c49ad9050297e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c90a6832042427d895ba4af46755543 in term 1.
I20260812 00:01:49.735715 15785 raft_consensus.cc:2454] T 71f9cbf54c764f95a992c2700cd9d117 P 4330d5ecb7e44e15b7d3e55c671748d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c90a6832042427d895ba4af46755543 in term 1.
I20260812 00:01:49.735868 15427 leader_election.cc:302] T 71f9cbf54c764f95a992c2700cd9d117 P 0c90a6832042427d895ba4af46755543 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c90a6832042427d895ba4af46755543, 243e9aadc9a5494fa5c49ad9050297e0; no voters:
I20260812 00:01:49.735951 16129 raft_consensus.cc:2781] T 71f9cbf54c764f95a992c2700cd9d117 P 0c90a6832042427d895ba4af46755543 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:01:49.736074 16129 raft_consensus.cc:686] T 71f9cbf54c764f95a992c2700cd9d117 P 0c90a6832042427d895ba4af46755543 [term 1 LEADER]: Becoming Leader. State: Replica: 0c90a6832042427d895ba4af46755543, State: Running, Role: LEADER
I20260812 00:01:49.736176 16129 consensus_queue.cc:237] T 71f9cbf54c764f95a992c2700cd9d117 P 0c90a6832042427d895ba4af46755543 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c90a6832042427d895ba4af46755543" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 33327 } } peers { permanent_uuid: "4330d5ecb7e44e15b7d3e55c671748d3" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 35565 } } peers { permanent_uuid: "243e9aadc9a5494fa5c49ad9050297e0" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 41863 } }
I20260812 00:01:49.736629 16155 tablet_replica.cc:439] T 71f9cbf54c764f95a992c2700cd9d117 P 0c90a6832042427d895ba4af46755543: TxnStatusTablet state changed. Reason: New leader 0c90a6832042427d895ba4af46755543. Latest consensus state: current_term: 1 leader_uuid: "0c90a6832042427d895ba4af46755543" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c90a6832042427d895ba4af46755543" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 33327 } } peers { permanent_uuid: "4330d5ecb7e44e15b7d3e55c671748d3" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 35565 } } peers { permanent_uuid: "243e9aadc9a5494fa5c49ad9050297e0" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 41863 } } }
I20260812 00:01:49.736708 16155 tablet_replica.cc:442] T 71f9cbf54c764f95a992c2700cd9d117 P 0c90a6832042427d895ba4af46755543: This TxnStatusTablet replica's current role is: LEADER
I20260812 00:01:49.736898 16158 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260812 00:01:49.737023 16158 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260812 00:01:49.737002 15287 catalog_manager.cc:5495] T 71f9cbf54c764f95a992c2700cd9d117 P 0c90a6832042427d895ba4af46755543 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c90a6832042427d895ba4af46755543 (127.11.206.65). New cstate: current_term: 1 leader_uuid: "0c90a6832042427d895ba4af46755543" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c90a6832042427d895ba4af46755543" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 33327 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4330d5ecb7e44e15b7d3e55c671748d3" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 35565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "243e9aadc9a5494fa5c49ad9050297e0" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 41863 } health_report { overall_health: UNKNOWN } } }
I20260812 00:01:49.743746 16112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:49.741134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45696 (local address 127.11.206.65:33327)
0812 00:01:49.741172 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:49.741174 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:49.741182 (+ 8us) server_negotiation.cc:407] Connection header received
0812 00:01:49.741277 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:49.741278 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:49.741292 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:49.741343 (+ 51us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:01:49.741485 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:49.742000 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:49.743041 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:49.743246 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:49.743296 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:49.743476 (+ 180us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:01:49.743567 (+ 91us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:01:49.743618 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:49.743678 (+ 60us) server_negotiation.cc:299] Negotiation successful
0812 00:01:49.743695 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 00:01:49.743813 16144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:49.741058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.65:33327 (local address 127.0.0.1:45696)
0812 00:01:49.741128 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0812 00:01:49.741141 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 00:01:49.741194 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:01:49.741350 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:01:49.741351 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:01:49.741353 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 00:01:49.741425 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:49.741428 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:49.742075 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:49.742076 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:49.742965 (+ 889us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:49.742969 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:49.743310 (+ 341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:49.743311 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:49.743381 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:49.743398 (+ 17us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 00:01:49.743619 (+ 221us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 00:01:49.743625 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 00:01:49.743675 (+ 50us) client_negotiation.cc:240] Negotiation successful
0812 00:01:49.743735 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
I20260812 00:01:49.745893 15785 raft_consensus.cc:1261] T 71f9cbf54c764f95a992c2700cd9d117 P 4330d5ecb7e44e15b7d3e55c671748d3 [term 1 FOLLOWER]: Refusing update from remote peer 0c90a6832042427d895ba4af46755543: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:01:49.746214 16013 raft_consensus.cc:1261] T 71f9cbf54c764f95a992c2700cd9d117 P 243e9aadc9a5494fa5c49ad9050297e0 [term 1 FOLLOWER]: Refusing update from remote peer 0c90a6832042427d895ba4af46755543: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:01:49.746188 16155 consensus_queue.cc:1035] T 71f9cbf54c764f95a992c2700cd9d117 P 0c90a6832042427d895ba4af46755543 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4330d5ecb7e44e15b7d3e55c671748d3" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 35565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:01:49.746429 16129 consensus_queue.cc:1035] T 71f9cbf54c764f95a992c2700cd9d117 P 0c90a6832042427d895ba4af46755543 [LEADER]: Connected to new peer: Peer: permanent_uuid: "243e9aadc9a5494fa5c49ad9050297e0" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 41863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:01:49.747380 16128 tablet_replica.cc:439] T 71f9cbf54c764f95a992c2700cd9d117 P 4330d5ecb7e44e15b7d3e55c671748d3: TxnStatusTablet state changed. Reason: New leader 0c90a6832042427d895ba4af46755543. Latest consensus state: current_term: 1 leader_uuid: "0c90a6832042427d895ba4af46755543" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c90a6832042427d895ba4af46755543" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 33327 } } peers { permanent_uuid: "4330d5ecb7e44e15b7d3e55c671748d3" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 35565 } } peers { permanent_uuid: "243e9aadc9a5494fa5c49ad9050297e0" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 41863 } } }
I20260812 00:01:49.747478 16128 tablet_replica.cc:442] T 71f9cbf54c764f95a992c2700cd9d117 P 4330d5ecb7e44e15b7d3e55c671748d3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:01:49.747579 16130 tablet_replica.cc:439] T 71f9cbf54c764f95a992c2700cd9d117 P 243e9aadc9a5494fa5c49ad9050297e0: TxnStatusTablet state changed. Reason: New leader 0c90a6832042427d895ba4af46755543. Latest consensus state: current_term: 1 leader_uuid: "0c90a6832042427d895ba4af46755543" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c90a6832042427d895ba4af46755543" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 33327 } } peers { permanent_uuid: "4330d5ecb7e44e15b7d3e55c671748d3" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 35565 } } peers { permanent_uuid: "243e9aadc9a5494fa5c49ad9050297e0" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 41863 } } }
I20260812 00:01:49.747673 16130 tablet_replica.cc:442] T 71f9cbf54c764f95a992c2700cd9d117 P 243e9aadc9a5494fa5c49ad9050297e0: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:01:49.748461 16129 tablet_replica.cc:439] T 71f9cbf54c764f95a992c2700cd9d117 P 0c90a6832042427d895ba4af46755543: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0c90a6832042427d895ba4af46755543" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c90a6832042427d895ba4af46755543" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 33327 } } peers { permanent_uuid: "4330d5ecb7e44e15b7d3e55c671748d3" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 35565 } } peers { permanent_uuid: "243e9aadc9a5494fa5c49ad9050297e0" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 41863 } } }
I20260812 00:01:49.748544 16129 tablet_replica.cc:442] T 71f9cbf54c764f95a992c2700cd9d117 P 0c90a6832042427d895ba4af46755543: This TxnStatusTablet replica's current role is: LEADER
I20260812 00:01:49.748982 16128 tablet_replica.cc:439] T 71f9cbf54c764f95a992c2700cd9d117 P 4330d5ecb7e44e15b7d3e55c671748d3: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0c90a6832042427d895ba4af46755543" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c90a6832042427d895ba4af46755543" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 33327 } } peers { permanent_uuid: "4330d5ecb7e44e15b7d3e55c671748d3" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 35565 } } peers { permanent_uuid: "243e9aadc9a5494fa5c49ad9050297e0" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 41863 } } }
I20260812 00:01:49.749073 16128 tablet_replica.cc:442] T 71f9cbf54c764f95a992c2700cd9d117 P 4330d5ecb7e44e15b7d3e55c671748d3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:01:49.749703 16155 tablet_replica.cc:439] T 71f9cbf54c764f95a992c2700cd9d117 P 0c90a6832042427d895ba4af46755543: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0c90a6832042427d895ba4af46755543" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c90a6832042427d895ba4af46755543" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 33327 } } peers { permanent_uuid: "4330d5ecb7e44e15b7d3e55c671748d3" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 35565 } } peers { permanent_uuid: "243e9aadc9a5494fa5c49ad9050297e0" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 41863 } } }
I20260812 00:01:49.749778 16155 tablet_replica.cc:442] T 71f9cbf54c764f95a992c2700cd9d117 P 0c90a6832042427d895ba4af46755543: This TxnStatusTablet replica's current role is: LEADER
I20260812 00:01:49.750181 16168 mvcc.cc:205] Tried to move back new op lower bound from 7317474958316679168 to 7317474958280011776. Current Snapshot: MvccSnapshot[applied={T|T < 7317474958316679168}]
I20260812 00:01:49.750284 16170 mvcc.cc:205] Tried to move back new op lower bound from 7317474958316679168 to 7317474958280011776. Current Snapshot: MvccSnapshot[applied={T|T < 7317474958316679168}]
I20260812 00:01:49.750350 16130 tablet_replica.cc:439] T 71f9cbf54c764f95a992c2700cd9d117 P 243e9aadc9a5494fa5c49ad9050297e0: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0c90a6832042427d895ba4af46755543" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c90a6832042427d895ba4af46755543" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 33327 } } peers { permanent_uuid: "4330d5ecb7e44e15b7d3e55c671748d3" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 35565 } } peers { permanent_uuid: "243e9aadc9a5494fa5c49ad9050297e0" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 41863 } } }
I20260812 00:01:49.750921 16130 tablet_replica.cc:442] T 71f9cbf54c764f95a992c2700cd9d117 P 243e9aadc9a5494fa5c49ad9050297e0: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:01:49.753458 16108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:49.751177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43690 (local address 127.11.206.67:41863)
0812 00:01:49.751213 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:49.751215 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:49.751228 (+ 13us) server_negotiation.cc:407] Connection header received
0812 00:01:49.751309 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:49.751310 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:49.751324 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:49.751385 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:01:49.751519 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:49.752013 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:49.752737 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:49.752936 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:49.752987 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:49.753146 (+ 159us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:01:49.753244 (+ 98us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:01:49.753307 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:49.753352 (+ 45us) server_negotiation.cc:299] Negotiation successful
0812 00:01:49.753395 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 00:01:49.758102 16112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:49.755790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.67:34021 (local address 127.11.206.65:33327)
0812 00:01:49.755834 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:49.755836 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:49.755844 (+ 8us) server_negotiation.cc:407] Connection header received
0812 00:01:49.755889 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:49.755890 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:49.755898 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:49.755935 (+ 37us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:01:49.756046 (+ 111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:49.756468 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:49.757534 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:49.757717 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:49.757765 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:49.757932 (+ 167us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:01:49.757953 (+ 21us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:01:49.757983 (+ 30us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:49.758038 (+ 55us) server_negotiation.cc:299] Negotiation successful
0812 00:01:49.758052 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 00:01:49.758157 16091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:49.755725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.65:33327 (local address 127.11.206.67:34021)
0812 00:01:49.755787 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0812 00:01:49.755798 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:01:49.755841 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:01:49.755947 (+ 106us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:01:49.755947 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:01:49.755948 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 00:01:49.756001 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:49.756003 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:49.756523 (+ 520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:49.756523 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:49.757466 (+ 943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:49.757469 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:49.757774 (+ 305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:49.757775 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:49.757838 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:49.757852 (+ 14us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 00:01:49.757988 (+ 136us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 00:01:49.757989 (+ 1us) client_negotiation.cc:769] Sending connection context
0812 00:01:49.758036 (+ 47us) client_negotiation.cc:240] Negotiation successful
0812 00:01:49.758085 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260812 00:01:49.760254 15785 raft_consensus.cc:1261] T 54055ba0f7b54b26bf3da677ce960879 P 4330d5ecb7e44e15b7d3e55c671748d3 [term 1 FOLLOWER]: Refusing update from remote peer 243e9aadc9a5494fa5c49ad9050297e0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:01:49.760267 15536 raft_consensus.cc:1261] T 54055ba0f7b54b26bf3da677ce960879 P 0c90a6832042427d895ba4af46755543 [term 1 FOLLOWER]: Refusing update from remote peer 243e9aadc9a5494fa5c49ad9050297e0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:01:49.760589 16135 consensus_queue.cc:1035] T 54055ba0f7b54b26bf3da677ce960879 P 243e9aadc9a5494fa5c49ad9050297e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4330d5ecb7e44e15b7d3e55c671748d3" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 35565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:01:49.760761 16130 consensus_queue.cc:1035] T 54055ba0f7b54b26bf3da677ce960879 P 243e9aadc9a5494fa5c49ad9050297e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c90a6832042427d895ba4af46755543" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 33327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:01:49.763876 16166 mvcc.cc:205] Tried to move back new op lower bound from 7317474958376214528 to 7317474957290528768. Current Snapshot: MvccSnapshot[applied={T|T < 7317474958376214528}]
I20260812 00:01:49.768424 16108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:49.766068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.65:49433 (local address 127.11.206.67:41863)
0812 00:01:49.766102 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:49.766104 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:49.766229 (+ 125us) server_negotiation.cc:407] Connection header received
0812 00:01:49.766304 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:49.766305 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:49.766314 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:49.766358 (+ 44us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:01:49.766475 (+ 117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:49.766930 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:49.767702 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:49.767952 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:49.768013 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:49.768248 (+ 235us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:01:49.768273 (+ 25us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:01:49.768309 (+ 36us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:49.768361 (+ 52us) server_negotiation.cc:299] Negotiation successful
0812 00:01:49.768377 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260812 00:01:49.768496 16197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:49.765962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.67:41863 (local address 127.11.206.65:49433)
0812 00:01:49.766164 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0812 00:01:49.766175 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:01:49.766254 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:01:49.766362 (+ 108us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:01:49.766362 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:01:49.766363 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 00:01:49.766424 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:49.766425 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:49.766995 (+ 570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:49.766996 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:49.767639 (+ 643us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:49.767641 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:49.768071 (+ 430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:49.768072 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:49.768148 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:49.768170 (+ 22us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 00:01:49.768311 (+ 141us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 00:01:49.768313 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 00:01:49.768360 (+ 47us) client_negotiation.cc:240] Negotiation successful
0812 00:01:49.768401 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":83,"threads_started":1}
I20260812 00:01:49.774969 15292 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46686:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:01:49.775084 15292 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46686:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:01:49.776392 15292 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 86fa27d7db434987b0eecd62069fcf05: Sending DeleteTablet for 3 replicas of tablet 54055ba0f7b54b26bf3da677ce960879
I20260812 00:01:49.776818 15977 tablet_service.cc:1514] Processing DeleteTablet for tablet 54055ba0f7b54b26bf3da677ce960879 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:01:49 UTC) from {username='kudu', principal='kudu/127.11.206.126@KRBTEST.COM'} at 127.0.0.1:43678
I20260812 00:01:49.776819 15756 tablet_service.cc:1514] Processing DeleteTablet for tablet 54055ba0f7b54b26bf3da677ce960879 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:01:49 UTC) from {username='kudu', principal='kudu/127.11.206.126@KRBTEST.COM'} at 127.0.0.1:38606
I20260812 00:01:49.776849 15499 tablet_service.cc:1514] Processing DeleteTablet for tablet 54055ba0f7b54b26bf3da677ce960879 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:01:49 UTC) from {username='kudu', principal='kudu/127.11.206.126@KRBTEST.COM'} at 127.0.0.1:45684
I20260812 00:01:49.777176 15292 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46686:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:01:49.777331 15292 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:01:49.777568 16204 tablet_replica.cc:330] T 54055ba0f7b54b26bf3da677ce960879 P 0c90a6832042427d895ba4af46755543: stopping tablet replica
I20260812 00:01:49.777678 16204 raft_consensus.cc:2229] T 54055ba0f7b54b26bf3da677ce960879 P 0c90a6832042427d895ba4af46755543 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:01:49.777729 16204 raft_consensus.cc:2258] T 54055ba0f7b54b26bf3da677ce960879 P 0c90a6832042427d895ba4af46755543 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:01:49.777946 16202 tablet_replica.cc:330] T 54055ba0f7b54b26bf3da677ce960879 P 4330d5ecb7e44e15b7d3e55c671748d3: stopping tablet replica
I20260812 00:01:49.778041 16202 raft_consensus.cc:2229] T 54055ba0f7b54b26bf3da677ce960879 P 4330d5ecb7e44e15b7d3e55c671748d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:01:49.778105 16202 raft_consensus.cc:2258] T 54055ba0f7b54b26bf3da677ce960879 P 4330d5ecb7e44e15b7d3e55c671748d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:01:49.778247 16203 tablet_replica.cc:330] T 54055ba0f7b54b26bf3da677ce960879 P 243e9aadc9a5494fa5c49ad9050297e0: stopping tablet replica
I20260812 00:01:49.778328 16203 raft_consensus.cc:2229] T 54055ba0f7b54b26bf3da677ce960879 P 243e9aadc9a5494fa5c49ad9050297e0 [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:01:49.778407 16203 raft_consensus.cc:2258] T 54055ba0f7b54b26bf3da677ce960879 P 243e9aadc9a5494fa5c49ad9050297e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:01:49.778893 15499 tablet_service.cc:1467] Processing CreateTablet for tablet eb1d7b3fc2724b7abbb3688c9fedcfbf (DEFAULT_TABLE table=test-table [id=67ef7fdce23c484ebd08201542cf4662]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:01:49.779014 15499 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb1d7b3fc2724b7abbb3688c9fedcfbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:01:49.779066 16203 ts_tablet_manager.cc:1905] T 54055ba0f7b54b26bf3da677ce960879 P 243e9aadc9a5494fa5c49ad9050297e0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:01:49.780330 16115 tablet_bootstrap.cc:492] T eb1d7b3fc2724b7abbb3688c9fedcfbf P 0c90a6832042427d895ba4af46755543: Bootstrap starting.
I20260812 00:01:49.780730 16203 ts_tablet_manager.cc:1918] T 54055ba0f7b54b26bf3da677ce960879 P 243e9aadc9a5494fa5c49ad9050297e0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 00:01:49.780793 16203 log.cc:1196] T 54055ba0f7b54b26bf3da677ce960879 P 243e9aadc9a5494fa5c49ad9050297e0: Deleting WAL directory at /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/minicluster-data/ts-2/wal/wals/54055ba0f7b54b26bf3da677ce960879
I20260812 00:01:49.780843 16115 tablet_bootstrap.cc:654] T eb1d7b3fc2724b7abbb3688c9fedcfbf P 0c90a6832042427d895ba4af46755543: Neither blocks nor log segments found. Creating new log.
I20260812 00:01:49.781061 16203 ts_tablet_manager.cc:1939] T 54055ba0f7b54b26bf3da677ce960879 P 243e9aadc9a5494fa5c49ad9050297e0: Deleting consensus metadata
I20260812 00:01:49.781437 15756 tablet_service.cc:1467] Processing CreateTablet for tablet eb1d7b3fc2724b7abbb3688c9fedcfbf (DEFAULT_TABLE table=test-table [id=67ef7fdce23c484ebd08201542cf4662]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:01:49.781446 15264 catalog_manager.cc:4841] TS 243e9aadc9a5494fa5c49ad9050297e0 (127.11.206.67:41863): tablet 54055ba0f7b54b26bf3da677ce960879 (table test-table [id=250b69934db44214ad0441e49e91cbf5]) successfully deleted
I20260812 00:01:49.781541 15756 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb1d7b3fc2724b7abbb3688c9fedcfbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:01:49.781790 16202 ts_tablet_manager.cc:1905] T 54055ba0f7b54b26bf3da677ce960879 P 4330d5ecb7e44e15b7d3e55c671748d3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:01:49.782807 16119 tablet_bootstrap.cc:492] T eb1d7b3fc2724b7abbb3688c9fedcfbf P 4330d5ecb7e44e15b7d3e55c671748d3: Bootstrap starting.
I20260812 00:01:49.783190 16119 tablet_bootstrap.cc:654] T eb1d7b3fc2724b7abbb3688c9fedcfbf P 4330d5ecb7e44e15b7d3e55c671748d3: Neither blocks nor log segments found. Creating new log.
I20260812 00:01:49.783288 15977 tablet_service.cc:1467] Processing CreateTablet for tablet eb1d7b3fc2724b7abbb3688c9fedcfbf (DEFAULT_TABLE table=test-table [id=67ef7fdce23c484ebd08201542cf4662]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:01:49.783387 15977 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb1d7b3fc2724b7abbb3688c9fedcfbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:01:49.784147 16202 ts_tablet_manager.cc:1918] T 54055ba0f7b54b26bf3da677ce960879 P 4330d5ecb7e44e15b7d3e55c671748d3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 00:01:49.784206 16202 log.cc:1196] T 54055ba0f7b54b26bf3da677ce960879 P 4330d5ecb7e44e15b7d3e55c671748d3: Deleting WAL directory at /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/minicluster-data/ts-1/wal/wals/54055ba0f7b54b26bf3da677ce960879
I20260812 00:01:49.784439 16202 ts_tablet_manager.cc:1939] T 54055ba0f7b54b26bf3da677ce960879 P 4330d5ecb7e44e15b7d3e55c671748d3: Deleting consensus metadata
I20260812 00:01:49.784538 16118 tablet_bootstrap.cc:492] T eb1d7b3fc2724b7abbb3688c9fedcfbf P 243e9aadc9a5494fa5c49ad9050297e0: Bootstrap starting.
I20260812 00:01:49.784797 15264 catalog_manager.cc:4841] TS 4330d5ecb7e44e15b7d3e55c671748d3 (127.11.206.66:35565): tablet 54055ba0f7b54b26bf3da677ce960879 (table test-table [id=250b69934db44214ad0441e49e91cbf5]) successfully deleted
I20260812 00:01:49.784940 16118 tablet_bootstrap.cc:654] T eb1d7b3fc2724b7abbb3688c9fedcfbf P 243e9aadc9a5494fa5c49ad9050297e0: Neither blocks nor log segments found. Creating new log.
I20260812 00:01:49.785264 16119 tablet_bootstrap.cc:492] T eb1d7b3fc2724b7abbb3688c9fedcfbf P 4330d5ecb7e44e15b7d3e55c671748d3: No bootstrap required, opened a new log
I20260812 00:01:49.785310 16119 ts_tablet_manager.cc:1397] T eb1d7b3fc2724b7abbb3688c9fedcfbf P 4330d5ecb7e44e15b7d3e55c671748d3: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260812 00:01:49.785458 16119 raft_consensus.cc:348] T eb1d7b3fc2724b7abbb3688c9fedcfbf P 4330d5ecb7e44e15b7d3e55c671748d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c90a6832042427d895ba4af46755543" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 33327 } } peers { permanent_uuid: "4330d5ecb7e44e15b7d3e55c671748d3" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 35565 } } peers { permanent_uuid: "243e9aadc9a5494fa5c49ad9050297e0" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 41863 } }
I20260812 00:01:49.785521 16119 raft_consensus.cc:374] T eb1d7b3fc2724b7abbb3688c9fedcfbf P 4330d5ecb7e44e15b7d3e55c671748d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:01:49.785540 16119 raft_consensus.cc:729] T eb1d7b3fc2724b7abbb3688c9fedcfbf P 4330d5ecb7e44e15b7d3e55c671748d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4330d5ecb7e44e15b7d3e55c671748d3, State: Initialized, Role: FOLLOWER
I20260812 00:01:49.785580 16119 consensus_queue.cc:260] T eb1d7b3fc2724b7abbb3688c9fedcfbf P 4330d5ecb7e44e15b7d3e55c671748d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c90a6832042427d895ba4af46755543" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 33327 } } peers { permanent_uuid: "4330d5ecb7e44e15b7d3e55c671748d3" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 35565 } } peers { permanent_uuid: "243e9aadc9a5494fa5c49ad9050297e0" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 41863 } }
I20260812 00:01:49.785655 16119 ts_tablet_manager.cc:1428] T eb1d7b3fc2724b7abbb3688c9fedcfbf P 4330d5ecb7e44e15b7d3e55c671748d3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:49.785751 16115 tablet_bootstrap.cc:492] T eb1d7b3fc2724b7abbb3688c9fedcfbf P 0c90a6832042427d895ba4af46755543: No bootstrap required, opened a new log
I20260812 00:01:49.785792 16115 ts_tablet_manager.cc:1397] T eb1d7b3fc2724b7abbb3688c9fedcfbf P 0c90a6832042427d895ba4af46755543: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260812 00:01:49.785933 16115 raft_consensus.cc:348] T eb1d7b3fc2724b7abbb3688c9fedcfbf P 0c90a6832042427d895ba4af46755543 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c90a6832042427d895ba4af46755543" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 33327 } } peers { permanent_uuid: "4330d5ecb7e44e15b7d3e55c671748d3" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 35565 } } peers { permanent_uuid: "243e9aadc9a5494fa5c49ad9050297e0" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 41863 } }
I20260812 00:01:49.785992 16115 raft_consensus.cc:374] T eb1d7b3fc2724b7abbb3688c9fedcfbf P 0c90a6832042427d895ba4af46755543 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:01:49.786011 16115 raft_consensus.cc:729] T eb1d7b3fc2724b7abbb3688c9fedcfbf P 0c90a6832042427d895ba4af46755543 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c90a6832042427d895ba4af46755543, State: Initialized, Role: FOLLOWER
I20260812 00:01:49.786072 16115 consensus_queue.cc:260] T eb1d7b3fc2724b7abbb3688c9fedcfbf P 0c90a6832042427d895ba4af46755543 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c90a6832042427d895ba4af46755543" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 33327 } } peers { permanent_uuid: "4330d5ecb7e44e15b7d3e55c671748d3" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 35565 } } peers { permanent_uuid: "243e9aadc9a5494fa5c49ad9050297e0" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 41863 } }
I20260812 00:01:49.786154 16115 ts_tablet_manager.cc:1428] T eb1d7b3fc2724b7abbb3688c9fedcfbf P 0c90a6832042427d895ba4af46755543: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260812 00:01:49.786825 16204 ts_tablet_manager.cc:1905] T 54055ba0f7b54b26bf3da677ce960879 P 0c90a6832042427d895ba4af46755543: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:01:49.788334 16204 ts_tablet_manager.cc:1918] T 54055ba0f7b54b26bf3da677ce960879 P 0c90a6832042427d895ba4af46755543: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 00:01:49.788404 16204 log.cc:1196] T 54055ba0f7b54b26bf3da677ce960879 P 0c90a6832042427d895ba4af46755543: Deleting WAL directory at /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/minicluster-data/ts-0/wal/wals/54055ba0f7b54b26bf3da677ce960879
I20260812 00:01:49.789136 16204 ts_tablet_manager.cc:1939] T 54055ba0f7b54b26bf3da677ce960879 P 0c90a6832042427d895ba4af46755543: Deleting consensus metadata
I20260812 00:01:49.789588 15263 catalog_manager.cc:4841] TS 0c90a6832042427d895ba4af46755543 (127.11.206.65:33327): tablet 54055ba0f7b54b26bf3da677ce960879 (table test-table [id=250b69934db44214ad0441e49e91cbf5]) successfully deleted
I20260812 00:01:49.789726 16118 tablet_bootstrap.cc:492] T eb1d7b3fc2724b7abbb3688c9fedcfbf P 243e9aadc9a5494fa5c49ad9050297e0: No bootstrap required, opened a new log
I20260812 00:01:49.789793 16118 ts_tablet_manager.cc:1397] T eb1d7b3fc2724b7abbb3688c9fedcfbf P 243e9aadc9a5494fa5c49ad9050297e0: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260812 00:01:49.789924 16118 raft_consensus.cc:348] T eb1d7b3fc2724b7abbb3688c9fedcfbf P 243e9aadc9a5494fa5c49ad9050297e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c90a6832042427d895ba4af46755543" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 33327 } } peers { permanent_uuid: "4330d5ecb7e44e15b7d3e55c671748d3" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 35565 } } peers { permanent_uuid: "243e9aadc9a5494fa5c49ad9050297e0" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 41863 } }
I20260812 00:01:49.789987 16118 raft_consensus.cc:374] T eb1d7b3fc2724b7abbb3688c9fedcfbf P 243e9aadc9a5494fa5c49ad9050297e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:01:49.790007 16118 raft_consensus.cc:729] T eb1d7b3fc2724b7abbb3688c9fedcfbf P 243e9aadc9a5494fa5c49ad9050297e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 243e9aadc9a5494fa5c49ad9050297e0, State: Initialized, Role: FOLLOWER
I20260812 00:01:49.790048 16118 consensus_queue.cc:260] T eb1d7b3fc2724b7abbb3688c9fedcfbf P 243e9aadc9a5494fa5c49ad9050297e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c90a6832042427d895ba4af46755543" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 33327 } } peers { permanent_uuid: "4330d5ecb7e44e15b7d3e55c671748d3" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 35565 } } peers { permanent_uuid: "243e9aadc9a5494fa5c49ad9050297e0" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 41863 } }
I20260812 00:01:49.790132 16118 ts_tablet_manager.cc:1428] T eb1d7b3fc2724b7abbb3688c9fedcfbf P 243e9aadc9a5494fa5c49ad9050297e0: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260812 00:01:50.074679 16128 raft_consensus.cc:482] T eb1d7b3fc2724b7abbb3688c9fedcfbf P 4330d5ecb7e44e15b7d3e55c671748d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:01:50.074797 16128 raft_consensus.cc:504] T eb1d7b3fc2724b7abbb3688c9fedcfbf P 4330d5ecb7e44e15b7d3e55c671748d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c90a6832042427d895ba4af46755543" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 33327 } } peers { permanent_uuid: "4330d5ecb7e44e15b7d3e55c671748d3" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 35565 } } peers { permanent_uuid: "243e9aadc9a5494fa5c49ad9050297e0" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 41863 } }
I20260812 00:01:50.075155 16128 leader_election.cc:288] T eb1d7b3fc2724b7abbb3688c9fedcfbf P 4330d5ecb7e44e15b7d3e55c671748d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c90a6832042427d895ba4af46755543 (127.11.206.65:33327), 243e9aadc9a5494fa5c49ad9050297e0 (127.11.206.67:41863)
I20260812 00:01:50.078292 16108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:50.075536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.66:37819 (local address 127.11.206.67:41863)
0812 00:01:50.075591 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:50.075593 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:50.075625 (+ 32us) server_negotiation.cc:407] Connection header received
0812 00:01:50.075690 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:50.075691 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:50.075705 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:50.075764 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:01:50.075912 (+ 148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:50.076438 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:50.077561 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:50.077958 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:50.078017 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:50.078028 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:50.078176 (+ 148us) server_negotiation.cc:299] Negotiation successful
0812 00:01:50.078217 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260812 00:01:50.078307 16213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:50.075385 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.67:41863 (local address 127.11.206.66:37819)
0812 00:01:50.075541 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0812 00:01:50.075553 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 00:01:50.075631 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:01:50.075774 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:01:50.075775 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:01:50.075777 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:01:50.075842 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:50.075844 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:50.076520 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:50.076522 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:50.077467 (+ 945us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:50.077471 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:50.078042 (+ 571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:50.078043 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:50.078103 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:50.078106 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:01:50.078158 (+ 52us) client_negotiation.cc:240] Negotiation successful
0812 00:01:50.078192 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"mutex_wait_us":2,"spinlock_wait_cycles":768,"thread_start_us":72,"threads_started":1}
I20260812 00:01:50.078346 16112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:50.075463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.66:51319 (local address 127.11.206.65:33327)
0812 00:01:50.075532 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:50.075535 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:50.075673 (+ 138us) server_negotiation.cc:407] Connection header received
0812 00:01:50.075744 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:50.075745 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:50.075755 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:50.075808 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:01:50.075959 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:50.076439 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:50.077639 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:50.078012 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:50.078088 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:50.078098 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:50.078248 (+ 150us) server_negotiation.cc:299] Negotiation successful
0812 00:01:50.078285 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260812 00:01:50.078441 16212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:50.075385 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.65:33327 (local address 127.11.206.66:51319)
0812 00:01:50.075537 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0812 00:01:50.075584 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0812 00:01:50.075670 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:01:50.075817 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:01:50.075818 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:01:50.075820 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:01:50.075895 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:50.075897 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:50.076518 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:50.076519 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:50.077536 (+ 1017us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:50.077540 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:50.078096 (+ 556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:50.078097 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:50.078172 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:50.078176 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:01:50.078237 (+ 61us) client_negotiation.cc:240] Negotiation successful
0812 00:01:50.078317 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"mutex_wait_us":121,"thread_start_us":77,"threads_started":1}
I20260812 00:01:50.078603 16013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb1d7b3fc2724b7abbb3688c9fedcfbf" candidate_uuid: "4330d5ecb7e44e15b7d3e55c671748d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "243e9aadc9a5494fa5c49ad9050297e0" is_pre_election: true
I20260812 00:01:50.078715 16013 raft_consensus.cc:2454] T eb1d7b3fc2724b7abbb3688c9fedcfbf P 243e9aadc9a5494fa5c49ad9050297e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4330d5ecb7e44e15b7d3e55c671748d3 in term 0.
I20260812 00:01:50.078675 15536 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb1d7b3fc2724b7abbb3688c9fedcfbf" candidate_uuid: "4330d5ecb7e44e15b7d3e55c671748d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c90a6832042427d895ba4af46755543" is_pre_election: true
I20260812 00:01:50.078764 15536 raft_consensus.cc:2454] T eb1d7b3fc2724b7abbb3688c9fedcfbf P 0c90a6832042427d895ba4af46755543 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4330d5ecb7e44e15b7d3e55c671748d3 in term 0.
I20260812 00:01:50.078918 15669 leader_election.cc:302] T eb1d7b3fc2724b7abbb3688c9fedcfbf P 4330d5ecb7e44e15b7d3e55c671748d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 243e9aadc9a5494fa5c49ad9050297e0, 4330d5ecb7e44e15b7d3e55c671748d3; no voters:
I20260812 00:01:50.079084 16128 raft_consensus.cc:2781] T eb1d7b3fc2724b7abbb3688c9fedcfbf P 4330d5ecb7e44e15b7d3e55c671748d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:01:50.079165 16128 raft_consensus.cc:482] T eb1d7b3fc2724b7abbb3688c9fedcfbf P 4330d5ecb7e44e15b7d3e55c671748d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:01:50.079185 16128 raft_consensus.cc:3037] T eb1d7b3fc2724b7abbb3688c9fedcfbf P 4330d5ecb7e44e15b7d3e55c671748d3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:01:50.080148 16128 raft_consensus.cc:504] T eb1d7b3fc2724b7abbb3688c9fedcfbf P 4330d5ecb7e44e15b7d3e55c671748d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c90a6832042427d895ba4af46755543" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 33327 } } peers { permanent_uuid: "4330d5ecb7e44e15b7d3e55c671748d3" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 35565 } } peers { permanent_uuid: "243e9aadc9a5494fa5c49ad9050297e0" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 41863 } }
I20260812 00:01:50.080282 16128 leader_election.cc:288] T eb1d7b3fc2724b7abbb3688c9fedcfbf P 4330d5ecb7e44e15b7d3e55c671748d3 [CANDIDATE]: Term 1 election: Requested vote from peers 0c90a6832042427d895ba4af46755543 (127.11.206.65:33327), 243e9aadc9a5494fa5c49ad9050297e0 (127.11.206.67:41863)
I20260812 00:01:50.080461 16013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb1d7b3fc2724b7abbb3688c9fedcfbf" candidate_uuid: "4330d5ecb7e44e15b7d3e55c671748d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "243e9aadc9a5494fa5c49ad9050297e0"
I20260812 00:01:50.080466 15536 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb1d7b3fc2724b7abbb3688c9fedcfbf" candidate_uuid: "4330d5ecb7e44e15b7d3e55c671748d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c90a6832042427d895ba4af46755543"
I20260812 00:01:50.080540 16013 raft_consensus.cc:3037] T eb1d7b3fc2724b7abbb3688c9fedcfbf P 243e9aadc9a5494fa5c49ad9050297e0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:01:50.080562 15536 raft_consensus.cc:3037] T eb1d7b3fc2724b7abbb3688c9fedcfbf P 0c90a6832042427d895ba4af46755543 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:01:50.081182 15536 raft_consensus.cc:2454] T eb1d7b3fc2724b7abbb3688c9fedcfbf P 0c90a6832042427d895ba4af46755543 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4330d5ecb7e44e15b7d3e55c671748d3 in term 1.
I20260812 00:01:50.081182 16013 raft_consensus.cc:2454] T eb1d7b3fc2724b7abbb3688c9fedcfbf P 243e9aadc9a5494fa5c49ad9050297e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4330d5ecb7e44e15b7d3e55c671748d3 in term 1.
I20260812 00:01:50.081367 15669 leader_election.cc:302] T eb1d7b3fc2724b7abbb3688c9fedcfbf P 4330d5ecb7e44e15b7d3e55c671748d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 243e9aadc9a5494fa5c49ad9050297e0, 4330d5ecb7e44e15b7d3e55c671748d3; no voters:
I20260812 00:01:50.081481 16128 raft_consensus.cc:2781] T eb1d7b3fc2724b7abbb3688c9fedcfbf P 4330d5ecb7e44e15b7d3e55c671748d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:01:50.081640 16128 raft_consensus.cc:686] T eb1d7b3fc2724b7abbb3688c9fedcfbf P 4330d5ecb7e44e15b7d3e55c671748d3 [term 1 LEADER]: Becoming Leader. State: Replica: 4330d5ecb7e44e15b7d3e55c671748d3, State: Running, Role: LEADER
I20260812 00:01:50.081717 16128 consensus_queue.cc:237] T eb1d7b3fc2724b7abbb3688c9fedcfbf P 4330d5ecb7e44e15b7d3e55c671748d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c90a6832042427d895ba4af46755543" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 33327 } } peers { permanent_uuid: "4330d5ecb7e44e15b7d3e55c671748d3" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 35565 } } peers { permanent_uuid: "243e9aadc9a5494fa5c49ad9050297e0" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 41863 } }
I20260812 00:01:50.082479 15292 catalog_manager.cc:5495] T eb1d7b3fc2724b7abbb3688c9fedcfbf P 4330d5ecb7e44e15b7d3e55c671748d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4330d5ecb7e44e15b7d3e55c671748d3 (127.11.206.66). New cstate: current_term: 1 leader_uuid: "4330d5ecb7e44e15b7d3e55c671748d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c90a6832042427d895ba4af46755543" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 33327 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4330d5ecb7e44e15b7d3e55c671748d3" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 35565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "243e9aadc9a5494fa5c49ad9050297e0" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 41863 } health_report { overall_health: UNKNOWN } } }
I20260812 00:01:50.141882 16114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:50.139492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38614 (local address 127.11.206.66:35565)
0812 00:01:50.139548 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:50.139550 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:50.139557 (+ 7us) server_negotiation.cc:407] Connection header received
0812 00:01:50.139595 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:50.139596 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:50.139623 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:50.139687 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:01:50.139794 (+ 107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:50.140284 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:50.141054 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:50.141260 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:50.141317 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:50.141521 (+ 204us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:01:50.141648 (+ 127us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:01:50.141719 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:50.141743 (+ 24us) server_negotiation.cc:299] Negotiation successful
0812 00:01:50.141792 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260812 00:01:50.147356 16112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:50.144716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.66:53541 (local address 127.11.206.65:33327)
0812 00:01:50.144790 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:50.144793 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:50.144899 (+ 106us) server_negotiation.cc:407] Connection header received
0812 00:01:50.144975 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:50.144976 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:50.144987 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:50.145037 (+ 50us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:01:50.145314 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:50.145870 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:50.146651 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:50.146859 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:50.146915 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:50.147101 (+ 186us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:01:50.147141 (+ 40us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:01:50.147186 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:50.147249 (+ 63us) server_negotiation.cc:299] Negotiation successful
0812 00:01:50.147272 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 00:01:50.147452 16223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:50.144611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.65:33327 (local address 127.11.206.66:53541)
0812 00:01:50.144827 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0812 00:01:50.144837 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:01:50.144909 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:01:50.145044 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:01:50.145044 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:01:50.145046 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 00:01:50.145234 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:50.145236 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:50.145947 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:50.145949 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:50.146560 (+ 611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:50.146562 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:50.146945 (+ 383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:50.146946 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:50.147003 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:50.147019 (+ 16us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 00:01:50.147194 (+ 175us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 00:01:50.147196 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 00:01:50.147239 (+ 43us) client_negotiation.cc:240] Negotiation successful
0812 00:01:50.147287 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":82,"threads_started":1}
I20260812 00:01:50.149680 16013 raft_consensus.cc:1261] T eb1d7b3fc2724b7abbb3688c9fedcfbf P 243e9aadc9a5494fa5c49ad9050297e0 [term 1 FOLLOWER]: Refusing update from remote peer 4330d5ecb7e44e15b7d3e55c671748d3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:01:50.149724 15536 raft_consensus.cc:1261] T eb1d7b3fc2724b7abbb3688c9fedcfbf P 0c90a6832042427d895ba4af46755543 [term 1 FOLLOWER]: Refusing update from remote peer 4330d5ecb7e44e15b7d3e55c671748d3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:01:50.150034 16214 consensus_queue.cc:1035] T eb1d7b3fc2724b7abbb3688c9fedcfbf P 4330d5ecb7e44e15b7d3e55c671748d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "243e9aadc9a5494fa5c49ad9050297e0" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 41863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:01:50.150209 16128 consensus_queue.cc:1035] T eb1d7b3fc2724b7abbb3688c9fedcfbf P 4330d5ecb7e44e15b7d3e55c671748d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c90a6832042427d895ba4af46755543" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 33327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:01:50.157621 16114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:50.155480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.65:46899 (local address 127.11.206.66:35565)
0812 00:01:50.155523 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:50.155525 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:50.155534 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:01:50.155555 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:50.155556 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:50.155565 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:50.155618 (+ 53us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:01:50.155738 (+ 120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:50.156211 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:50.156916 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:50.157137 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:50.157198 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:50.157364 (+ 166us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:01:50.157423 (+ 59us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:01:50.157468 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:50.157518 (+ 50us) server_negotiation.cc:299] Negotiation successful
0812 00:01:50.157539 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 00:01:50.157634 16197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:50.155405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.66:35565 (local address 127.11.206.65:46899)
0812 00:01:50.155448 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0812 00:01:50.155460 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 00:01:50.155502 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:01:50.155620 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:01:50.155621 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:01:50.155622 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 00:01:50.155670 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:50.155671 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:50.156282 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:50.156283 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:50.156835 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:50.156838 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:50.157242 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:50.157243 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:50.157297 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:50.157304 (+ 7us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 00:01:50.157470 (+ 166us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 00:01:50.157472 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 00:01:50.157515 (+ 43us) client_negotiation.cc:240] Negotiation successful
0812 00:01:50.157568 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":21}
W20260812 00:01:50.158051 16168 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260812 00:01:51.683100 15287 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46686:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:01:51.683223 15287 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46686:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:01:51.684237 15287 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 86fa27d7db434987b0eecd62069fcf05: Sending DeleteTablet for 3 replicas of tablet eb1d7b3fc2724b7abbb3688c9fedcfbf
I20260812 00:01:51.684491 15499 tablet_service.cc:1514] Processing DeleteTablet for tablet eb1d7b3fc2724b7abbb3688c9fedcfbf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:01:51 UTC) from {username='kudu', principal='kudu/127.11.206.126@KRBTEST.COM'} at 127.0.0.1:45684
I20260812 00:01:51.684521 15756 tablet_service.cc:1514] Processing DeleteTablet for tablet eb1d7b3fc2724b7abbb3688c9fedcfbf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:01:51 UTC) from {username='kudu', principal='kudu/127.11.206.126@KRBTEST.COM'} at 127.0.0.1:38606
I20260812 00:01:51.684569 15977 tablet_service.cc:1514] Processing DeleteTablet for tablet eb1d7b3fc2724b7abbb3688c9fedcfbf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:01:51 UTC) from {username='kudu', principal='kudu/127.11.206.126@KRBTEST.COM'} at 127.0.0.1:43678
I20260812 00:01:51.684818 16282 tablet_replica.cc:330] T eb1d7b3fc2724b7abbb3688c9fedcfbf P 243e9aadc9a5494fa5c49ad9050297e0: stopping tablet replica
I20260812 00:01:51.684878 16282 raft_consensus.cc:2229] T eb1d7b3fc2724b7abbb3688c9fedcfbf P 243e9aadc9a5494fa5c49ad9050297e0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:01:51.684914 16282 raft_consensus.cc:2258] T eb1d7b3fc2724b7abbb3688c9fedcfbf P 243e9aadc9a5494fa5c49ad9050297e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:01:51.685010 16281 tablet_replica.cc:330] T eb1d7b3fc2724b7abbb3688c9fedcfbf P 4330d5ecb7e44e15b7d3e55c671748d3: stopping tablet replica
I20260812 00:01:51.685065 16281 raft_consensus.cc:2229] T eb1d7b3fc2724b7abbb3688c9fedcfbf P 4330d5ecb7e44e15b7d3e55c671748d3 [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:01:51.685153 16281 raft_consensus.cc:2258] T eb1d7b3fc2724b7abbb3688c9fedcfbf P 4330d5ecb7e44e15b7d3e55c671748d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:01:51.685464 16282 ts_tablet_manager.cc:1905] T eb1d7b3fc2724b7abbb3688c9fedcfbf P 243e9aadc9a5494fa5c49ad9050297e0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:01:51.685491 16281 ts_tablet_manager.cc:1905] T eb1d7b3fc2724b7abbb3688c9fedcfbf P 4330d5ecb7e44e15b7d3e55c671748d3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:01:51.685783 16279 tablet_replica.cc:330] T eb1d7b3fc2724b7abbb3688c9fedcfbf P 0c90a6832042427d895ba4af46755543: stopping tablet replica
I20260812 00:01:51.685909 16279 raft_consensus.cc:2229] T eb1d7b3fc2724b7abbb3688c9fedcfbf P 0c90a6832042427d895ba4af46755543 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:01:51.687204 16282 ts_tablet_manager.cc:1918] T eb1d7b3fc2724b7abbb3688c9fedcfbf P 243e9aadc9a5494fa5c49ad9050297e0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 00:01:51.687271 16281 ts_tablet_manager.cc:1918] T eb1d7b3fc2724b7abbb3688c9fedcfbf P 4330d5ecb7e44e15b7d3e55c671748d3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 00:01:51.685986 16279 raft_consensus.cc:2258] T eb1d7b3fc2724b7abbb3688c9fedcfbf P 0c90a6832042427d895ba4af46755543 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:01:51.687343 16281 log.cc:1196] T eb1d7b3fc2724b7abbb3688c9fedcfbf P 4330d5ecb7e44e15b7d3e55c671748d3: Deleting WAL directory at /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/minicluster-data/ts-1/wal/wals/eb1d7b3fc2724b7abbb3688c9fedcfbf
I20260812 00:01:51.687611 16281 ts_tablet_manager.cc:1939] T eb1d7b3fc2724b7abbb3688c9fedcfbf P 4330d5ecb7e44e15b7d3e55c671748d3: Deleting consensus metadata
I20260812 00:01:51.687736 16279 ts_tablet_manager.cc:1905] T eb1d7b3fc2724b7abbb3688c9fedcfbf P 0c90a6832042427d895ba4af46755543: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:01:51.687973 15264 catalog_manager.cc:4841] TS 4330d5ecb7e44e15b7d3e55c671748d3 (127.11.206.66:35565): tablet eb1d7b3fc2724b7abbb3688c9fedcfbf (table test-table [id=67ef7fdce23c484ebd08201542cf4662]) successfully deleted
I20260812 00:01:51.689518 16279 ts_tablet_manager.cc:1918] T eb1d7b3fc2724b7abbb3688c9fedcfbf P 0c90a6832042427d895ba4af46755543: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 00:01:51.689589 16279 log.cc:1196] T eb1d7b3fc2724b7abbb3688c9fedcfbf P 0c90a6832042427d895ba4af46755543: Deleting WAL directory at /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/minicluster-data/ts-0/wal/wals/eb1d7b3fc2724b7abbb3688c9fedcfbf
I20260812 00:01:51.689781 16279 ts_tablet_manager.cc:1939] T eb1d7b3fc2724b7abbb3688c9fedcfbf P 0c90a6832042427d895ba4af46755543: Deleting consensus metadata
I20260812 00:01:51.687316 16282 log.cc:1196] T eb1d7b3fc2724b7abbb3688c9fedcfbf P 243e9aadc9a5494fa5c49ad9050297e0: Deleting WAL directory at /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/minicluster-data/ts-2/wal/wals/eb1d7b3fc2724b7abbb3688c9fedcfbf
I20260812 00:01:51.690171 15263 catalog_manager.cc:4841] TS 0c90a6832042427d895ba4af46755543 (127.11.206.65:33327): tablet eb1d7b3fc2724b7abbb3688c9fedcfbf (table test-table [id=67ef7fdce23c484ebd08201542cf4662]) successfully deleted
I20260812 00:01:51.690249 16282 ts_tablet_manager.cc:1939] T eb1d7b3fc2724b7abbb3688c9fedcfbf P 243e9aadc9a5494fa5c49ad9050297e0: Deleting consensus metadata
I20260812 00:01:51.690564 15264 catalog_manager.cc:4841] TS 243e9aadc9a5494fa5c49ad9050297e0 (127.11.206.67:41863): tablet eb1d7b3fc2724b7abbb3688c9fedcfbf (table test-table [id=67ef7fdce23c484ebd08201542cf4662]) successfully deleted
Aug 12 00:01:51 dist-test-slave-f0tn krb5kdc[15210](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492911, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 00:01:51 dist-test-slave-f0tn krb5kdc[15210](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492911, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:01:51.711117 16297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:51.704214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46708 (local address 127.11.206.126:36401)
0812 00:01:51.704377 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:51.704379 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:51.704390 (+ 11us) server_negotiation.cc:407] Connection header received
0812 00:01:51.704435 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:51.704436 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:51.704448 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:51.704508 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:01:51.705014 (+ 506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:51.705588 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:51.706298 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:51.706508 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:51.706567 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:51.708762 (+ 2195us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:01:51.708763 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:01:51.708763 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:01:51.708771 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:01:51.710147 (+ 1376us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:51.710481 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:51.710482 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:51.710483 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:51.710544 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:51.710680 (+ 136us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:51.710681 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:51.710681 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:51.710788 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:01:51.710870 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:51.710930 (+ 60us) server_negotiation.cc:299] Negotiation successful
0812 00:01:51.710997 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":96,"threads_started":1}
I20260812 00:01:51.712668 15287 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46708:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:01:51.712829 15287 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:01:51.714300 15756 tablet_service.cc:1467] Processing CreateTablet for tablet d59ccef9d4c6461ab4037d7d9211973f (DEFAULT_TABLE table=test-table [id=0fec153447794e279ee8fcbb590a105c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:01:51.714298 15499 tablet_service.cc:1467] Processing CreateTablet for tablet d59ccef9d4c6461ab4037d7d9211973f (DEFAULT_TABLE table=test-table [id=0fec153447794e279ee8fcbb590a105c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:01:51.714324 15977 tablet_service.cc:1467] Processing CreateTablet for tablet d59ccef9d4c6461ab4037d7d9211973f (DEFAULT_TABLE table=test-table [id=0fec153447794e279ee8fcbb590a105c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:01:51.714447 15499 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d59ccef9d4c6461ab4037d7d9211973f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:01:51.714448 15756 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d59ccef9d4c6461ab4037d7d9211973f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:01:51.714452 15977 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d59ccef9d4c6461ab4037d7d9211973f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:01:51.715926 16305 tablet_bootstrap.cc:492] T d59ccef9d4c6461ab4037d7d9211973f P 0c90a6832042427d895ba4af46755543: Bootstrap starting.
I20260812 00:01:51.716087 16302 tablet_bootstrap.cc:492] T d59ccef9d4c6461ab4037d7d9211973f P 4330d5ecb7e44e15b7d3e55c671748d3: Bootstrap starting.
I20260812 00:01:51.716269 16306 tablet_bootstrap.cc:492] T d59ccef9d4c6461ab4037d7d9211973f P 243e9aadc9a5494fa5c49ad9050297e0: Bootstrap starting.
I20260812 00:01:51.716390 16305 tablet_bootstrap.cc:654] T d59ccef9d4c6461ab4037d7d9211973f P 0c90a6832042427d895ba4af46755543: Neither blocks nor log segments found. Creating new log.
I20260812 00:01:51.716476 16302 tablet_bootstrap.cc:654] T d59ccef9d4c6461ab4037d7d9211973f P 4330d5ecb7e44e15b7d3e55c671748d3: Neither blocks nor log segments found. Creating new log.
I20260812 00:01:51.716609 16306 tablet_bootstrap.cc:654] T d59ccef9d4c6461ab4037d7d9211973f P 243e9aadc9a5494fa5c49ad9050297e0: Neither blocks nor log segments found. Creating new log.
I20260812 00:01:51.717079 16305 tablet_bootstrap.cc:492] T d59ccef9d4c6461ab4037d7d9211973f P 0c90a6832042427d895ba4af46755543: No bootstrap required, opened a new log
I20260812 00:01:51.717140 16305 ts_tablet_manager.cc:1397] T d59ccef9d4c6461ab4037d7d9211973f P 0c90a6832042427d895ba4af46755543: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 00:01:51.717216 16306 tablet_bootstrap.cc:492] T d59ccef9d4c6461ab4037d7d9211973f P 243e9aadc9a5494fa5c49ad9050297e0: No bootstrap required, opened a new log
I20260812 00:01:51.717269 16302 tablet_bootstrap.cc:492] T d59ccef9d4c6461ab4037d7d9211973f P 4330d5ecb7e44e15b7d3e55c671748d3: No bootstrap required, opened a new log
I20260812 00:01:51.717294 16305 raft_consensus.cc:348] T d59ccef9d4c6461ab4037d7d9211973f P 0c90a6832042427d895ba4af46755543 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c90a6832042427d895ba4af46755543" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 33327 } } peers { permanent_uuid: "4330d5ecb7e44e15b7d3e55c671748d3" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 35565 } } peers { permanent_uuid: "243e9aadc9a5494fa5c49ad9050297e0" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 41863 } }
I20260812 00:01:51.717347 16302 ts_tablet_manager.cc:1397] T d59ccef9d4c6461ab4037d7d9211973f P 4330d5ecb7e44e15b7d3e55c671748d3: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 00:01:51.717399 16305 raft_consensus.cc:374] T d59ccef9d4c6461ab4037d7d9211973f P 0c90a6832042427d895ba4af46755543 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:01:51.717422 16305 raft_consensus.cc:729] T d59ccef9d4c6461ab4037d7d9211973f P 0c90a6832042427d895ba4af46755543 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c90a6832042427d895ba4af46755543, State: Initialized, Role: FOLLOWER
I20260812 00:01:51.717484 16305 consensus_queue.cc:260] T d59ccef9d4c6461ab4037d7d9211973f P 0c90a6832042427d895ba4af46755543 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c90a6832042427d895ba4af46755543" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 33327 } } peers { permanent_uuid: "4330d5ecb7e44e15b7d3e55c671748d3" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 35565 } } peers { permanent_uuid: "243e9aadc9a5494fa5c49ad9050297e0" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 41863 } }
I20260812 00:01:51.717491 16302 raft_consensus.cc:348] T d59ccef9d4c6461ab4037d7d9211973f P 4330d5ecb7e44e15b7d3e55c671748d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c90a6832042427d895ba4af46755543" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 33327 } } peers { permanent_uuid: "4330d5ecb7e44e15b7d3e55c671748d3" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 35565 } } peers { permanent_uuid: "243e9aadc9a5494fa5c49ad9050297e0" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 41863 } }
I20260812 00:01:51.717586 16302 raft_consensus.cc:374] T d59ccef9d4c6461ab4037d7d9211973f P 4330d5ecb7e44e15b7d3e55c671748d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:01:51.717589 16306 ts_tablet_manager.cc:1397] T d59ccef9d4c6461ab4037d7d9211973f P 243e9aadc9a5494fa5c49ad9050297e0: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 00:01:51.717617 16305 ts_tablet_manager.cc:1428] T d59ccef9d4c6461ab4037d7d9211973f P 0c90a6832042427d895ba4af46755543: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:51.717628 16302 raft_consensus.cc:729] T d59ccef9d4c6461ab4037d7d9211973f P 4330d5ecb7e44e15b7d3e55c671748d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4330d5ecb7e44e15b7d3e55c671748d3, State: Initialized, Role: FOLLOWER
I20260812 00:01:51.717674 16302 consensus_queue.cc:260] T d59ccef9d4c6461ab4037d7d9211973f P 4330d5ecb7e44e15b7d3e55c671748d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c90a6832042427d895ba4af46755543" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 33327 } } peers { permanent_uuid: "4330d5ecb7e44e15b7d3e55c671748d3" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 35565 } } peers { permanent_uuid: "243e9aadc9a5494fa5c49ad9050297e0" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 41863 } }
I20260812 00:01:51.717790 16302 ts_tablet_manager.cc:1428] T d59ccef9d4c6461ab4037d7d9211973f P 4330d5ecb7e44e15b7d3e55c671748d3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:51.717799 16306 raft_consensus.cc:348] T d59ccef9d4c6461ab4037d7d9211973f P 243e9aadc9a5494fa5c49ad9050297e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c90a6832042427d895ba4af46755543" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 33327 } } peers { permanent_uuid: "4330d5ecb7e44e15b7d3e55c671748d3" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 35565 } } peers { permanent_uuid: "243e9aadc9a5494fa5c49ad9050297e0" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 41863 } }
I20260812 00:01:51.717886 16306 raft_consensus.cc:374] T d59ccef9d4c6461ab4037d7d9211973f P 243e9aadc9a5494fa5c49ad9050297e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:01:51.717912 16306 raft_consensus.cc:729] T d59ccef9d4c6461ab4037d7d9211973f P 243e9aadc9a5494fa5c49ad9050297e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 243e9aadc9a5494fa5c49ad9050297e0, State: Initialized, Role: FOLLOWER
I20260812 00:01:51.717962 16306 consensus_queue.cc:260] T d59ccef9d4c6461ab4037d7d9211973f P 243e9aadc9a5494fa5c49ad9050297e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c90a6832042427d895ba4af46755543" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 33327 } } peers { permanent_uuid: "4330d5ecb7e44e15b7d3e55c671748d3" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 35565 } } peers { permanent_uuid: "243e9aadc9a5494fa5c49ad9050297e0" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 41863 } }
I20260812 00:01:51.718145 16306 ts_tablet_manager.cc:1428] T d59ccef9d4c6461ab4037d7d9211973f P 243e9aadc9a5494fa5c49ad9050297e0: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:51.720237 16315 raft_consensus.cc:482] T d59ccef9d4c6461ab4037d7d9211973f P 243e9aadc9a5494fa5c49ad9050297e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:01:51.720284 16315 raft_consensus.cc:504] T d59ccef9d4c6461ab4037d7d9211973f P 243e9aadc9a5494fa5c49ad9050297e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c90a6832042427d895ba4af46755543" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 33327 } } peers { permanent_uuid: "4330d5ecb7e44e15b7d3e55c671748d3" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 35565 } } peers { permanent_uuid: "243e9aadc9a5494fa5c49ad9050297e0" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 41863 } }
I20260812 00:01:51.720414 16315 leader_election.cc:288] T d59ccef9d4c6461ab4037d7d9211973f P 243e9aadc9a5494fa5c49ad9050297e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c90a6832042427d895ba4af46755543 (127.11.206.65:33327), 4330d5ecb7e44e15b7d3e55c671748d3 (127.11.206.66:35565)
I20260812 00:01:51.720552 15536 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d59ccef9d4c6461ab4037d7d9211973f" candidate_uuid: "243e9aadc9a5494fa5c49ad9050297e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c90a6832042427d895ba4af46755543" is_pre_election: true
I20260812 00:01:51.720629 15536 raft_consensus.cc:2454] T d59ccef9d4c6461ab4037d7d9211973f P 0c90a6832042427d895ba4af46755543 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 243e9aadc9a5494fa5c49ad9050297e0 in term 0.
I20260812 00:01:51.720602 15785 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d59ccef9d4c6461ab4037d7d9211973f" candidate_uuid: "243e9aadc9a5494fa5c49ad9050297e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4330d5ecb7e44e15b7d3e55c671748d3" is_pre_election: true
I20260812 00:01:51.720690 15785 raft_consensus.cc:2454] T d59ccef9d4c6461ab4037d7d9211973f P 4330d5ecb7e44e15b7d3e55c671748d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 243e9aadc9a5494fa5c49ad9050297e0 in term 0.
I20260812 00:01:51.720793 15900 leader_election.cc:302] T d59ccef9d4c6461ab4037d7d9211973f P 243e9aadc9a5494fa5c49ad9050297e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c90a6832042427d895ba4af46755543, 243e9aadc9a5494fa5c49ad9050297e0; no voters:
I20260812 00:01:51.720901 16315 raft_consensus.cc:2781] T d59ccef9d4c6461ab4037d7d9211973f P 243e9aadc9a5494fa5c49ad9050297e0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:01:51.720930 16315 raft_consensus.cc:482] T d59ccef9d4c6461ab4037d7d9211973f P 243e9aadc9a5494fa5c49ad9050297e0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:01:51.720948 16315 raft_consensus.cc:3037] T d59ccef9d4c6461ab4037d7d9211973f P 243e9aadc9a5494fa5c49ad9050297e0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:01:51.721570 16315 raft_consensus.cc:504] T d59ccef9d4c6461ab4037d7d9211973f P 243e9aadc9a5494fa5c49ad9050297e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c90a6832042427d895ba4af46755543" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 33327 } } peers { permanent_uuid: "4330d5ecb7e44e15b7d3e55c671748d3" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 35565 } } peers { permanent_uuid: "243e9aadc9a5494fa5c49ad9050297e0" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 41863 } }
I20260812 00:01:51.721686 16315 leader_election.cc:288] T d59ccef9d4c6461ab4037d7d9211973f P 243e9aadc9a5494fa5c49ad9050297e0 [CANDIDATE]: Term 1 election: Requested vote from peers 0c90a6832042427d895ba4af46755543 (127.11.206.65:33327), 4330d5ecb7e44e15b7d3e55c671748d3 (127.11.206.66:35565)
I20260812 00:01:51.721840 15785 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d59ccef9d4c6461ab4037d7d9211973f" candidate_uuid: "243e9aadc9a5494fa5c49ad9050297e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4330d5ecb7e44e15b7d3e55c671748d3"
I20260812 00:01:51.721841 15536 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d59ccef9d4c6461ab4037d7d9211973f" candidate_uuid: "243e9aadc9a5494fa5c49ad9050297e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c90a6832042427d895ba4af46755543"
I20260812 00:01:51.721917 15785 raft_consensus.cc:3037] T d59ccef9d4c6461ab4037d7d9211973f P 4330d5ecb7e44e15b7d3e55c671748d3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:01:51.721917 15536 raft_consensus.cc:3037] T d59ccef9d4c6461ab4037d7d9211973f P 0c90a6832042427d895ba4af46755543 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:01:51.722695 15536 raft_consensus.cc:2454] T d59ccef9d4c6461ab4037d7d9211973f P 0c90a6832042427d895ba4af46755543 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 243e9aadc9a5494fa5c49ad9050297e0 in term 1.
I20260812 00:01:51.722695 15785 raft_consensus.cc:2454] T d59ccef9d4c6461ab4037d7d9211973f P 4330d5ecb7e44e15b7d3e55c671748d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 243e9aadc9a5494fa5c49ad9050297e0 in term 1.
I20260812 00:01:51.722855 15902 leader_election.cc:302] T d59ccef9d4c6461ab4037d7d9211973f P 243e9aadc9a5494fa5c49ad9050297e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 243e9aadc9a5494fa5c49ad9050297e0, 4330d5ecb7e44e15b7d3e55c671748d3; no voters:
I20260812 00:01:51.722967 16315 raft_consensus.cc:2781] T d59ccef9d4c6461ab4037d7d9211973f P 243e9aadc9a5494fa5c49ad9050297e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:01:51.723094 16315 raft_consensus.cc:686] T d59ccef9d4c6461ab4037d7d9211973f P 243e9aadc9a5494fa5c49ad9050297e0 [term 1 LEADER]: Becoming Leader. State: Replica: 243e9aadc9a5494fa5c49ad9050297e0, State: Running, Role: LEADER
I20260812 00:01:51.723138 16315 consensus_queue.cc:237] T d59ccef9d4c6461ab4037d7d9211973f P 243e9aadc9a5494fa5c49ad9050297e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c90a6832042427d895ba4af46755543" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 33327 } } peers { permanent_uuid: "4330d5ecb7e44e15b7d3e55c671748d3" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 35565 } } peers { permanent_uuid: "243e9aadc9a5494fa5c49ad9050297e0" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 41863 } }
I20260812 00:01:51.723646 15292 catalog_manager.cc:5495] T d59ccef9d4c6461ab4037d7d9211973f P 243e9aadc9a5494fa5c49ad9050297e0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 243e9aadc9a5494fa5c49ad9050297e0 (127.11.206.67). New cstate: current_term: 1 leader_uuid: "243e9aadc9a5494fa5c49ad9050297e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c90a6832042427d895ba4af46755543" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 33327 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4330d5ecb7e44e15b7d3e55c671748d3" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 35565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "243e9aadc9a5494fa5c49ad9050297e0" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 41863 } health_report { overall_health: HEALTHY } } }
I20260812 00:01:51.731748 16319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:51.729468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43694 (local address 127.11.206.67:41863)
0812 00:01:51.729608 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:51.729609 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:51.729617 (+ 8us) server_negotiation.cc:407] Connection header received
0812 00:01:51.729636 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:51.729636 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:51.729647 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:51.729698 (+ 51us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:01:51.729798 (+ 100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:51.730271 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:51.731113 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:51.731318 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:51.731382 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:51.731494 (+ 112us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:01:51.731523 (+ 29us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:01:51.731555 (+ 32us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:51.731608 (+ 53us) server_negotiation.cc:299] Negotiation successful
0812 00:01:51.731649 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":94,"threads_started":1}
I20260812 00:01:51.733982 15536 raft_consensus.cc:1261] T d59ccef9d4c6461ab4037d7d9211973f P 0c90a6832042427d895ba4af46755543 [term 1 FOLLOWER]: Refusing update from remote peer 243e9aadc9a5494fa5c49ad9050297e0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:01:51.734025 15785 raft_consensus.cc:1261] T d59ccef9d4c6461ab4037d7d9211973f P 4330d5ecb7e44e15b7d3e55c671748d3 [term 1 FOLLOWER]: Refusing update from remote peer 243e9aadc9a5494fa5c49ad9050297e0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:01:51.734181 16315 consensus_queue.cc:1035] T d59ccef9d4c6461ab4037d7d9211973f P 243e9aadc9a5494fa5c49ad9050297e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c90a6832042427d895ba4af46755543" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 33327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:01:51.734293 16316 consensus_queue.cc:1035] T d59ccef9d4c6461ab4037d7d9211973f P 243e9aadc9a5494fa5c49ad9050297e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4330d5ecb7e44e15b7d3e55c671748d3" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 35565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:01:51.744205 15285 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46708:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:01:51.744305 15285 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46708:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:01:51.744948 15285 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 86fa27d7db434987b0eecd62069fcf05: Sending DeleteTablet for 3 replicas of tablet d59ccef9d4c6461ab4037d7d9211973f
I20260812 00:01:51.745167 15499 tablet_service.cc:1514] Processing DeleteTablet for tablet d59ccef9d4c6461ab4037d7d9211973f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:01:51 UTC) from {username='kudu', principal='kudu/127.11.206.126@KRBTEST.COM'} at 127.0.0.1:45684
I20260812 00:01:51.745182 15756 tablet_service.cc:1514] Processing DeleteTablet for tablet d59ccef9d4c6461ab4037d7d9211973f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:01:51 UTC) from {username='kudu', principal='kudu/127.11.206.126@KRBTEST.COM'} at 127.0.0.1:38606
I20260812 00:01:51.745204 15977 tablet_service.cc:1514] Processing DeleteTablet for tablet d59ccef9d4c6461ab4037d7d9211973f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:01:51 UTC) from {username='kudu', principal='kudu/127.11.206.126@KRBTEST.COM'} at 127.0.0.1:43678
I20260812 00:01:51.745280 16282 tablet_replica.cc:330] T d59ccef9d4c6461ab4037d7d9211973f P 243e9aadc9a5494fa5c49ad9050297e0: stopping tablet replica
I20260812 00:01:51.745293 16279 tablet_replica.cc:330] T d59ccef9d4c6461ab4037d7d9211973f P 0c90a6832042427d895ba4af46755543: stopping tablet replica
I20260812 00:01:51.745311 16281 tablet_replica.cc:330] T d59ccef9d4c6461ab4037d7d9211973f P 4330d5ecb7e44e15b7d3e55c671748d3: stopping tablet replica
I20260812 00:01:51.745332 16282 raft_consensus.cc:2229] T d59ccef9d4c6461ab4037d7d9211973f P 243e9aadc9a5494fa5c49ad9050297e0 [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:01:51.745362 16281 raft_consensus.cc:2229] T d59ccef9d4c6461ab4037d7d9211973f P 4330d5ecb7e44e15b7d3e55c671748d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:01:51.745355 16279 raft_consensus.cc:2229] T d59ccef9d4c6461ab4037d7d9211973f P 0c90a6832042427d895ba4af46755543 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:01:51.745404 16282 raft_consensus.cc:2258] T d59ccef9d4c6461ab4037d7d9211973f P 243e9aadc9a5494fa5c49ad9050297e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:01:51.745415 16281 raft_consensus.cc:2258] T d59ccef9d4c6461ab4037d7d9211973f P 4330d5ecb7e44e15b7d3e55c671748d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:01:51.745425 16279 raft_consensus.cc:2258] T d59ccef9d4c6461ab4037d7d9211973f P 0c90a6832042427d895ba4af46755543 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:01:51.745663 15285 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46708:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 00:01:51.745748 16279 ts_tablet_manager.cc:1905] T d59ccef9d4c6461ab4037d7d9211973f P 0c90a6832042427d895ba4af46755543: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260812 00:01:51.745798 15285 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:01:51.745801 16281 ts_tablet_manager.cc:1905] T d59ccef9d4c6461ab4037d7d9211973f P 4330d5ecb7e44e15b7d3e55c671748d3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:01:51.746060 16282 ts_tablet_manager.cc:1905] T d59ccef9d4c6461ab4037d7d9211973f P 243e9aadc9a5494fa5c49ad9050297e0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:01:51.747031 15756 tablet_service.cc:1467] Processing CreateTablet for tablet a66a8108e2fd42d38780d59fbaadb8ff (DEFAULT_TABLE table=test-table [id=b62f825b125242199965cd662c5fbb22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:01:51.747143 15756 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a66a8108e2fd42d38780d59fbaadb8ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:01:51.747268 16281 ts_tablet_manager.cc:1918] T d59ccef9d4c6461ab4037d7d9211973f P 4330d5ecb7e44e15b7d3e55c671748d3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 00:01:51.747272 16279 ts_tablet_manager.cc:1918] T d59ccef9d4c6461ab4037d7d9211973f P 0c90a6832042427d895ba4af46755543: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 00:01:51.747318 16281 log.cc:1196] T d59ccef9d4c6461ab4037d7d9211973f P 4330d5ecb7e44e15b7d3e55c671748d3: Deleting WAL directory at /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/minicluster-data/ts-1/wal/wals/d59ccef9d4c6461ab4037d7d9211973f
I20260812 00:01:51.747318 16279 log.cc:1196] T d59ccef9d4c6461ab4037d7d9211973f P 0c90a6832042427d895ba4af46755543: Deleting WAL directory at /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/minicluster-data/ts-0/wal/wals/d59ccef9d4c6461ab4037d7d9211973f
I20260812 00:01:51.747306 15977 tablet_service.cc:1467] Processing CreateTablet for tablet a66a8108e2fd42d38780d59fbaadb8ff (DEFAULT_TABLE table=test-table [id=b62f825b125242199965cd662c5fbb22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:01:51.747392 15977 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a66a8108e2fd42d38780d59fbaadb8ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:01:51.747532 16279 ts_tablet_manager.cc:1939] T d59ccef9d4c6461ab4037d7d9211973f P 0c90a6832042427d895ba4af46755543: Deleting consensus metadata
I20260812 00:01:51.747546 16281 ts_tablet_manager.cc:1939] T d59ccef9d4c6461ab4037d7d9211973f P 4330d5ecb7e44e15b7d3e55c671748d3: Deleting consensus metadata
I20260812 00:01:51.747732 16282 ts_tablet_manager.cc:1918] T d59ccef9d4c6461ab4037d7d9211973f P 243e9aadc9a5494fa5c49ad9050297e0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 00:01:51.747776 16282 log.cc:1196] T d59ccef9d4c6461ab4037d7d9211973f P 243e9aadc9a5494fa5c49ad9050297e0: Deleting WAL directory at /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/minicluster-data/ts-2/wal/wals/d59ccef9d4c6461ab4037d7d9211973f
I20260812 00:01:51.747810 15264 catalog_manager.cc:4841] TS 4330d5ecb7e44e15b7d3e55c671748d3 (127.11.206.66:35565): tablet d59ccef9d4c6461ab4037d7d9211973f (table test-table [id=0fec153447794e279ee8fcbb590a105c]) successfully deleted
I20260812 00:01:51.747968 16282 ts_tablet_manager.cc:1939] T d59ccef9d4c6461ab4037d7d9211973f P 243e9aadc9a5494fa5c49ad9050297e0: Deleting consensus metadata
I20260812 00:01:51.748512 16306 tablet_bootstrap.cc:492] T a66a8108e2fd42d38780d59fbaadb8ff P 243e9aadc9a5494fa5c49ad9050297e0: Bootstrap starting.
I20260812 00:01:51.748744 16302 tablet_bootstrap.cc:492] T a66a8108e2fd42d38780d59fbaadb8ff P 4330d5ecb7e44e15b7d3e55c671748d3: Bootstrap starting.
I20260812 00:01:51.748808 16306 tablet_bootstrap.cc:654] T a66a8108e2fd42d38780d59fbaadb8ff P 243e9aadc9a5494fa5c49ad9050297e0: Neither blocks nor log segments found. Creating new log.
I20260812 00:01:51.749003 15263 catalog_manager.cc:4841] TS 0c90a6832042427d895ba4af46755543 (127.11.206.65:33327): tablet d59ccef9d4c6461ab4037d7d9211973f (table test-table [id=0fec153447794e279ee8fcbb590a105c]) successfully deleted
I20260812 00:01:51.749029 16302 tablet_bootstrap.cc:654] T a66a8108e2fd42d38780d59fbaadb8ff P 4330d5ecb7e44e15b7d3e55c671748d3: Neither blocks nor log segments found. Creating new log.
I20260812 00:01:51.749235 15499 tablet_service.cc:1467] Processing CreateTablet for tablet a66a8108e2fd42d38780d59fbaadb8ff (DEFAULT_TABLE table=test-table [id=b62f825b125242199965cd662c5fbb22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:01:51.749347 15499 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a66a8108e2fd42d38780d59fbaadb8ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:01:51.749511 15264 catalog_manager.cc:4841] TS 243e9aadc9a5494fa5c49ad9050297e0 (127.11.206.67:41863): tablet d59ccef9d4c6461ab4037d7d9211973f (table test-table [id=0fec153447794e279ee8fcbb590a105c]) successfully deleted
I20260812 00:01:51.749811 16306 tablet_bootstrap.cc:492] T a66a8108e2fd42d38780d59fbaadb8ff P 243e9aadc9a5494fa5c49ad9050297e0: No bootstrap required, opened a new log
I20260812 00:01:51.749857 16306 ts_tablet_manager.cc:1397] T a66a8108e2fd42d38780d59fbaadb8ff P 243e9aadc9a5494fa5c49ad9050297e0: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 00:01:51.749955 16306 raft_consensus.cc:348] T a66a8108e2fd42d38780d59fbaadb8ff P 243e9aadc9a5494fa5c49ad9050297e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c90a6832042427d895ba4af46755543" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 33327 } } peers { permanent_uuid: "4330d5ecb7e44e15b7d3e55c671748d3" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 35565 } } peers { permanent_uuid: "243e9aadc9a5494fa5c49ad9050297e0" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 41863 } }
I20260812 00:01:51.750008 16306 raft_consensus.cc:374] T a66a8108e2fd42d38780d59fbaadb8ff P 243e9aadc9a5494fa5c49ad9050297e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:01:51.750026 16306 raft_consensus.cc:729] T a66a8108e2fd42d38780d59fbaadb8ff P 243e9aadc9a5494fa5c49ad9050297e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 243e9aadc9a5494fa5c49ad9050297e0, State: Initialized, Role: FOLLOWER
I20260812 00:01:51.750064 16306 consensus_queue.cc:260] T a66a8108e2fd42d38780d59fbaadb8ff P 243e9aadc9a5494fa5c49ad9050297e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c90a6832042427d895ba4af46755543" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 33327 } } peers { permanent_uuid: "4330d5ecb7e44e15b7d3e55c671748d3" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 35565 } } peers { permanent_uuid: "243e9aadc9a5494fa5c49ad9050297e0" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 41863 } }
I20260812 00:01:51.750154 16306 ts_tablet_manager.cc:1428] T a66a8108e2fd42d38780d59fbaadb8ff P 243e9aadc9a5494fa5c49ad9050297e0: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:51.750355 16305 tablet_bootstrap.cc:492] T a66a8108e2fd42d38780d59fbaadb8ff P 0c90a6832042427d895ba4af46755543: Bootstrap starting.
I20260812 00:01:51.750540 16302 tablet_bootstrap.cc:492] T a66a8108e2fd42d38780d59fbaadb8ff P 4330d5ecb7e44e15b7d3e55c671748d3: No bootstrap required, opened a new log
I20260812 00:01:51.750584 16302 ts_tablet_manager.cc:1397] T a66a8108e2fd42d38780d59fbaadb8ff P 4330d5ecb7e44e15b7d3e55c671748d3: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260812 00:01:51.750705 16302 raft_consensus.cc:348] T a66a8108e2fd42d38780d59fbaadb8ff P 4330d5ecb7e44e15b7d3e55c671748d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c90a6832042427d895ba4af46755543" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 33327 } } peers { permanent_uuid: "4330d5ecb7e44e15b7d3e55c671748d3" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 35565 } } peers { permanent_uuid: "243e9aadc9a5494fa5c49ad9050297e0" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 41863 } }
I20260812 00:01:51.750764 16302 raft_consensus.cc:374] T a66a8108e2fd42d38780d59fbaadb8ff P 4330d5ecb7e44e15b7d3e55c671748d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:01:51.750782 16302 raft_consensus.cc:729] T a66a8108e2fd42d38780d59fbaadb8ff P 4330d5ecb7e44e15b7d3e55c671748d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4330d5ecb7e44e15b7d3e55c671748d3, State: Initialized, Role: FOLLOWER
I20260812 00:01:51.750823 16302 consensus_queue.cc:260] T a66a8108e2fd42d38780d59fbaadb8ff P 4330d5ecb7e44e15b7d3e55c671748d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c90a6832042427d895ba4af46755543" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 33327 } } peers { permanent_uuid: "4330d5ecb7e44e15b7d3e55c671748d3" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 35565 } } peers { permanent_uuid: "243e9aadc9a5494fa5c49ad9050297e0" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 41863 } }
I20260812 00:01:51.750905 16302 ts_tablet_manager.cc:1428] T a66a8108e2fd42d38780d59fbaadb8ff P 4330d5ecb7e44e15b7d3e55c671748d3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:51.751030 16305 tablet_bootstrap.cc:654] T a66a8108e2fd42d38780d59fbaadb8ff P 0c90a6832042427d895ba4af46755543: Neither blocks nor log segments found. Creating new log.
I20260812 00:01:51.751516 16305 tablet_bootstrap.cc:492] T a66a8108e2fd42d38780d59fbaadb8ff P 0c90a6832042427d895ba4af46755543: No bootstrap required, opened a new log
I20260812 00:01:51.751567 16305 ts_tablet_manager.cc:1397] T a66a8108e2fd42d38780d59fbaadb8ff P 0c90a6832042427d895ba4af46755543: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260812 00:01:51.751682 16305 raft_consensus.cc:348] T a66a8108e2fd42d38780d59fbaadb8ff P 0c90a6832042427d895ba4af46755543 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c90a6832042427d895ba4af46755543" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 33327 } } peers { permanent_uuid: "4330d5ecb7e44e15b7d3e55c671748d3" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 35565 } } peers { permanent_uuid: "243e9aadc9a5494fa5c49ad9050297e0" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 41863 } }
I20260812 00:01:51.751741 16305 raft_consensus.cc:374] T a66a8108e2fd42d38780d59fbaadb8ff P 0c90a6832042427d895ba4af46755543 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:01:51.751758 16305 raft_consensus.cc:729] T a66a8108e2fd42d38780d59fbaadb8ff P 0c90a6832042427d895ba4af46755543 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c90a6832042427d895ba4af46755543, State: Initialized, Role: FOLLOWER
I20260812 00:01:51.751799 16305 consensus_queue.cc:260] T a66a8108e2fd42d38780d59fbaadb8ff P 0c90a6832042427d895ba4af46755543 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c90a6832042427d895ba4af46755543" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 33327 } } peers { permanent_uuid: "4330d5ecb7e44e15b7d3e55c671748d3" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 35565 } } peers { permanent_uuid: "243e9aadc9a5494fa5c49ad9050297e0" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 41863 } }
I20260812 00:01:51.751883 16305 ts_tablet_manager.cc:1428] T a66a8108e2fd42d38780d59fbaadb8ff P 0c90a6832042427d895ba4af46755543: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:51.752246 16325 raft_consensus.cc:482] T a66a8108e2fd42d38780d59fbaadb8ff P 243e9aadc9a5494fa5c49ad9050297e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:01:51.752313 16325 raft_consensus.cc:504] T a66a8108e2fd42d38780d59fbaadb8ff P 243e9aadc9a5494fa5c49ad9050297e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c90a6832042427d895ba4af46755543" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 33327 } } peers { permanent_uuid: "4330d5ecb7e44e15b7d3e55c671748d3" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 35565 } } peers { permanent_uuid: "243e9aadc9a5494fa5c49ad9050297e0" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 41863 } }
I20260812 00:01:51.752434 16325 leader_election.cc:288] T a66a8108e2fd42d38780d59fbaadb8ff P 243e9aadc9a5494fa5c49ad9050297e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c90a6832042427d895ba4af46755543 (127.11.206.65:33327), 4330d5ecb7e44e15b7d3e55c671748d3 (127.11.206.66:35565)
I20260812 00:01:51.752547 15536 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a66a8108e2fd42d38780d59fbaadb8ff" candidate_uuid: "243e9aadc9a5494fa5c49ad9050297e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c90a6832042427d895ba4af46755543" is_pre_election: true
I20260812 00:01:51.752621 15536 raft_consensus.cc:2454] T a66a8108e2fd42d38780d59fbaadb8ff P 0c90a6832042427d895ba4af46755543 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 243e9aadc9a5494fa5c49ad9050297e0 in term 0.
I20260812 00:01:51.752641 15785 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a66a8108e2fd42d38780d59fbaadb8ff" candidate_uuid: "243e9aadc9a5494fa5c49ad9050297e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4330d5ecb7e44e15b7d3e55c671748d3" is_pre_election: true
I20260812 00:01:51.752719 15785 raft_consensus.cc:2454] T a66a8108e2fd42d38780d59fbaadb8ff P 4330d5ecb7e44e15b7d3e55c671748d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 243e9aadc9a5494fa5c49ad9050297e0 in term 0.
I20260812 00:01:51.752799 15900 leader_election.cc:302] T a66a8108e2fd42d38780d59fbaadb8ff P 243e9aadc9a5494fa5c49ad9050297e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c90a6832042427d895ba4af46755543, 243e9aadc9a5494fa5c49ad9050297e0; no voters:
I20260812 00:01:51.752892 16325 raft_consensus.cc:2781] T a66a8108e2fd42d38780d59fbaadb8ff P 243e9aadc9a5494fa5c49ad9050297e0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:01:51.752924 16325 raft_consensus.cc:482] T a66a8108e2fd42d38780d59fbaadb8ff P 243e9aadc9a5494fa5c49ad9050297e0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:01:51.752944 16325 raft_consensus.cc:3037] T a66a8108e2fd42d38780d59fbaadb8ff P 243e9aadc9a5494fa5c49ad9050297e0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:01:51.753456 16325 raft_consensus.cc:504] T a66a8108e2fd42d38780d59fbaadb8ff P 243e9aadc9a5494fa5c49ad9050297e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c90a6832042427d895ba4af46755543" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 33327 } } peers { permanent_uuid: "4330d5ecb7e44e15b7d3e55c671748d3" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 35565 } } peers { permanent_uuid: "243e9aadc9a5494fa5c49ad9050297e0" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 41863 } }
I20260812 00:01:51.753579 16325 leader_election.cc:288] T a66a8108e2fd42d38780d59fbaadb8ff P 243e9aadc9a5494fa5c49ad9050297e0 [CANDIDATE]: Term 1 election: Requested vote from peers 0c90a6832042427d895ba4af46755543 (127.11.206.65:33327), 4330d5ecb7e44e15b7d3e55c671748d3 (127.11.206.66:35565)
I20260812 00:01:51.753734 15536 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a66a8108e2fd42d38780d59fbaadb8ff" candidate_uuid: "243e9aadc9a5494fa5c49ad9050297e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c90a6832042427d895ba4af46755543"
I20260812 00:01:51.753804 15536 raft_consensus.cc:3037] T a66a8108e2fd42d38780d59fbaadb8ff P 0c90a6832042427d895ba4af46755543 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:01:51.753815 15785 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a66a8108e2fd42d38780d59fbaadb8ff" candidate_uuid: "243e9aadc9a5494fa5c49ad9050297e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4330d5ecb7e44e15b7d3e55c671748d3"
I20260812 00:01:51.753885 15785 raft_consensus.cc:3037] T a66a8108e2fd42d38780d59fbaadb8ff P 4330d5ecb7e44e15b7d3e55c671748d3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:01:51.754297 15536 raft_consensus.cc:2454] T a66a8108e2fd42d38780d59fbaadb8ff P 0c90a6832042427d895ba4af46755543 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 243e9aadc9a5494fa5c49ad9050297e0 in term 1.
I20260812 00:01:51.754446 15900 leader_election.cc:302] T a66a8108e2fd42d38780d59fbaadb8ff P 243e9aadc9a5494fa5c49ad9050297e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c90a6832042427d895ba4af46755543, 243e9aadc9a5494fa5c49ad9050297e0; no voters:
I20260812 00:01:51.754520 16325 raft_consensus.cc:2781] T a66a8108e2fd42d38780d59fbaadb8ff P 243e9aadc9a5494fa5c49ad9050297e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:01:51.754549 15785 raft_consensus.cc:2454] T a66a8108e2fd42d38780d59fbaadb8ff P 4330d5ecb7e44e15b7d3e55c671748d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 243e9aadc9a5494fa5c49ad9050297e0 in term 1.
I20260812 00:01:51.754566 16325 raft_consensus.cc:686] T a66a8108e2fd42d38780d59fbaadb8ff P 243e9aadc9a5494fa5c49ad9050297e0 [term 1 LEADER]: Becoming Leader. State: Replica: 243e9aadc9a5494fa5c49ad9050297e0, State: Running, Role: LEADER
I20260812 00:01:51.754602 16325 consensus_queue.cc:237] T a66a8108e2fd42d38780d59fbaadb8ff P 243e9aadc9a5494fa5c49ad9050297e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c90a6832042427d895ba4af46755543" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 33327 } } peers { permanent_uuid: "4330d5ecb7e44e15b7d3e55c671748d3" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 35565 } } peers { permanent_uuid: "243e9aadc9a5494fa5c49ad9050297e0" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 41863 } }
I20260812 00:01:51.755021 15292 catalog_manager.cc:5495] T a66a8108e2fd42d38780d59fbaadb8ff P 243e9aadc9a5494fa5c49ad9050297e0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 243e9aadc9a5494fa5c49ad9050297e0 (127.11.206.67). New cstate: current_term: 1 leader_uuid: "243e9aadc9a5494fa5c49ad9050297e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c90a6832042427d895ba4af46755543" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 33327 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4330d5ecb7e44e15b7d3e55c671748d3" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 35565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "243e9aadc9a5494fa5c49ad9050297e0" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 41863 } health_report { overall_health: HEALTHY } } }
I20260812 00:01:51.761888 15536 raft_consensus.cc:1261] T a66a8108e2fd42d38780d59fbaadb8ff P 0c90a6832042427d895ba4af46755543 [term 1 FOLLOWER]: Refusing update from remote peer 243e9aadc9a5494fa5c49ad9050297e0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:01:51.761888 15785 raft_consensus.cc:1261] T a66a8108e2fd42d38780d59fbaadb8ff P 4330d5ecb7e44e15b7d3e55c671748d3 [term 1 FOLLOWER]: Refusing update from remote peer 243e9aadc9a5494fa5c49ad9050297e0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:01:51.762112 16325 consensus_queue.cc:1035] T a66a8108e2fd42d38780d59fbaadb8ff P 243e9aadc9a5494fa5c49ad9050297e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4330d5ecb7e44e15b7d3e55c671748d3" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 35565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:01:51.762221 16316 consensus_queue.cc:1035] T a66a8108e2fd42d38780d59fbaadb8ff P 243e9aadc9a5494fa5c49ad9050297e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c90a6832042427d895ba4af46755543" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 33327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 00:01:51.766024 16242 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260812 00:01:53.284792 15292 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46708:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:01:53.284906 15292 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46708:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:01:53.285794 15292 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 86fa27d7db434987b0eecd62069fcf05: Sending DeleteTablet for 3 replicas of tablet a66a8108e2fd42d38780d59fbaadb8ff
I20260812 00:01:53.286056 15756 tablet_service.cc:1514] Processing DeleteTablet for tablet a66a8108e2fd42d38780d59fbaadb8ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:01:53 UTC) from {username='kudu', principal='kudu/127.11.206.126@KRBTEST.COM'} at 127.0.0.1:38606
I20260812 00:01:53.286067 15977 tablet_service.cc:1514] Processing DeleteTablet for tablet a66a8108e2fd42d38780d59fbaadb8ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:01:53 UTC) from {username='kudu', principal='kudu/127.11.206.126@KRBTEST.COM'} at 127.0.0.1:43678
I20260812 00:01:53.286077 15499 tablet_service.cc:1514] Processing DeleteTablet for tablet a66a8108e2fd42d38780d59fbaadb8ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:01:53 UTC) from {username='kudu', principal='kudu/127.11.206.126@KRBTEST.COM'} at 127.0.0.1:45684
I20260812 00:01:53.286260 16373 tablet_replica.cc:330] T a66a8108e2fd42d38780d59fbaadb8ff P 4330d5ecb7e44e15b7d3e55c671748d3: stopping tablet replica
I20260812 00:01:53.286244 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 15405
I20260812 00:01:53.286337 16373 raft_consensus.cc:2229] T a66a8108e2fd42d38780d59fbaadb8ff P 4330d5ecb7e44e15b7d3e55c671748d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:01:53.299671 16373 raft_consensus.cc:2258] T a66a8108e2fd42d38780d59fbaadb8ff P 4330d5ecb7e44e15b7d3e55c671748d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:01:53.303010 16373 ts_tablet_manager.cc:1905] T a66a8108e2fd42d38780d59fbaadb8ff P 4330d5ecb7e44e15b7d3e55c671748d3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:01:53.303364 16378 tablet_replica.cc:330] T a66a8108e2fd42d38780d59fbaadb8ff P 243e9aadc9a5494fa5c49ad9050297e0: stopping tablet replica
I20260812 00:01:53.303442 16378 raft_consensus.cc:2229] T a66a8108e2fd42d38780d59fbaadb8ff P 243e9aadc9a5494fa5c49ad9050297e0 [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:01:53.303516 16378 raft_consensus.cc:2258] T a66a8108e2fd42d38780d59fbaadb8ff P 243e9aadc9a5494fa5c49ad9050297e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:01:53.303869 16378 ts_tablet_manager.cc:1905] T a66a8108e2fd42d38780d59fbaadb8ff P 243e9aadc9a5494fa5c49ad9050297e0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:01:53.304679 16373 ts_tablet_manager.cc:1918] T a66a8108e2fd42d38780d59fbaadb8ff P 4330d5ecb7e44e15b7d3e55c671748d3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 00:01:53.304735 16373 log.cc:1196] T a66a8108e2fd42d38780d59fbaadb8ff P 4330d5ecb7e44e15b7d3e55c671748d3: Deleting WAL directory at /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/minicluster-data/ts-1/wal/wals/a66a8108e2fd42d38780d59fbaadb8ff
I20260812 00:01:53.304925 16373 ts_tablet_manager.cc:1939] T a66a8108e2fd42d38780d59fbaadb8ff P 4330d5ecb7e44e15b7d3e55c671748d3: Deleting consensus metadata
I20260812 00:01:53.305328 15264 catalog_manager.cc:4841] TS 4330d5ecb7e44e15b7d3e55c671748d3 (127.11.206.66:35565): tablet a66a8108e2fd42d38780d59fbaadb8ff (table test-table [id=b62f825b125242199965cd662c5fbb22]) successfully deleted
I20260812 00:01:53.305503 16378 ts_tablet_manager.cc:1918] T a66a8108e2fd42d38780d59fbaadb8ff P 243e9aadc9a5494fa5c49ad9050297e0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 00:01:53.305568 16378 log.cc:1196] T a66a8108e2fd42d38780d59fbaadb8ff P 243e9aadc9a5494fa5c49ad9050297e0: Deleting WAL directory at /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786492899949492-12089-0/minicluster-data/ts-2/wal/wals/a66a8108e2fd42d38780d59fbaadb8ff
I20260812 00:01:53.305773 16378 ts_tablet_manager.cc:1939] T a66a8108e2fd42d38780d59fbaadb8ff P 243e9aadc9a5494fa5c49ad9050297e0: Deleting consensus metadata
I20260812 00:01:53.306095 15264 catalog_manager.cc:4841] TS 243e9aadc9a5494fa5c49ad9050297e0 (127.11.206.67:41863): tablet a66a8108e2fd42d38780d59fbaadb8ff (table test-table [id=b62f825b125242199965cd662c5fbb22]) successfully deleted
W20260812 00:01:53.309587 15263 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.206.65:33327 (error 108)
I20260812 00:01:53.310164 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 15631
I20260812 00:01:53.310221 16381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:53.309981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.65:33327 (local address 127.0.0.1:45704)
0812 00:01:53.310127 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0812 00:01:53.310182 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.65:33327: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":91,"threads_started":1}
W20260812 00:01:53.313094 15263 catalog_manager.cc:4584] TS 0c90a6832042427d895ba4af46755543 (127.11.206.65:33327): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a66a8108e2fd42d38780d59fbaadb8ff: Network error: Client connection negotiation failed: client connection to 127.11.206.65:33327: connect: Connection refused (error 111)
I20260812 00:01:53.331043 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 15868
I20260812 00:01:53.347819 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 15234
2026-08-12T00:01:53Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (5918 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:01:53 dist-test-slave-f0tn krb5kdc[16385](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:01:53 dist-test-slave-f0tn krb5kdc[16385](info): set up 2 sockets
Aug 12 00:01:53 dist-test-slave-f0tn krb5kdc[16385](info): commencing operation
krb5kdc: starting...
W20260812 00:01:54.576758 12089 mini_kdc.cc:121] Time spent starting KDC: real 1.200s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/krb5kdc/test-user.keytab.
Aug 12 00:01:54 dist-test-slave-f0tn krb5kdc[16385](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492914, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:01:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:01:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.206.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab.
Entry for principal kudu/127.11.206.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab.
I20260812 00:01:54.691797 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:35033
--webserver_interface=127.11.206.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab
--principal=kudu/127.11.206.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:40091
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.206.126:35033
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:01:54.773064 16409 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:01:54.773291 16409 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:01:54.773322 16409 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:01:54.774490 16409 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:01:54.774533 16409 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:01:54.774552 16409 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:01:54.774569 16409 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:01:54.774585 16409 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:01:54.776048 16409 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:40091
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.206.126:35033
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab
--principal=kudu/127.11.206.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:35033
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.206.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16409
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:01:54.776311 16409 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:01:54.776523 16409 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:01:54.781540 16415 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:01:54.781545 16417 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:01:54.781545 16425 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:01:54.781563 16409 server_base.cc:1034] running on GCE node
I20260812 00:01:54.782032 16409 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:01:54.782313 16409 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:01:54.783448 16409 hybrid_clock.cc:648] HybridClock initialized: now 1786492914783439 us; error 29 us; skew 500 ppm
Aug 12 00:01:54 dist-test-slave-f0tn krb5kdc[16385](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492914, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:01:54.789511 16409 init.cc:377] Logged in from keytab as kudu/127.11.206.126@KRBTEST.COM (short username kudu)
I20260812 00:01:54.790016 16409 webserver.cc:460] Webserver started at http://127.11.206.126:46719/ using document root <none> and password file <none>
I20260812 00:01:54.790235 16409 fs_manager.cc:359] Metadata directory not provided
I20260812 00:01:54.790287 16409 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:01:54.790419 16409 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:01:54.791512 16409 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/minicluster-data/master-0/data/instance:
uuid: "69901d2de9c54ef4b6f4a23dd14e9d24"
format_stamp: "Formatted at 2026-08-12 00:01:54 on dist-test-slave-f0tn"
server_key: "fe2d4d7345a21272a2a4f0e0bf7a4798"
server_key_iv: "07897225fb36a36b64ba0d751e6842ac"
server_key_version: "encryptionkey@0"
I20260812 00:01:54.791864 16409 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/minicluster-data/master-0/wal/instance:
uuid: "69901d2de9c54ef4b6f4a23dd14e9d24"
format_stamp: "Formatted at 2026-08-12 00:01:54 on dist-test-slave-f0tn"
server_key: "fe2d4d7345a21272a2a4f0e0bf7a4798"
server_key_iv: "07897225fb36a36b64ba0d751e6842ac"
server_key_version: "encryptionkey@0"
I20260812 00:01:54.793165 16409 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:01:54.793965 16434 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:54.794188 16409 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260812 00:01:54.794288 16409 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/minicluster-data/master-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/minicluster-data/master-0/wal
uuid: "69901d2de9c54ef4b6f4a23dd14e9d24"
format_stamp: "Formatted at 2026-08-12 00:01:54 on dist-test-slave-f0tn"
server_key: "fe2d4d7345a21272a2a4f0e0bf7a4798"
server_key_iv: "07897225fb36a36b64ba0d751e6842ac"
server_key_version: "encryptionkey@0"
I20260812 00:01:54.794354 16409 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:01:54.823433 16409 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:01:54.825672 16409 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:01:54.825791 16409 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:01:54.829624 16409 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.126:35033
I20260812 00:01:54.829663 16519 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.126:35033 every 8 connection(s)
I20260812 00:01:54.829998 16409 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
I20260812 00:01:54.830914 16521 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:01:54.833182 16521 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 69901d2de9c54ef4b6f4a23dd14e9d24: Bootstrap starting.
I20260812 00:01:54.833784 16521 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 69901d2de9c54ef4b6f4a23dd14e9d24: Neither blocks nor log segments found. Creating new log.
I20260812 00:01:54.834033 16521 log.cc:824] T 00000000000000000000000000000000 P 69901d2de9c54ef4b6f4a23dd14e9d24: Log is configured to *not* fsync() on all Append() calls
I20260812 00:01:54.834790 16521 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 69901d2de9c54ef4b6f4a23dd14e9d24: No bootstrap required, opened a new log
I20260812 00:01:54.836372 16521 raft_consensus.cc:348] T 00000000000000000000000000000000 P 69901d2de9c54ef4b6f4a23dd14e9d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69901d2de9c54ef4b6f4a23dd14e9d24" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 35033 } }
I20260812 00:01:54.836517 16521 raft_consensus.cc:374] T 00000000000000000000000000000000 P 69901d2de9c54ef4b6f4a23dd14e9d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:01:54.836560 16521 raft_consensus.cc:729] T 00000000000000000000000000000000 P 69901d2de9c54ef4b6f4a23dd14e9d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69901d2de9c54ef4b6f4a23dd14e9d24, State: Initialized, Role: FOLLOWER
I20260812 00:01:54.836702 16521 consensus_queue.cc:260] T 00000000000000000000000000000000 P 69901d2de9c54ef4b6f4a23dd14e9d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69901d2de9c54ef4b6f4a23dd14e9d24" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 35033 } }
I20260812 00:01:54.836782 16521 raft_consensus.cc:388] T 00000000000000000000000000000000 P 69901d2de9c54ef4b6f4a23dd14e9d24 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:01:54.836823 16521 raft_consensus.cc:482] T 00000000000000000000000000000000 P 69901d2de9c54ef4b6f4a23dd14e9d24 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:01:54.836871 16521 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 69901d2de9c54ef4b6f4a23dd14e9d24 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:01:54.837162 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 16409
I20260812 00:01:54.837236 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/minicluster-data/master-0/wal/instance
I20260812 00:01:54.837446 12089 external_mini_cluster.cc:1428] Setting key d40767596f883858888edaca95506db2
I20260812 00:01:54.837448 16521 raft_consensus.cc:504] T 00000000000000000000000000000000 P 69901d2de9c54ef4b6f4a23dd14e9d24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69901d2de9c54ef4b6f4a23dd14e9d24" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 35033 } }
I20260812 00:01:54.837569 16521 leader_election.cc:302] T 00000000000000000000000000000000 P 69901d2de9c54ef4b6f4a23dd14e9d24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 69901d2de9c54ef4b6f4a23dd14e9d24; no voters:
I20260812 00:01:54.837739 16521 leader_election.cc:288] T 00000000000000000000000000000000 P 69901d2de9c54ef4b6f4a23dd14e9d24 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:01:54.837774 16524 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 69901d2de9c54ef4b6f4a23dd14e9d24 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:01:54.838075 16521 sys_catalog.cc:564] T 00000000000000000000000000000000 P 69901d2de9c54ef4b6f4a23dd14e9d24 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:01:54.838152 16524 raft_consensus.cc:686] T 00000000000000000000000000000000 P 69901d2de9c54ef4b6f4a23dd14e9d24 [term 1 LEADER]: Becoming Leader. State: Replica: 69901d2de9c54ef4b6f4a23dd14e9d24, State: Running, Role: LEADER
I20260812 00:01:54.838246 16524 consensus_queue.cc:237] T 00000000000000000000000000000000 P 69901d2de9c54ef4b6f4a23dd14e9d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69901d2de9c54ef4b6f4a23dd14e9d24" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 35033 } }
I20260812 00:01:54.838565 16524 sys_catalog.cc:455] T 00000000000000000000000000000000 P 69901d2de9c54ef4b6f4a23dd14e9d24 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 69901d2de9c54ef4b6f4a23dd14e9d24. Latest consensus state: current_term: 1 leader_uuid: "69901d2de9c54ef4b6f4a23dd14e9d24" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69901d2de9c54ef4b6f4a23dd14e9d24" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 35033 } } }
I20260812 00:01:54.838652 16525 sys_catalog.cc:455] T 00000000000000000000000000000000 P 69901d2de9c54ef4b6f4a23dd14e9d24 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "69901d2de9c54ef4b6f4a23dd14e9d24" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69901d2de9c54ef4b6f4a23dd14e9d24" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 35033 } } }
I20260812 00:01:54.838804 16525 sys_catalog.cc:458] T 00000000000000000000000000000000 P 69901d2de9c54ef4b6f4a23dd14e9d24 [sys.catalog]: This master's current role is: LEADER
I20260812 00:01:54.838663 16524 sys_catalog.cc:458] T 00000000000000000000000000000000 P 69901d2de9c54ef4b6f4a23dd14e9d24 [sys.catalog]: This master's current role is: LEADER
I20260812 00:01:54.839201 16534 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:01:54.839776 16534 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:01:54.841655 16534 catalog_manager.cc:1347] Generated new cluster ID: 7390e5b7ab704ffaa2d85b1707828e92
I20260812 00:01:54.841706 16534 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 00:01:54 dist-test-slave-f0tn krb5kdc[16385](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492914, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:01:54.849726 16527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:54.837912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48082 (local address 127.11.206.126:35033)
0812 00:01:54.838741 (+ 829us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:54.838751 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:54.838786 (+ 35us) server_negotiation.cc:407] Connection header received
0812 00:01:54.838903 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:54.838911 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:54.838971 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:54.839840 (+ 869us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:01:54.839954 (+ 114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:54.840882 (+ 928us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:54.841977 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:54.842578 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:54.842666 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:54.845364 (+ 2698us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:01:54.845369 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:01:54.845369 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:01:54.845422 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:01:54.848094 (+ 2672us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:54.848449 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:54.848453 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:54.848453 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:54.848580 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:54.848762 (+ 182us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:54.848763 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:54.848763 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:54.849082 (+ 319us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:01:54.849235 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:54.849309 (+ 74us) server_negotiation.cc:299] Negotiation successful
0812 00:01:54.849491 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":779,"thread_start_us":65,"threads_started":1}
I20260812 00:01:54.865312 16534 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:01:54.866098 16534 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:01:54.870577 16534 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 69901d2de9c54ef4b6f4a23dd14e9d24: Generated new TSK 0
I20260812 00:01:54.870779 16534 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.206.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.65.keytab.
Entry for principal kudu/127.11.206.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.65.keytab.
I20260812 00:01:54.900183 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.65:0
--local_ip_for_outbound_sockets=127.11.206.65
--webserver_interface=127.11.206.65
--webserver_port=0
--tserver_master_addrs=127.11.206.126:35033
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.65.keytab
--principal=kudu/127.11.206.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:40091
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:01:54.980618 16558 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:01:54.980823 16558 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:01:54.980845 16558 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:01:54.982002 16558 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:01:54.982039 16558 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:01:54.982064 16558 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.65
I20260812 00:01:54.983474 16558 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:40091
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.65.keytab
--principal=kudu/127.11.206.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.206.65
--webserver_port=0
--tserver_master_addrs=127.11.206.126:35033
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16558
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.65
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:01:54.983678 16558 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:01:54.983868 16558 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:01:54.988855 16565 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:01:54.988881 16568 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:01:54.988870 16570 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:01:54.989132 16558 server_base.cc:1034] running on GCE node
I20260812 00:01:54.989316 16558 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:01:54.989573 16558 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:01:54.990741 16558 hybrid_clock.cc:648] HybridClock initialized: now 1786492914990724 us; error 32 us; skew 500 ppm
Aug 12 00:01:54 dist-test-slave-f0tn krb5kdc[16385](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492914, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:01:54.993180 16558 init.cc:377] Logged in from keytab as kudu/127.11.206.65@KRBTEST.COM (short username kudu)
I20260812 00:01:54.993641 16558 webserver.cc:460] Webserver started at http://127.11.206.65:33227/ using document root <none> and password file <none>
I20260812 00:01:54.993870 16558 fs_manager.cc:359] Metadata directory not provided
I20260812 00:01:54.993918 16558 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:01:54.994043 16558 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:01:54.995119 16558 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-0/data/instance:
uuid: "bce7ee93dd9c489388e40b8d6c0971f4"
format_stamp: "Formatted at 2026-08-12 00:01:54 on dist-test-slave-f0tn"
server_key: "92348db50fe56c993431dad59c99e098"
server_key_iv: "15b5b02cb50e1bca5b48d5e576dd76e7"
server_key_version: "encryptionkey@0"
I20260812 00:01:54.995507 16558 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-0/wal/instance:
uuid: "bce7ee93dd9c489388e40b8d6c0971f4"
format_stamp: "Formatted at 2026-08-12 00:01:54 on dist-test-slave-f0tn"
server_key: "92348db50fe56c993431dad59c99e098"
server_key_iv: "15b5b02cb50e1bca5b48d5e576dd76e7"
server_key_version: "encryptionkey@0"
I20260812 00:01:54.996748 16558 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:01:54.997462 16580 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:54.997622 16558 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:01:54.997707 16558 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-0/wal
uuid: "bce7ee93dd9c489388e40b8d6c0971f4"
format_stamp: "Formatted at 2026-08-12 00:01:54 on dist-test-slave-f0tn"
server_key: "92348db50fe56c993431dad59c99e098"
server_key_iv: "15b5b02cb50e1bca5b48d5e576dd76e7"
server_key_version: "encryptionkey@0"
I20260812 00:01:54.997768 16558 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:01:55.010870 16558 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:01:55.012807 16558 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:01:55.012944 16558 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:01:55.013177 16558 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:01:55.013563 16558 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:01:55.013607 16558 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:55.013638 16558 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:01:55.013655 16558 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:55.019178 16558 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.65:32973
I20260812 00:01:55.019209 16776 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.65:32973 every 8 connection(s)
I20260812 00:01:55.019531 16558 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
I20260812 00:01:55.024889 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 16558
I20260812 00:01:55.024981 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-0/wal/instance
I20260812 00:01:55.025172 12089 external_mini_cluster.cc:1428] Setting key b81ea79f25cf46b31e1bf0ffb6b3cab2
Aug 12 00:01:55 dist-test-slave-f0tn krb5kdc[16385](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492914, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.65@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:01:55.028916 16527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:55.020285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.65:55491 (local address 127.11.206.126:35033)
0812 00:01:55.020337 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:55.020339 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:55.020545 (+ 206us) server_negotiation.cc:407] Connection header received
0812 00:01:55.021032 (+ 487us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:55.021033 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:55.021047 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:55.021103 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:01:55.022097 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:55.022603 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:55.023618 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:55.023803 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:55.023849 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:55.026081 (+ 2232us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:01:55.026106 (+ 25us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:01:55.026106 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:01:55.026113 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:01:55.027480 (+ 1367us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:55.027939 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:55.027940 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:55.027940 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:55.027987 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:55.028258 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:55.028260 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:55.028260 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:55.028384 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:01:55.028447 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:55.028757 (+ 310us) server_negotiation.cc:299] Negotiation successful
0812 00:01:55.028850 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 00:01:55.029120 16781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:55.020265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:35033 (local address 127.11.206.65:55491)
0812 00:01:55.020427 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0812 00:01:55.020465 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 00:01:55.020944 (+ 479us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:01:55.021178 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:01:55.021182 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:01:55.021821 (+ 639us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:01:55.022020 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:55.022026 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:55.022667 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:55.022668 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:55.023553 (+ 885us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:55.023556 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:55.023860 (+ 304us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:55.023860 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:55.023957 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:55.024402 (+ 445us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:01:55.024410 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:01:55.025991 (+ 1581us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:01:55.027555 (+ 1564us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:01:55.027562 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:01:55.027565 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:01:55.027870 (+ 305us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:01:55.028037 (+ 167us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:01:55.028038 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:01:55.028038 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:01:55.028170 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:01:55.028452 (+ 282us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:01:55.028459 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:01:55.028618 (+ 159us) client_negotiation.cc:769] Sending connection context
0812 00:01:55.028739 (+ 121us) client_negotiation.cc:240] Negotiation successful
0812 00:01:55.028900 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":81,"threads_started":1}
I20260812 00:01:55.029618 16778 heartbeater.cc:347] Connected to a master server at 127.11.206.126:35033
I20260812 00:01:55.029711 16778 heartbeater.cc:464] Registering TS with master...
I20260812 00:01:55.029871 16778 heartbeater.cc:511] Master 127.11.206.126:35033 requested a full tablet report, sending...
I20260812 00:01:55.030457 16463 ts_manager.cc:194] Registered new tserver with Master: bce7ee93dd9c489388e40b8d6c0971f4 (127.11.206.65:32973)
I20260812 00:01:55.031365 16463 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.206.65@KRBTEST.COM'} at 127.11.206.65:55491
WARNING: no policy specified for kudu/127.11.206.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.66.keytab.
Entry for principal kudu/127.11.206.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.66.keytab.
I20260812 00:01:55.049998 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.66:0
--local_ip_for_outbound_sockets=127.11.206.66
--webserver_interface=127.11.206.66
--webserver_port=0
--tserver_master_addrs=127.11.206.126:35033
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.66.keytab
--principal=kudu/127.11.206.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:40091
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:01:55.131176 16791 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:01:55.131378 16791 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:01:55.131402 16791 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:01:55.132515 16791 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:01:55.132548 16791 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:01:55.132572 16791 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.66
I20260812 00:01:55.133976 16791 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:40091
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.66.keytab
--principal=kudu/127.11.206.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.206.66
--webserver_port=0
--tserver_master_addrs=127.11.206.126:35033
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16791
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.66
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:01:55.134178 16791 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:01:55.134366 16791 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:01:55.139328 16798 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:01:55.139318 16802 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:01:55.139411 16797 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:01:55.139591 16791 server_base.cc:1034] running on GCE node
I20260812 00:01:55.139806 16791 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:01:55.140049 16791 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:01:55.141208 16791 hybrid_clock.cc:648] HybridClock initialized: now 1786492915141178 us; error 43 us; skew 500 ppm
Aug 12 00:01:55 dist-test-slave-f0tn krb5kdc[16385](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492915, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:01:55.143675 16791 init.cc:377] Logged in from keytab as kudu/127.11.206.66@KRBTEST.COM (short username kudu)
I20260812 00:01:55.144160 16791 webserver.cc:460] Webserver started at http://127.11.206.66:37645/ using document root <none> and password file <none>
I20260812 00:01:55.144379 16791 fs_manager.cc:359] Metadata directory not provided
I20260812 00:01:55.144428 16791 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:01:55.144557 16791 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:01:55.145689 16791 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-1/data/instance:
uuid: "e436548b9ebc47feb5ea6d7f3b250441"
format_stamp: "Formatted at 2026-08-12 00:01:55 on dist-test-slave-f0tn"
server_key: "1b2478d826331920e878cba9253441ca"
server_key_iv: "df0b4f878f9bfb0aec8778c72ed8373e"
server_key_version: "encryptionkey@0"
I20260812 00:01:55.146014 16791 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-1/wal/instance:
uuid: "e436548b9ebc47feb5ea6d7f3b250441"
format_stamp: "Formatted at 2026-08-12 00:01:55 on dist-test-slave-f0tn"
server_key: "1b2478d826331920e878cba9253441ca"
server_key_iv: "df0b4f878f9bfb0aec8778c72ed8373e"
server_key_version: "encryptionkey@0"
I20260812 00:01:55.147245 16791 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260812 00:01:55.147980 16811 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:55.148218 16791 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260812 00:01:55.148322 16791 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-1/wal
uuid: "e436548b9ebc47feb5ea6d7f3b250441"
format_stamp: "Formatted at 2026-08-12 00:01:55 on dist-test-slave-f0tn"
server_key: "1b2478d826331920e878cba9253441ca"
server_key_iv: "df0b4f878f9bfb0aec8778c72ed8373e"
server_key_version: "encryptionkey@0"
I20260812 00:01:55.148394 16791 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:01:55.166992 16791 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:01:55.168968 16791 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:01:55.169122 16791 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:01:55.169348 16791 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:01:55.169697 16791 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:01:55.169739 16791 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:55.169768 16791 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:01:55.169785 16791 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:55.175261 16791 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.66:37577
I20260812 00:01:55.175305 17008 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.66:37577 every 8 connection(s)
I20260812 00:01:55.175606 16791 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
Aug 12 00:01:55 dist-test-slave-f0tn krb5kdc[16385](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492915, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.66@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:01:55.184204 16527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:55.176305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.66:57515 (local address 127.11.206.126:35033)
0812 00:01:55.176360 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:55.176361 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:55.176547 (+ 186us) server_negotiation.cc:407] Connection header received
0812 00:01:55.177070 (+ 523us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:55.177072 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:55.177093 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:55.177142 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:01:55.178180 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:55.178689 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:55.179680 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:55.179879 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:55.179935 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:55.181994 (+ 2059us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:01:55.181995 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:01:55.181996 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:01:55.182003 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:01:55.183116 (+ 1113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:55.183466 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:55.183467 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:55.183467 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:55.183512 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:55.183690 (+ 178us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:55.183691 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:55.183691 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:55.183786 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:01:55.183831 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:55.184047 (+ 216us) server_negotiation.cc:299] Negotiation successful
0812 00:01:55.184137 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260812 00:01:55.184340 17013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:55.176275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:35033 (local address 127.11.206.66:57515)
0812 00:01:55.176434 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0812 00:01:55.176472 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 00:01:55.176959 (+ 487us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:01:55.177227 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:01:55.177231 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:01:55.177861 (+ 630us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:01:55.178080 (+ 219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:55.178087 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:55.178776 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:55.178777 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:55.179600 (+ 823us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:55.179602 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:55.179948 (+ 346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:55.179948 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:55.180096 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:55.180519 (+ 423us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:01:55.180527 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:01:55.181901 (+ 1374us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:01:55.183184 (+ 1283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:01:55.183190 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:01:55.183192 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:01:55.183410 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:01:55.183555 (+ 145us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:01:55.183556 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:01:55.183556 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:01:55.183649 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:01:55.183830 (+ 181us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:01:55.183833 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:01:55.183951 (+ 118us) client_negotiation.cc:769] Sending connection context
0812 00:01:55.184033 (+ 82us) client_negotiation.cc:240] Negotiation successful
0812 00:01:55.184161 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":76,"threads_started":1}
I20260812 00:01:55.184839 17010 heartbeater.cc:347] Connected to a master server at 127.11.206.126:35033
I20260812 00:01:55.184931 17010 heartbeater.cc:464] Registering TS with master...
I20260812 00:01:55.185114 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 16791
I20260812 00:01:55.185127 17010 heartbeater.cc:511] Master 127.11.206.126:35033 requested a full tablet report, sending...
I20260812 00:01:55.185195 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-1/wal/instance
I20260812 00:01:55.185424 12089 external_mini_cluster.cc:1428] Setting key 310e52f20c19330ac252e1830f1e6be0
I20260812 00:01:55.185640 16463 ts_manager.cc:194] Registered new tserver with Master: e436548b9ebc47feb5ea6d7f3b250441 (127.11.206.66:37577)
I20260812 00:01:55.186115 16463 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.206.66@KRBTEST.COM'} at 127.11.206.66:57515
WARNING: no policy specified for kudu/127.11.206.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.67.keytab.
Entry for principal kudu/127.11.206.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.67.keytab.
I20260812 00:01:55.209967 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.67:0
--local_ip_for_outbound_sockets=127.11.206.67
--webserver_interface=127.11.206.67
--webserver_port=0
--tserver_master_addrs=127.11.206.126:35033
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.67.keytab
--principal=kudu/127.11.206.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:40091
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:01:55.291380 17018 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:01:55.291600 17018 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:01:55.291622 17018 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:01:55.292704 17018 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:01:55.292737 17018 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:01:55.292760 17018 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.67
I20260812 00:01:55.294225 17018 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:40091
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.67.keytab
--principal=kudu/127.11.206.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.206.67
--webserver_port=0
--tserver_master_addrs=127.11.206.126:35033
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17018
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.67
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:01:55.294416 17018 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:01:55.294610 17018 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:01:55.299628 17027 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:01:55.299660 17030 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:01:55.299587 17028 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:01:55.299746 17018 server_base.cc:1034] running on GCE node
I20260812 00:01:55.299916 17018 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:01:55.300127 17018 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:01:55.301265 17018 hybrid_clock.cc:648] HybridClock initialized: now 1786492915301253 us; error 28 us; skew 500 ppm
Aug 12 00:01:55 dist-test-slave-f0tn krb5kdc[16385](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492915, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:01:55.303695 17018 init.cc:377] Logged in from keytab as kudu/127.11.206.67@KRBTEST.COM (short username kudu)
I20260812 00:01:55.304137 17018 webserver.cc:460] Webserver started at http://127.11.206.67:33731/ using document root <none> and password file <none>
I20260812 00:01:55.304333 17018 fs_manager.cc:359] Metadata directory not provided
I20260812 00:01:55.304376 17018 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:01:55.304507 17018 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:01:55.305550 17018 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-2/data/instance:
uuid: "3c7596c047214062ad342623f6187c06"
format_stamp: "Formatted at 2026-08-12 00:01:55 on dist-test-slave-f0tn"
server_key: "f7ec009a17b07c0b2a202e2b85787348"
server_key_iv: "396cb2baa02d864fb0c9fbc57966b6fc"
server_key_version: "encryptionkey@0"
I20260812 00:01:55.305877 17018 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-2/wal/instance:
uuid: "3c7596c047214062ad342623f6187c06"
format_stamp: "Formatted at 2026-08-12 00:01:55 on dist-test-slave-f0tn"
server_key: "f7ec009a17b07c0b2a202e2b85787348"
server_key_iv: "396cb2baa02d864fb0c9fbc57966b6fc"
server_key_version: "encryptionkey@0"
I20260812 00:01:55.307142 17018 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:01:55.307808 17041 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:55.307962 17018 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:01:55.308043 17018 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-2/wal
uuid: "3c7596c047214062ad342623f6187c06"
format_stamp: "Formatted at 2026-08-12 00:01:55 on dist-test-slave-f0tn"
server_key: "f7ec009a17b07c0b2a202e2b85787348"
server_key_iv: "396cb2baa02d864fb0c9fbc57966b6fc"
server_key_version: "encryptionkey@0"
I20260812 00:01:55.308133 17018 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:01:55.331022 17018 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:01:55.333184 17018 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:01:55.333314 17018 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:01:55.333587 17018 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:01:55.333900 17018 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:01:55.333936 17018 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:55.333958 17018 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:01:55.333969 17018 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:55.340098 17018 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.67:37149
I20260812 00:01:55.340139 17231 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.67:37149 every 8 connection(s)
I20260812 00:01:55.340492 17018 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
I20260812 00:01:55.345148 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 17018
I20260812 00:01:55.345252 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-2/wal/instance
I20260812 00:01:55.345510 12089 external_mini_cluster.cc:1428] Setting key ddc62ab03d9a5621000a0401af525962
Aug 12 00:01:55 dist-test-slave-f0tn krb5kdc[16385](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492915, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.67@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:01:55.349365 16527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:55.341229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.67:38895 (local address 127.11.206.126:35033)
0812 00:01:55.341293 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:55.341295 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:55.341545 (+ 250us) server_negotiation.cc:407] Connection header received
0812 00:01:55.342051 (+ 506us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:55.342053 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:55.342065 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:55.342119 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:01:55.343044 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:55.343547 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:55.344578 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:55.344768 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:55.344818 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:55.347185 (+ 2367us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:01:55.347186 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:01:55.347186 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:01:55.347193 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:01:55.348293 (+ 1100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:55.348670 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:55.348670 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:55.348671 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:55.348716 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:55.348885 (+ 169us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:55.348886 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:55.348886 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:55.348980 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:01:55.349026 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:55.349241 (+ 215us) server_negotiation.cc:299] Negotiation successful
0812 00:01:55.349300 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260812 00:01:55.349623 17234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:55.341216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:35033 (local address 127.11.206.67:38895)
0812 00:01:55.341409 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0812 00:01:55.341462 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0812 00:01:55.341956 (+ 494us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:01:55.342181 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:01:55.342184 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:01:55.342752 (+ 568us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:01:55.342953 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:55.342957 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:55.343621 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:55.343622 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:55.344494 (+ 872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:55.344498 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:55.344827 (+ 329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:55.344828 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:55.344929 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:55.345593 (+ 664us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:01:55.345604 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:01:55.347109 (+ 1505us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:01:55.348372 (+ 1263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:01:55.348378 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:01:55.348380 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:01:55.348614 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:01:55.348755 (+ 141us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:01:55.348756 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:01:55.348756 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:01:55.348847 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:01:55.349023 (+ 176us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:01:55.349026 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:01:55.349144 (+ 118us) client_negotiation.cc:769] Sending connection context
0812 00:01:55.349221 (+ 77us) client_negotiation.cc:240] Negotiation successful
0812 00:01:55.349339 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":94,"threads_started":1}
I20260812 00:01:55.350026 17232 heartbeater.cc:347] Connected to a master server at 127.11.206.126:35033
I20260812 00:01:55.350122 17232 heartbeater.cc:464] Registering TS with master...
I20260812 00:01:55.350274 17232 heartbeater.cc:511] Master 127.11.206.126:35033 requested a full tablet report, sending...
I20260812 00:01:55.350682 16463 ts_manager.cc:194] Registered new tserver with Master: 3c7596c047214062ad342623f6187c06 (127.11.206.67:37149)
I20260812 00:01:55.351063 16463 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.206.67@KRBTEST.COM'} at 127.11.206.67:38895
I20260812 00:01:55.357354 12089 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260812 00:01:55.369104 16527 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:01:55.368309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48088 (local address 127.11.206.126:35033)
0812 00:01:55.368365 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:55.368367 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:55.368448 (+ 81us) server_negotiation.cc:407] Connection header received
0812 00:01:55.368502 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:55.368503 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:55.368512 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:55.368568 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:01:55.369045 (+ 477us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48088: BlockingRecv error: recv got EOF from 127.0.0.1:48088 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
I20260812 00:01:55.370535 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 16558
I20260812 00:01:55.380952 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 16791
I20260812 00:01:55.388002 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 17018
I20260812 00:01:55.429409 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 16409
2026-08-12T00:01:55Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (2091 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786492899949492-12089-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:01:55 dist-test-slave-f0tn krb5kdc[17248](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:01:55 dist-test-slave-f0tn krb5kdc[17248](info): set up 2 sockets
Aug 12 00:01:55 dist-test-slave-f0tn krb5kdc[17248](info): commencing operation
krb5kdc: starting...
W20260812 00:01:56.646687 12089 mini_kdc.cc:121] Time spent starting KDC: real 1.178s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
W20260812 00:01:56.861698 12089 mini_kdc.cc:253] Time spent creating user principal test-admin: real 0.215s user 0.000s sys 0.002s
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
W20260812 00:01:57.029014 12089 mini_kdc.cc:253] Time spent creating user principal test-user: real 0.167s user 0.000s sys 0.002s
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
W20260812 00:01:57.165198 12089 mini_kdc.cc:253] Time spent creating user principal joe-interloper: real 0.136s user 0.000s sys 0.002s
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786492899949492-12089-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786492899949492-12089-0/krb5kdc/test-user.keytab.
W20260812 00:01:57.934710 12089 mini_kdc.cc:302] Time spent creating keytab for test-user: real 0.769s user 0.000s sys 0.002s
Aug 12 00:01:57 dist-test-slave-f0tn krb5kdc[17248](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492917, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:01:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:01:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.206.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab.
Entry for principal kudu/127.11.206.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab.
W20260812 00:01:58.097519 12089 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.11.206.126: real 0.139s user 0.000s sys 0.003s
I20260812 00:01:58.097884 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786492899949492-12089-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786492899949492-12089-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786492899949492-12089-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:45475
--webserver_interface=127.11.206.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab
--principal=kudu/127.11.206.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:33559
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.206.126:45475
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:01:58.182366 17267 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:01:58.182588 17267 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:01:58.182610 17267 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:01:58.183799 17267 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:01:58.183847 17267 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:01:58.183861 17267 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:01:58.183872 17267 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:01:58.183883 17267 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:01:58.185474 17267 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:33559
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786492899949492-12089-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786492899949492-12089-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.206.126:45475
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab
--principal=kudu/127.11.206.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:45475
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.206.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17267
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786492899949492-12089-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:01:58.185729 17267 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:01:58.185950 17267 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:01:58.190850 17273 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:01:58.190856 17280 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:01:58.190855 17277 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:01:58.190927 17267 server_base.cc:1034] running on GCE node
I20260812 00:01:58.191253 17267 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:01:58.191592 17267 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:01:58.192771 17267 hybrid_clock.cc:648] HybridClock initialized: now 1786492918192750 us; error 37 us; skew 500 ppm
Aug 12 00:01:58 dist-test-slave-f0tn krb5kdc[17248](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492918, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:01:58.195466 17267 init.cc:377] Logged in from keytab as kudu/127.11.206.126@KRBTEST.COM (short username kudu)
I20260812 00:01:58.195909 17267 webserver.cc:460] Webserver started at http://127.11.206.126:39717/ using document root <none> and password file <none>
I20260812 00:01:58.196178 17267 fs_manager.cc:359] Metadata directory not provided
I20260812 00:01:58.196231 17267 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:01:58.196358 17267 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:01:58.197467 17267 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786492899949492-12089-0/minicluster-data/master-0/data/instance:
uuid: "f6d7ba43b7e84d5ca76d856ee0e2db39"
format_stamp: "Formatted at 2026-08-12 00:01:58 on dist-test-slave-f0tn"
server_key: "72c2199220aabe34da16bf09dc55468c"
server_key_iv: "4df757f94a37c71291afadc810b8d750"
server_key_version: "encryptionkey@0"
I20260812 00:01:58.197824 17267 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786492899949492-12089-0/minicluster-data/master-0/wal/instance:
uuid: "f6d7ba43b7e84d5ca76d856ee0e2db39"
format_stamp: "Formatted at 2026-08-12 00:01:58 on dist-test-slave-f0tn"
server_key: "72c2199220aabe34da16bf09dc55468c"
server_key_iv: "4df757f94a37c71291afadc810b8d750"
server_key_version: "encryptionkey@0"
I20260812 00:01:58.199242 17267 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 00:01:58.200109 17289 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:58.200286 17267 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 00:01:58.200380 17267 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786492899949492-12089-0/minicluster-data/master-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786492899949492-12089-0/minicluster-data/master-0/wal
uuid: "f6d7ba43b7e84d5ca76d856ee0e2db39"
format_stamp: "Formatted at 2026-08-12 00:01:58 on dist-test-slave-f0tn"
server_key: "72c2199220aabe34da16bf09dc55468c"
server_key_iv: "4df757f94a37c71291afadc810b8d750"
server_key_version: "encryptionkey@0"
I20260812 00:01:58.200448 17267 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786492899949492-12089-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786492899949492-12089-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786492899949492-12089-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:01:58.221644 17267 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:01:58.223963 17267 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:01:58.224114 17267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:01:58.227990 17267 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.126:45475
I20260812 00:01:58.228034 17396 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.126:45475 every 8 connection(s)
I20260812 00:01:58.228505 17267 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
I20260812 00:01:58.229202 17399 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:01:58.231572 17399 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f6d7ba43b7e84d5ca76d856ee0e2db39: Bootstrap starting.
I20260812 00:01:58.232136 17399 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f6d7ba43b7e84d5ca76d856ee0e2db39: Neither blocks nor log segments found. Creating new log.
I20260812 00:01:58.232381 17399 log.cc:824] T 00000000000000000000000000000000 P f6d7ba43b7e84d5ca76d856ee0e2db39: Log is configured to *not* fsync() on all Append() calls
I20260812 00:01:58.233116 17399 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f6d7ba43b7e84d5ca76d856ee0e2db39: No bootstrap required, opened a new log
I20260812 00:01:58.233670 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 17267
I20260812 00:01:58.233757 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786492899949492-12089-0/minicluster-data/master-0/wal/instance
I20260812 00:01:58.233915 12089 external_mini_cluster.cc:1428] Setting key 58e833b80a80941ef03c9523f67f6ca6
I20260812 00:01:58.235509 17399 raft_consensus.cc:348] T 00000000000000000000000000000000 P f6d7ba43b7e84d5ca76d856ee0e2db39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6d7ba43b7e84d5ca76d856ee0e2db39" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 45475 } }
I20260812 00:01:58.235656 17399 raft_consensus.cc:374] T 00000000000000000000000000000000 P f6d7ba43b7e84d5ca76d856ee0e2db39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:01:58.235689 17399 raft_consensus.cc:729] T 00000000000000000000000000000000 P f6d7ba43b7e84d5ca76d856ee0e2db39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6d7ba43b7e84d5ca76d856ee0e2db39, State: Initialized, Role: FOLLOWER
I20260812 00:01:58.235853 17399 consensus_queue.cc:260] T 00000000000000000000000000000000 P f6d7ba43b7e84d5ca76d856ee0e2db39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6d7ba43b7e84d5ca76d856ee0e2db39" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 45475 } }
I20260812 00:01:58.235925 17399 raft_consensus.cc:388] T 00000000000000000000000000000000 P f6d7ba43b7e84d5ca76d856ee0e2db39 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:01:58.235956 17399 raft_consensus.cc:482] T 00000000000000000000000000000000 P f6d7ba43b7e84d5ca76d856ee0e2db39 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:01:58.236006 17399 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f6d7ba43b7e84d5ca76d856ee0e2db39 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:01:58.236544 17399 raft_consensus.cc:504] T 00000000000000000000000000000000 P f6d7ba43b7e84d5ca76d856ee0e2db39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6d7ba43b7e84d5ca76d856ee0e2db39" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 45475 } }
I20260812 00:01:58.236645 17399 leader_election.cc:302] T 00000000000000000000000000000000 P f6d7ba43b7e84d5ca76d856ee0e2db39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f6d7ba43b7e84d5ca76d856ee0e2db39; no voters:
I20260812 00:01:58.236800 17399 leader_election.cc:288] T 00000000000000000000000000000000 P f6d7ba43b7e84d5ca76d856ee0e2db39 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:01:58.236845 17412 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f6d7ba43b7e84d5ca76d856ee0e2db39 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:01:58.236986 17412 raft_consensus.cc:686] T 00000000000000000000000000000000 P f6d7ba43b7e84d5ca76d856ee0e2db39 [term 1 LEADER]: Becoming Leader. State: Replica: f6d7ba43b7e84d5ca76d856ee0e2db39, State: Running, Role: LEADER
I20260812 00:01:58.237093 17399 sys_catalog.cc:564] T 00000000000000000000000000000000 P f6d7ba43b7e84d5ca76d856ee0e2db39 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:01:58.237125 17412 consensus_queue.cc:237] T 00000000000000000000000000000000 P f6d7ba43b7e84d5ca76d856ee0e2db39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6d7ba43b7e84d5ca76d856ee0e2db39" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 45475 } }
I20260812 00:01:58.237592 17414 sys_catalog.cc:455] T 00000000000000000000000000000000 P f6d7ba43b7e84d5ca76d856ee0e2db39 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f6d7ba43b7e84d5ca76d856ee0e2db39" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6d7ba43b7e84d5ca76d856ee0e2db39" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 45475 } } }
I20260812 00:01:58.237676 17414 sys_catalog.cc:458] T 00000000000000000000000000000000 P f6d7ba43b7e84d5ca76d856ee0e2db39 [sys.catalog]: This master's current role is: LEADER
I20260812 00:01:58.237826 17413 sys_catalog.cc:455] T 00000000000000000000000000000000 P f6d7ba43b7e84d5ca76d856ee0e2db39 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f6d7ba43b7e84d5ca76d856ee0e2db39. Latest consensus state: current_term: 1 leader_uuid: "f6d7ba43b7e84d5ca76d856ee0e2db39" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6d7ba43b7e84d5ca76d856ee0e2db39" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 45475 } } }
I20260812 00:01:58.237879 17413 sys_catalog.cc:458] T 00000000000000000000000000000000 P f6d7ba43b7e84d5ca76d856ee0e2db39 [sys.catalog]: This master's current role is: LEADER
I20260812 00:01:58.238293 17431 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:01:58.238845 17431 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:01:58.240365 17431 catalog_manager.cc:1347] Generated new cluster ID: c1239c4f10a7454b9ed83ff478e3810b
I20260812 00:01:58.240417 17431 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 00:01:58 dist-test-slave-f0tn krb5kdc[17248](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492917, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:01:58.245923 17404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:58.234480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41866 (local address 127.11.206.126:45475)
0812 00:01:58.234661 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:58.234669 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:58.234717 (+ 48us) server_negotiation.cc:407] Connection header received
0812 00:01:58.235504 (+ 787us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:58.235513 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:58.235583 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:58.235738 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:01:58.236467 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:58.237802 (+ 1335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:58.238806 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:58.239420 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:58.239521 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:58.242366 (+ 2845us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:01:58.242371 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:01:58.242371 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:01:58.242383 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:01:58.244272 (+ 1889us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:58.244701 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:58.244704 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:58.244704 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:58.244820 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:58.245009 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:58.245009 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:58.245010 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:58.245303 (+ 293us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:01:58.245476 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:58.245587 (+ 111us) server_negotiation.cc:299] Negotiation successful
0812 00:01:58.245721 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":81,"threads_started":1}
I20260812 00:01:58.247051 12089 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:01:58.271080 17404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:58.266819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41882 (local address 127.11.206.126:45475)
0812 00:01:58.266862 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:58.266864 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:58.267024 (+ 160us) server_negotiation.cc:407] Connection header received
0812 00:01:58.267109 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:58.267111 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:58.267123 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:58.267185 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:01:58.267591 (+ 406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:58.268349 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:58.269365 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:58.269745 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:58.269811 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:58.270539 (+ 728us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:01:58.270541 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:01:58.270541 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:01:58.270807 (+ 266us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:01:58.270829 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:01:58.270837 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:01:58.270892 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:58.270951 (+ 59us) server_negotiation.cc:299] Negotiation successful
0812 00:01:58.270985 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 00:01:58.279141 17431 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:01:58.279938 17431 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:01:58.294236 17431 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f6d7ba43b7e84d5ca76d856ee0e2db39: Generated new TSK 0
I20260812 00:01:58.294461 17431 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:01:58.302625 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 17267
2026-08-12T00:01:58Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (2891 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:01:58 dist-test-slave-f0tn krb5kdc[17472](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:01:58 dist-test-slave-f0tn krb5kdc[17472](info): set up 2 sockets
Aug 12 00:01:58 dist-test-slave-f0tn krb5kdc[17472](info): commencing operation
krb5kdc: starting...
W20260812 00:01:59.538317 12089 mini_kdc.cc:121] Time spent starting KDC: real 1.178s user 0.001s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/krb5kdc/test-user.keytab.
Aug 12 00:01:59 dist-test-slave-f0tn krb5kdc[17472](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492919, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:01:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:01:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.206.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab.
Entry for principal kudu/127.11.206.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab.
I20260812 00:01:59.656286 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:40411
--webserver_interface=127.11.206.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab
--principal=kudu/127.11.206.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:36503
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.206.126:40411
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:01:59.737586 17496 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:01:59.737782 17496 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:01:59.737802 17496 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:01:59.738927 17496 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:01:59.738969 17496 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:01:59.738982 17496 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:01:59.738994 17496 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:01:59.739012 17496 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:01:59.740499 17496 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:36503
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.206.126:40411
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab
--principal=kudu/127.11.206.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:40411
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.206.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17496
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:01:59.740723 17496 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:01:59.740950 17496 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:01:59.745679 17502 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:01:59.745685 17507 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:01:59.745685 17503 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:01:59.745901 17496 server_base.cc:1034] running on GCE node
I20260812 00:01:59.746171 17496 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:01:59.746433 17496 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:01:59.747602 17496 hybrid_clock.cc:648] HybridClock initialized: now 1786492919747585 us; error 27 us; skew 500 ppm
Aug 12 00:01:59 dist-test-slave-f0tn krb5kdc[17472](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492919, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:01:59.750034 17496 init.cc:377] Logged in from keytab as kudu/127.11.206.126@KRBTEST.COM (short username kudu)
I20260812 00:01:59.750475 17496 webserver.cc:460] Webserver started at http://127.11.206.126:46499/ using document root <none> and password file <none>
I20260812 00:01:59.750689 17496 fs_manager.cc:359] Metadata directory not provided
I20260812 00:01:59.750735 17496 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:01:59.750856 17496 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:01:59.751871 17496 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/minicluster-data/master-0/data/instance:
uuid: "239b17794bfc4161b8a0a1bed5fe1143"
format_stamp: "Formatted at 2026-08-12 00:01:59 on dist-test-slave-f0tn"
server_key: "a147258c6ae706c447e88a41ed22005c"
server_key_iv: "a128cfd5f8a672cf8e2dee2a3b01a15e"
server_key_version: "encryptionkey@0"
I20260812 00:01:59.752203 17496 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/minicluster-data/master-0/wal/instance:
uuid: "239b17794bfc4161b8a0a1bed5fe1143"
format_stamp: "Formatted at 2026-08-12 00:01:59 on dist-test-slave-f0tn"
server_key: "a147258c6ae706c447e88a41ed22005c"
server_key_iv: "a128cfd5f8a672cf8e2dee2a3b01a15e"
server_key_version: "encryptionkey@0"
I20260812 00:01:59.753510 17496 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 00:01:59.754313 17515 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:59.754528 17496 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:01:59.754626 17496 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/minicluster-data/master-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/minicluster-data/master-0/wal
uuid: "239b17794bfc4161b8a0a1bed5fe1143"
format_stamp: "Formatted at 2026-08-12 00:01:59 on dist-test-slave-f0tn"
server_key: "a147258c6ae706c447e88a41ed22005c"
server_key_iv: "a128cfd5f8a672cf8e2dee2a3b01a15e"
server_key_version: "encryptionkey@0"
I20260812 00:01:59.754700 17496 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:01:59.780284 17496 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:01:59.782357 17496 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:01:59.782505 17496 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:01:59.786307 17496 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.126:40411
I20260812 00:01:59.786343 17607 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.126:40411 every 8 connection(s)
I20260812 00:01:59.786674 17496 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
I20260812 00:01:59.787789 17610 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:01:59.790092 17610 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 239b17794bfc4161b8a0a1bed5fe1143: Bootstrap starting.
I20260812 00:01:59.790627 17610 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 239b17794bfc4161b8a0a1bed5fe1143: Neither blocks nor log segments found. Creating new log.
I20260812 00:01:59.790870 17610 log.cc:824] T 00000000000000000000000000000000 P 239b17794bfc4161b8a0a1bed5fe1143: Log is configured to *not* fsync() on all Append() calls
I20260812 00:01:59.791196 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 17496
I20260812 00:01:59.791286 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/minicluster-data/master-0/wal/instance
I20260812 00:01:59.791468 12089 external_mini_cluster.cc:1428] Setting key 8b6d0fa640cd2cee6dc2a06bc7082a76
I20260812 00:01:59.791635 17610 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 239b17794bfc4161b8a0a1bed5fe1143: No bootstrap required, opened a new log
I20260812 00:01:59.793526 17610 raft_consensus.cc:348] T 00000000000000000000000000000000 P 239b17794bfc4161b8a0a1bed5fe1143 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "239b17794bfc4161b8a0a1bed5fe1143" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 40411 } }
I20260812 00:01:59.793660 17610 raft_consensus.cc:374] T 00000000000000000000000000000000 P 239b17794bfc4161b8a0a1bed5fe1143 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:01:59.793694 17610 raft_consensus.cc:729] T 00000000000000000000000000000000 P 239b17794bfc4161b8a0a1bed5fe1143 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 239b17794bfc4161b8a0a1bed5fe1143, State: Initialized, Role: FOLLOWER
I20260812 00:01:59.793810 17610 consensus_queue.cc:260] T 00000000000000000000000000000000 P 239b17794bfc4161b8a0a1bed5fe1143 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "239b17794bfc4161b8a0a1bed5fe1143" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 40411 } }
I20260812 00:01:59.793870 17610 raft_consensus.cc:388] T 00000000000000000000000000000000 P 239b17794bfc4161b8a0a1bed5fe1143 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:01:59.793900 17610 raft_consensus.cc:482] T 00000000000000000000000000000000 P 239b17794bfc4161b8a0a1bed5fe1143 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:01:59.793946 17610 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 239b17794bfc4161b8a0a1bed5fe1143 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:01:59.794467 17610 raft_consensus.cc:504] T 00000000000000000000000000000000 P 239b17794bfc4161b8a0a1bed5fe1143 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "239b17794bfc4161b8a0a1bed5fe1143" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 40411 } }
I20260812 00:01:59.794623 17610 leader_election.cc:302] T 00000000000000000000000000000000 P 239b17794bfc4161b8a0a1bed5fe1143 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 239b17794bfc4161b8a0a1bed5fe1143; no voters:
I20260812 00:01:59.794793 17610 leader_election.cc:288] T 00000000000000000000000000000000 P 239b17794bfc4161b8a0a1bed5fe1143 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:01:59.794823 17617 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 239b17794bfc4161b8a0a1bed5fe1143 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:01:59.794960 17617 raft_consensus.cc:686] T 00000000000000000000000000000000 P 239b17794bfc4161b8a0a1bed5fe1143 [term 1 LEADER]: Becoming Leader. State: Replica: 239b17794bfc4161b8a0a1bed5fe1143, State: Running, Role: LEADER
I20260812 00:01:59.795060 17610 sys_catalog.cc:564] T 00000000000000000000000000000000 P 239b17794bfc4161b8a0a1bed5fe1143 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:01:59.795084 17617 consensus_queue.cc:237] T 00000000000000000000000000000000 P 239b17794bfc4161b8a0a1bed5fe1143 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "239b17794bfc4161b8a0a1bed5fe1143" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 40411 } }
I20260812 00:01:59.795420 17617 sys_catalog.cc:455] T 00000000000000000000000000000000 P 239b17794bfc4161b8a0a1bed5fe1143 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 239b17794bfc4161b8a0a1bed5fe1143. Latest consensus state: current_term: 1 leader_uuid: "239b17794bfc4161b8a0a1bed5fe1143" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "239b17794bfc4161b8a0a1bed5fe1143" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 40411 } } }
I20260812 00:01:59.795495 17617 sys_catalog.cc:458] T 00000000000000000000000000000000 P 239b17794bfc4161b8a0a1bed5fe1143 [sys.catalog]: This master's current role is: LEADER
I20260812 00:01:59.795581 17618 sys_catalog.cc:455] T 00000000000000000000000000000000 P 239b17794bfc4161b8a0a1bed5fe1143 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "239b17794bfc4161b8a0a1bed5fe1143" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "239b17794bfc4161b8a0a1bed5fe1143" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 40411 } } }
I20260812 00:01:59.795696 17618 sys_catalog.cc:458] T 00000000000000000000000000000000 P 239b17794bfc4161b8a0a1bed5fe1143 [sys.catalog]: This master's current role is: LEADER
I20260812 00:01:59.796396 17626 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:01:59.796918 17626 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:01:59.798467 17626 catalog_manager.cc:1347] Generated new cluster ID: 93a2585a319d4a6cb5e5a67e04ea6eb6
I20260812 00:01:59.798527 17626 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 00:01:59 dist-test-slave-f0tn krb5kdc[17472](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492919, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:01:59.806648 17616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:59.791939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37820 (local address 127.11.206.126:40411)
0812 00:01:59.792137 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:59.792147 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:59.792179 (+ 32us) server_negotiation.cc:407] Connection header received
0812 00:01:59.792839 (+ 660us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:59.792847 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:59.792895 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:59.793018 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:01:59.793664 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:59.795033 (+ 1369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:59.796043 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:59.796650 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:59.796782 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:59.803473 (+ 6691us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:01:59.803478 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:01:59.803478 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:01:59.803491 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:01:59.805093 (+ 1602us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:59.805470 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:59.805474 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:59.805475 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:59.805576 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:59.805769 (+ 193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:59.805770 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:59.805770 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:59.806035 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:01:59.806206 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:59.806296 (+ 90us) server_negotiation.cc:299] Negotiation successful
0812 00:01:59.806437 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":98,"threads_started":1}
I20260812 00:01:59.815481 17626 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:01:59.816293 17626 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:01:59.823963 17626 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 239b17794bfc4161b8a0a1bed5fe1143: Generated new TSK 0
I20260812 00:01:59.824194 17626 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.206.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.65.keytab.
Entry for principal kudu/127.11.206.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.65.keytab.
I20260812 00:01:59.857191 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.65:0
--local_ip_for_outbound_sockets=127.11.206.65
--webserver_interface=127.11.206.65
--webserver_port=0
--tserver_master_addrs=127.11.206.126:40411
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.65.keytab
--principal=kudu/127.11.206.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:36503
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:01:59.939673 17652 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:01:59.939875 17652 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:01:59.939896 17652 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:01:59.941012 17652 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:01:59.941053 17652 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:01:59.941088 17652 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.65
I20260812 00:01:59.942642 17652 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:36503
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.65.keytab
--principal=kudu/127.11.206.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.206.65
--webserver_port=0
--tserver_master_addrs=127.11.206.126:40411
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17652
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.65
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:01:59.942862 17652 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:01:59.943065 17652 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:01:59.948089 17660 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:01:59.948096 17663 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:01:59.948263 17666 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:01:59.948400 17652 server_base.cc:1034] running on GCE node
I20260812 00:01:59.948678 17652 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:01:59.948936 17652 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:01:59.950069 17652 hybrid_clock.cc:648] HybridClock initialized: now 1786492919950063 us; error 35 us; skew 500 ppm
Aug 12 00:01:59 dist-test-slave-f0tn krb5kdc[17472](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492919, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:01:59.952607 17652 init.cc:377] Logged in from keytab as kudu/127.11.206.65@KRBTEST.COM (short username kudu)
I20260812 00:01:59.953027 17652 webserver.cc:460] Webserver started at http://127.11.206.65:44891/ using document root <none> and password file <none>
I20260812 00:01:59.953243 17652 fs_manager.cc:359] Metadata directory not provided
I20260812 00:01:59.953286 17652 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:01:59.953451 17652 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:01:59.954514 17652 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-0/data/instance:
uuid: "a3b62965615b483383ca35aec8c1ab40"
format_stamp: "Formatted at 2026-08-12 00:01:59 on dist-test-slave-f0tn"
server_key: "4ce002efc9f525c55d0e2b342bf26827"
server_key_iv: "6751ea70609fd56421bb598ee1e09dbf"
server_key_version: "encryptionkey@0"
I20260812 00:01:59.954847 17652 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-0/wal/instance:
uuid: "a3b62965615b483383ca35aec8c1ab40"
format_stamp: "Formatted at 2026-08-12 00:01:59 on dist-test-slave-f0tn"
server_key: "4ce002efc9f525c55d0e2b342bf26827"
server_key_iv: "6751ea70609fd56421bb598ee1e09dbf"
server_key_version: "encryptionkey@0"
I20260812 00:01:59.956154 17652 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 00:01:59.956892 17677 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:59.957028 17652 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:01:59.957114 17652 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-0/wal
uuid: "a3b62965615b483383ca35aec8c1ab40"
format_stamp: "Formatted at 2026-08-12 00:01:59 on dist-test-slave-f0tn"
server_key: "4ce002efc9f525c55d0e2b342bf26827"
server_key_iv: "6751ea70609fd56421bb598ee1e09dbf"
server_key_version: "encryptionkey@0"
I20260812 00:01:59.957185 17652 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:01:59.971129 17652 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:01:59.973412 17652 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:01:59.973572 17652 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:01:59.973814 17652 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:01:59.974138 17652 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:01:59.974174 17652 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:59.974203 17652 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:01:59.974226 17652 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:01:59.979604 17652 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.65:46573
I20260812 00:01:59.979673 17874 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.65:46573 every 8 connection(s)
I20260812 00:01:59.979969 17652 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
I20260812 00:01:59.982868 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 17652
I20260812 00:01:59.982964 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-0/wal/instance
I20260812 00:01:59.983146 12089 external_mini_cluster.cc:1428] Setting key 66ca28c5e3df0fef7724011e01d8420d
Aug 12 00:01:59 dist-test-slave-f0tn krb5kdc[17472](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492919, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.65@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:01:59.989946 17616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:59.980820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.65:59505 (local address 127.11.206.126:40411)
0812 00:01:59.980887 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0812 00:01:59.980889 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:01:59.981093 (+ 204us) server_negotiation.cc:407] Connection header received
0812 00:01:59.981625 (+ 532us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:01:59.981627 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:01:59.981639 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:01:59.981699 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:01:59.982716 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:59.983301 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:59.984404 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:01:59.984621 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:01:59.984676 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:59.987056 (+ 2380us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:01:59.987058 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:01:59.987058 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:01:59.987065 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:01:59.988447 (+ 1382us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:59.988919 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:59.988919 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:59.988920 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:59.988972 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:01:59.989266 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:01:59.989267 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:01:59.989268 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:01:59.989420 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:01:59.989482 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0812 00:01:59.989807 (+ 325us) server_negotiation.cc:299] Negotiation successful
0812 00:01:59.989878 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260812 00:01:59.990214 17879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:01:59.980754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:40411 (local address 127.11.206.65:59505)
0812 00:01:59.980960 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0812 00:01:59.980998 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 00:01:59.981524 (+ 526us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:01:59.981792 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:01:59.981795 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:01:59.982402 (+ 607us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:01:59.982611 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:59.982616 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:59.983383 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:59.983385 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:59.984318 (+ 933us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:01:59.984321 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:01:59.984691 (+ 370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:01:59.984692 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:01:59.984822 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:01:59.985336 (+ 514us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:01:59.985347 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:01:59.986944 (+ 1597us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:01:59.988528 (+ 1584us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:01:59.988536 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:01:59.988538 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:01:59.988847 (+ 309us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:01:59.989033 (+ 186us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:01:59.989034 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:01:59.989034 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:01:59.989179 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:01:59.989485 (+ 306us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:01:59.989493 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:01:59.989671 (+ 178us) client_negotiation.cc:769] Sending connection context
0812 00:01:59.989799 (+ 128us) client_negotiation.cc:240] Negotiation successful
0812 00:01:59.989972 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":91,"threads_started":1}
I20260812 00:01:59.990708 17875 heartbeater.cc:347] Connected to a master server at 127.11.206.126:40411
I20260812 00:01:59.990799 17875 heartbeater.cc:464] Registering TS with master...
I20260812 00:01:59.990964 17875 heartbeater.cc:511] Master 127.11.206.126:40411 requested a full tablet report, sending...
I20260812 00:01:59.991526 17553 ts_manager.cc:194] Registered new tserver with Master: a3b62965615b483383ca35aec8c1ab40 (127.11.206.65:46573)
WARNING: no policy specified for kudu/127.11.206.66@KRBTEST.COM; defaulting to no policy
I20260812 00:01:59.992134 17553 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.206.65@KRBTEST.COM'} at 127.11.206.65:59505
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.66.keytab.
Entry for principal kudu/127.11.206.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.66.keytab.
I20260812 00:02:00.010211 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.66:0
--local_ip_for_outbound_sockets=127.11.206.66
--webserver_interface=127.11.206.66
--webserver_port=0
--tserver_master_addrs=127.11.206.126:40411
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.66.keytab
--principal=kudu/127.11.206.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:36503
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:02:00.092029 17891 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:02:00.092240 17891 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:02:00.092272 17891 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:02:00.093429 17891 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:02:00.093469 17891 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:02:00.093502 17891 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.66
I20260812 00:02:00.095008 17891 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:36503
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.66.keytab
--principal=kudu/127.11.206.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.206.66
--webserver_port=0
--tserver_master_addrs=127.11.206.126:40411
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17891
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.66
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:02:00.095244 17891 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:02:00.095468 17891 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:02:00.100415 17901 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:00.100406 17899 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:00.100485 17891 server_base.cc:1034] running on GCE node
W20260812 00:02:00.100405 17905 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:00.100821 17891 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:02:00.101051 17891 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:02:00.102192 17891 hybrid_clock.cc:648] HybridClock initialized: now 1786492920102179 us; error 30 us; skew 500 ppm
Aug 12 00:02:00 dist-test-slave-f0tn krb5kdc[17472](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492920, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:02:00.104938 17891 init.cc:377] Logged in from keytab as kudu/127.11.206.66@KRBTEST.COM (short username kudu)
I20260812 00:02:00.105414 17891 webserver.cc:460] Webserver started at http://127.11.206.66:33897/ using document root <none> and password file <none>
I20260812 00:02:00.105634 17891 fs_manager.cc:359] Metadata directory not provided
I20260812 00:02:00.105682 17891 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:02:00.105811 17891 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:02:00.106830 17891 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-1/data/instance:
uuid: "82aa67c68a144376bb2217ff97fac19f"
format_stamp: "Formatted at 2026-08-12 00:02:00 on dist-test-slave-f0tn"
server_key: "f7819c8929c446aa8bbedaf8aa41c7b9"
server_key_iv: "6c377e4452cb28a14ad23fb4719bf656"
server_key_version: "encryptionkey@0"
I20260812 00:02:00.107156 17891 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-1/wal/instance:
uuid: "82aa67c68a144376bb2217ff97fac19f"
format_stamp: "Formatted at 2026-08-12 00:02:00 on dist-test-slave-f0tn"
server_key: "f7819c8929c446aa8bbedaf8aa41c7b9"
server_key_iv: "6c377e4452cb28a14ad23fb4719bf656"
server_key_version: "encryptionkey@0"
I20260812 00:02:00.108397 17891 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:02:00.109068 17914 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:00.109236 17891 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:02:00.109323 17891 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-1/wal
uuid: "82aa67c68a144376bb2217ff97fac19f"
format_stamp: "Formatted at 2026-08-12 00:02:00 on dist-test-slave-f0tn"
server_key: "f7819c8929c446aa8bbedaf8aa41c7b9"
server_key_iv: "6c377e4452cb28a14ad23fb4719bf656"
server_key_version: "encryptionkey@0"
I20260812 00:02:00.109426 17891 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:02:00.123414 17891 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:02:00.125524 17891 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:02:00.125638 17891 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:02:00.125826 17891 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:02:00.126080 17891 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:02:00.126112 17891 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:00.126142 17891 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:02:00.126159 17891 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:00.131798 17891 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.66:40583
I20260812 00:02:00.131855 18091 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.66:40583 every 8 connection(s)
I20260812 00:02:00.132148 17891 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
I20260812 00:02:00.135368 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 17891
I20260812 00:02:00.135483 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-1/wal/instance
I20260812 00:02:00.135684 12089 external_mini_cluster.cc:1428] Setting key ddabb6a303ee6c80a194f0d2806bed93
Aug 12 00:02:00 dist-test-slave-f0tn krb5kdc[17472](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492920, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.66@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:02:00.141906 17616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:00.132826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.66:50417 (local address 127.11.206.126:40411)
0812 00:02:00.132879 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:00.132881 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:00.133056 (+ 175us) server_negotiation.cc:407] Connection header received
0812 00:02:00.133633 (+ 577us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:00.133635 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:00.133645 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:00.133686 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:00.134617 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:00.135119 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:00.136503 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:00.136707 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:00.136760 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:00.139059 (+ 2299us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:00.139061 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:00.139061 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:00.139102 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:00.140419 (+ 1317us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:00.140888 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:00.140890 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:00.140890 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:00.140957 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:00.141242 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:00.141243 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:00.141243 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:00.141348 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:00.141428 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:00.141756 (+ 328us) server_negotiation.cc:299] Negotiation successful
0812 00:02:00.141838 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260812 00:02:00.142154 18094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:00.132792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:40411 (local address 127.11.206.66:50417)
0812 00:02:00.132943 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:00.132986 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:00.133524 (+ 538us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:00.133770 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:00.133773 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:00.134330 (+ 557us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:00.134520 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:00.134524 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:00.135204 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:00.135206 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:00.136425 (+ 1219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:00.136428 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:00.136783 (+ 355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:00.136784 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:00.136934 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:00.137506 (+ 572us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:00.137516 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:00.138957 (+ 1441us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:02:00.140493 (+ 1536us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:00.140500 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:00.140503 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:00.140792 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:00.141033 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:00.141034 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:00.141035 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:00.141184 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:00.141424 (+ 240us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:02:00.141429 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:02:00.141601 (+ 172us) client_negotiation.cc:769] Sending connection context
0812 00:02:00.141717 (+ 116us) client_negotiation.cc:240] Negotiation successful
0812 00:02:00.141902 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":70,"threads_started":1}
I20260812 00:02:00.142684 18092 heartbeater.cc:347] Connected to a master server at 127.11.206.126:40411
I20260812 00:02:00.142795 18092 heartbeater.cc:464] Registering TS with master...
I20260812 00:02:00.142992 18092 heartbeater.cc:511] Master 127.11.206.126:40411 requested a full tablet report, sending...
I20260812 00:02:00.143397 17553 ts_manager.cc:194] Registered new tserver with Master: 82aa67c68a144376bb2217ff97fac19f (127.11.206.66:40583)
I20260812 00:02:00.143862 17553 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.206.66@KRBTEST.COM'} at 127.11.206.66:50417
WARNING: no policy specified for kudu/127.11.206.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.67.keytab.
Entry for principal kudu/127.11.206.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.67.keytab.
I20260812 00:02:00.161665 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.67:0
--local_ip_for_outbound_sockets=127.11.206.67
--webserver_interface=127.11.206.67
--webserver_port=0
--tserver_master_addrs=127.11.206.126:40411
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.67.keytab
--principal=kudu/127.11.206.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:36503
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:02:00.243937 18099 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:02:00.244141 18099 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:02:00.244163 18099 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:02:00.245237 18099 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:02:00.245271 18099 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:02:00.245301 18099 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.67
I20260812 00:02:00.246731 18099 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:36503
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.67.keytab
--principal=kudu/127.11.206.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.206.67
--webserver_port=0
--tserver_master_addrs=127.11.206.126:40411
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18099
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.67
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:02:00.246922 18099 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:02:00.247108 18099 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:02:00.252003 18104 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:00.252074 18099 server_base.cc:1034] running on GCE node
W20260812 00:02:00.251989 18108 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:00.252003 18106 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:00.252377 18099 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:02:00.252616 18099 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:02:00.253774 18099 hybrid_clock.cc:648] HybridClock initialized: now 1786492920253761 us; error 29 us; skew 500 ppm
Aug 12 00:02:00 dist-test-slave-f0tn krb5kdc[17472](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492920, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:02:00.256307 18099 init.cc:377] Logged in from keytab as kudu/127.11.206.67@KRBTEST.COM (short username kudu)
I20260812 00:02:00.256742 18099 webserver.cc:460] Webserver started at http://127.11.206.67:36723/ using document root <none> and password file <none>
I20260812 00:02:00.256965 18099 fs_manager.cc:359] Metadata directory not provided
I20260812 00:02:00.257010 18099 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:02:00.257138 18099 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:02:00.258198 18099 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-2/data/instance:
uuid: "9033300da81e4cf3814e9070eb754414"
format_stamp: "Formatted at 2026-08-12 00:02:00 on dist-test-slave-f0tn"
server_key: "e2adf0f7ba88f78639d99f9fc55ec9a1"
server_key_iv: "7e69a02c541a55f4daaef2ed6b115893"
server_key_version: "encryptionkey@0"
I20260812 00:02:00.258567 18099 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-2/wal/instance:
uuid: "9033300da81e4cf3814e9070eb754414"
format_stamp: "Formatted at 2026-08-12 00:02:00 on dist-test-slave-f0tn"
server_key: "e2adf0f7ba88f78639d99f9fc55ec9a1"
server_key_iv: "7e69a02c541a55f4daaef2ed6b115893"
server_key_version: "encryptionkey@0"
I20260812 00:02:00.259852 18099 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260812 00:02:00.260643 18123 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:00.260825 18099 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 00:02:00.260916 18099 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-2/wal
uuid: "9033300da81e4cf3814e9070eb754414"
format_stamp: "Formatted at 2026-08-12 00:02:00 on dist-test-slave-f0tn"
server_key: "e2adf0f7ba88f78639d99f9fc55ec9a1"
server_key_iv: "7e69a02c541a55f4daaef2ed6b115893"
server_key_version: "encryptionkey@0"
I20260812 00:02:00.260984 18099 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:02:00.271279 18099 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:02:00.273504 18099 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:02:00.273658 18099 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:02:00.273880 18099 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:02:00.274235 18099 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:02:00.274272 18099 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:00.274302 18099 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:02:00.274319 18099 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:00.279896 18099 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.67:40873
I20260812 00:02:00.279953 18312 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.67:40873 every 8 connection(s)
I20260812 00:02:00.280260 18099 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
Aug 12 00:02:00 dist-test-slave-f0tn krb5kdc[17472](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492920, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.67@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:02:00.286919 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 18099
I20260812 00:02:00.287011 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786492899949492-12089-0/minicluster-data/ts-2/wal/instance
I20260812 00:02:00.287211 12089 external_mini_cluster.cc:1428] Setting key c887dadd90a2ddac13f3b5b5ef74e38b
I20260812 00:02:00.289224 17616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:00.280986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.67:38587 (local address 127.11.206.126:40411)
0812 00:02:00.281030 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:00.281032 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:00.281237 (+ 205us) server_negotiation.cc:407] Connection header received
0812 00:02:00.281795 (+ 558us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:00.281796 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:00.281807 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:00.281844 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:00.282793 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:00.283300 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:00.284383 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:00.284568 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:00.284612 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:00.286637 (+ 2025us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:00.286638 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:00.286638 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:00.286645 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:00.288075 (+ 1430us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:00.288498 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:00.288499 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:00.288499 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:00.288555 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:00.288743 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:00.288743 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:00.288744 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:00.288853 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:00.288899 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:00.289102 (+ 203us) server_negotiation.cc:299] Negotiation successful
0812 00:02:00.289161 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260812 00:02:00.289459 18316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:00.280968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:40411 (local address 127.11.206.67:38587)
0812 00:02:00.281112 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:00.281151 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:00.281677 (+ 526us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:00.281915 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:00.281918 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:00.282471 (+ 553us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:00.282678 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:00.282683 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:00.283374 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:00.283375 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:00.284318 (+ 943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:00.284321 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:00.284623 (+ 302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:00.284624 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:00.284721 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:00.285216 (+ 495us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:00.285224 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:00.286537 (+ 1313us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:02:00.288187 (+ 1650us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:00.288194 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:00.288197 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:00.288437 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:00.288605 (+ 168us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:00.288605 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:00.288606 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:00.288700 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:00.288895 (+ 195us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:02:00.288898 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:02:00.289008 (+ 110us) client_negotiation.cc:769] Sending connection context
0812 00:02:00.289092 (+ 84us) client_negotiation.cc:240] Negotiation successful
0812 00:02:00.289215 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":69,"threads_started":1}
I20260812 00:02:00.289880 18313 heartbeater.cc:347] Connected to a master server at 127.11.206.126:40411
I20260812 00:02:00.289971 18313 heartbeater.cc:464] Registering TS with master...
I20260812 00:02:00.290119 18313 heartbeater.cc:511] Master 127.11.206.126:40411 requested a full tablet report, sending...
I20260812 00:02:00.290449 17553 ts_manager.cc:194] Registered new tserver with Master: 9033300da81e4cf3814e9070eb754414 (127.11.206.67:40873)
I20260812 00:02:00.290784 17553 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.206.67@KRBTEST.COM'} at 127.11.206.67:38587
I20260812 00:02:00.299039 12089 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 00:02:00 dist-test-slave-f0tn krb5kdc[17472](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492920, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 12 00:02:00 dist-test-slave-f0tn krb5kdc[17472](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492920, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:02:00.321851 17616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:00.314683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37824 (local address 127.11.206.126:40411)
0812 00:02:00.314748 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:00.314750 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:00.314765 (+ 15us) server_negotiation.cc:407] Connection header received
0812 00:02:00.314848 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:00.314849 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:00.314859 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:00.314906 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:00.315460 (+ 554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:00.315971 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:00.316747 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:00.316934 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:00.316995 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:00.319295 (+ 2300us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:00.319297 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:00.319297 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:00.319304 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:00.320622 (+ 1318us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:00.320970 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:00.320971 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:00.320971 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:00.321028 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:00.321192 (+ 164us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:00.321193 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:00.321193 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:00.321356 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:00.321521 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:00.321682 (+ 161us) server_negotiation.cc:299] Negotiation successful
0812 00:02:00.321779 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
W20260812 00:02:00.322093 17553 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:37824
I20260812 00:02:00.322816 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 17652
I20260812 00:02:00.358032 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 17891
I20260812 00:02:00.378587 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 18099
I20260812 00:02:00.391239 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 17496
2026-08-12T00:02:00Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (2054 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:02:00 dist-test-slave-f0tn krb5kdc[18330](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:02:00 dist-test-slave-f0tn krb5kdc[18330](info): set up 2 sockets
Aug 12 00:02:00 dist-test-slave-f0tn krb5kdc[18330](info): commencing operation
krb5kdc: starting...
W20260812 00:02:01.570528 12089 mini_kdc.cc:121] Time spent starting KDC: real 1.156s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/krb5kdc/test-user.keytab.
Aug 12 00:02:01 dist-test-slave-f0tn krb5kdc[18330](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492921, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:02:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:02:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.206.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab.
Entry for principal kudu/127.11.206.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab.
I20260812 00:02:01.684065 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:43243
--webserver_interface=127.11.206.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab
--principal=kudu/127.11.206.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:34855
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.206.126:43243
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:02:01.764635 18346 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:02:01.764849 18346 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:02:01.764879 18346 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:02:01.766048 18346 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:02:01.766091 18346 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:02:01.766109 18346 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:02:01.766125 18346 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:02:01.766140 18346 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:02:01.767649 18346 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:34855
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.206.126:43243
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab
--principal=kudu/127.11.206.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:43243
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.206.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18346
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:02:01.767906 18346 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:02:01.768115 18346 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:02:01.772908 18360 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:01.772938 18346 server_base.cc:1034] running on GCE node
W20260812 00:02:01.772900 18357 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:01.772915 18358 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:01.773324 18346 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:02:01.773622 18346 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:02:01.774773 18346 hybrid_clock.cc:648] HybridClock initialized: now 1786492921774761 us; error 29 us; skew 500 ppm
Aug 12 00:02:01 dist-test-slave-f0tn krb5kdc[18330](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492921, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:02:01.777148 18346 init.cc:377] Logged in from keytab as kudu/127.11.206.126@KRBTEST.COM (short username kudu)
I20260812 00:02:01.777588 18346 webserver.cc:460] Webserver started at http://127.11.206.126:42291/ using document root <none> and password file <none>
I20260812 00:02:01.777819 18346 fs_manager.cc:359] Metadata directory not provided
I20260812 00:02:01.777868 18346 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:02:01.777997 18346 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:02:01.779268 18346 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/minicluster-data/master-0/data/instance:
uuid: "0f124625d87e48afb65722c960dd2528"
format_stamp: "Formatted at 2026-08-12 00:02:01 on dist-test-slave-f0tn"
server_key: "43e6a61503b078e9b9e2ef95fb4a549f"
server_key_iv: "ba33877bdee54124ba81afe4e1b49c2f"
server_key_version: "encryptionkey@0"
I20260812 00:02:01.779611 18346 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/minicluster-data/master-0/wal/instance:
uuid: "0f124625d87e48afb65722c960dd2528"
format_stamp: "Formatted at 2026-08-12 00:02:01 on dist-test-slave-f0tn"
server_key: "43e6a61503b078e9b9e2ef95fb4a549f"
server_key_iv: "ba33877bdee54124ba81afe4e1b49c2f"
server_key_version: "encryptionkey@0"
I20260812 00:02:01.780874 18346 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:02:01.781623 18375 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:01.781787 18346 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:02:01.781881 18346 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/minicluster-data/master-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/minicluster-data/master-0/wal
uuid: "0f124625d87e48afb65722c960dd2528"
format_stamp: "Formatted at 2026-08-12 00:02:01 on dist-test-slave-f0tn"
server_key: "43e6a61503b078e9b9e2ef95fb4a549f"
server_key_iv: "ba33877bdee54124ba81afe4e1b49c2f"
server_key_version: "encryptionkey@0"
I20260812 00:02:01.781952 18346 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:02:01.790716 18346 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:02:01.792862 18346 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:02:01.793015 18346 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:02:01.796965 18346 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.126:43243
I20260812 00:02:01.797006 18465 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.126:43243 every 8 connection(s)
I20260812 00:02:01.797515 18346 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
I20260812 00:02:01.798177 18466 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:02:01.798413 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 18346
I20260812 00:02:01.798518 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/minicluster-data/master-0/wal/instance
I20260812 00:02:01.798708 12089 external_mini_cluster.cc:1428] Setting key 69cc8c3f299a52c393c8c5bfd1607eb5
I20260812 00:02:01.800879 18466 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f124625d87e48afb65722c960dd2528: Bootstrap starting.
I20260812 00:02:01.801489 18466 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0f124625d87e48afb65722c960dd2528: Neither blocks nor log segments found. Creating new log.
I20260812 00:02:01.801736 18466 log.cc:824] T 00000000000000000000000000000000 P 0f124625d87e48afb65722c960dd2528: Log is configured to *not* fsync() on all Append() calls
I20260812 00:02:01.802400 18466 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f124625d87e48afb65722c960dd2528: No bootstrap required, opened a new log
I20260812 00:02:01.804606 18466 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0f124625d87e48afb65722c960dd2528 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f124625d87e48afb65722c960dd2528" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 43243 } }
I20260812 00:02:01.804741 18466 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0f124625d87e48afb65722c960dd2528 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:02:01.804774 18466 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0f124625d87e48afb65722c960dd2528 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f124625d87e48afb65722c960dd2528, State: Initialized, Role: FOLLOWER
I20260812 00:02:01.804895 18466 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0f124625d87e48afb65722c960dd2528 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f124625d87e48afb65722c960dd2528" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 43243 } }
I20260812 00:02:01.804970 18466 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0f124625d87e48afb65722c960dd2528 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:02:01.805001 18466 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0f124625d87e48afb65722c960dd2528 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:02:01.805049 18466 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0f124625d87e48afb65722c960dd2528 [term 0 FOLLOWER]: Advancing to term 1
Aug 12 00:02:01 dist-test-slave-f0tn krb5kdc[18330](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492921, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:02:01.805660 18466 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0f124625d87e48afb65722c960dd2528 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f124625d87e48afb65722c960dd2528" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 43243 } }
I20260812 00:02:01.805771 18466 leader_election.cc:302] T 00000000000000000000000000000000 P 0f124625d87e48afb65722c960dd2528 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0f124625d87e48afb65722c960dd2528; no voters:
I20260812 00:02:01.805945 18466 leader_election.cc:288] T 00000000000000000000000000000000 P 0f124625d87e48afb65722c960dd2528 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:02:01.806133 18473 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0f124625d87e48afb65722c960dd2528 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:02:01.806195 18466 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0f124625d87e48afb65722c960dd2528 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:02:01.806331 18473 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0f124625d87e48afb65722c960dd2528 [term 1 LEADER]: Becoming Leader. State: Replica: 0f124625d87e48afb65722c960dd2528, State: Running, Role: LEADER
I20260812 00:02:01.806424 18473 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0f124625d87e48afb65722c960dd2528 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f124625d87e48afb65722c960dd2528" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 43243 } }
I20260812 00:02:01.806715 18473 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f124625d87e48afb65722c960dd2528 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0f124625d87e48afb65722c960dd2528. Latest consensus state: current_term: 1 leader_uuid: "0f124625d87e48afb65722c960dd2528" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f124625d87e48afb65722c960dd2528" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 43243 } } }
I20260812 00:02:01.806799 18473 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f124625d87e48afb65722c960dd2528 [sys.catalog]: This master's current role is: LEADER
I20260812 00:02:01.806768 18472 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f124625d87e48afb65722c960dd2528 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0f124625d87e48afb65722c960dd2528" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f124625d87e48afb65722c960dd2528" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 43243 } } }
I20260812 00:02:01.807029 18472 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f124625d87e48afb65722c960dd2528 [sys.catalog]: This master's current role is: LEADER
W20260812 00:02:01.807893 18495 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 0f124625d87e48afb65722c960dd2528: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 00:02:01.807938 18495 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 00:02:01.808894 18484 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:02:01.809208 18470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:01.799236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45712 (local address 127.11.206.126:43243)
0812 00:02:01.799407 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:01.799417 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:01.799444 (+ 27us) server_negotiation.cc:407] Connection header received
0812 00:02:01.799867 (+ 423us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:01.799873 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:01.799919 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:01.800043 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:01.800773 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:01.801957 (+ 1184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:01.802745 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:01.803376 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:01.803488 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:01.805670 (+ 2182us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:01.805675 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:01.805675 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:01.805687 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:01.807566 (+ 1879us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:01.808007 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:01.808011 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:01.808011 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:01.808117 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:01.808328 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:01.808330 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:01.808330 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:01.808572 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:01.808721 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:01.808838 (+ 117us) server_negotiation.cc:299] Negotiation successful
0812 00:02:01.808971 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":73,"threads_started":1}
I20260812 00:02:01.809063 18484 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:02:01.810937 18484 catalog_manager.cc:1347] Generated new cluster ID: c214d7c97e9f4d49b9a1e9c83a7ec08e
I20260812 00:02:01.810992 18484 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:02:01.827834 18484 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:02:01.828349 18484 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:02:01.831029 18484 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0f124625d87e48afb65722c960dd2528: Generated new TSK 0
I20260812 00:02:01.831188 18484 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.206.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.65.keytab.
Entry for principal kudu/127.11.206.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.65.keytab.
I20260812 00:02:01.858279 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.65:0
--local_ip_for_outbound_sockets=127.11.206.65
--webserver_interface=127.11.206.65
--webserver_port=0
--tserver_master_addrs=127.11.206.126:43243
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.65.keytab
--principal=kudu/127.11.206.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:34855
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:02:01.938622 18504 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:02:01.938824 18504 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:02:01.938846 18504 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:02:01.940076 18504 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:02:01.940126 18504 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:02:01.940171 18504 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.65
I20260812 00:02:01.941927 18504 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:34855
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.65.keytab
--principal=kudu/127.11.206.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.206.65
--webserver_port=0
--tserver_master_addrs=127.11.206.126:43243
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18504
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.65
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:02:01.942157 18504 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:02:01.942377 18504 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:02:01.947203 18512 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:01.947306 18504 server_base.cc:1034] running on GCE node
W20260812 00:02:01.947395 18511 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:01.947203 18515 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:01.947707 18504 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:02:01.947960 18504 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:02:01.949100 18504 hybrid_clock.cc:648] HybridClock initialized: now 1786492921949086 us; error 24 us; skew 500 ppm
Aug 12 00:02:01 dist-test-slave-f0tn krb5kdc[18330](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492921, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:02:01.951439 18504 init.cc:377] Logged in from keytab as kudu/127.11.206.65@KRBTEST.COM (short username kudu)
I20260812 00:02:01.951818 18504 webserver.cc:460] Webserver started at http://127.11.206.65:39849/ using document root <none> and password file <none>
I20260812 00:02:01.952009 18504 fs_manager.cc:359] Metadata directory not provided
I20260812 00:02:01.952047 18504 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:02:01.952137 18504 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:02:01.953088 18504 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/minicluster-data/ts-0/data/instance:
uuid: "3946a5787c6343aab09a8ba21188d912"
format_stamp: "Formatted at 2026-08-12 00:02:01 on dist-test-slave-f0tn"
server_key: "b0782e14c24b0f7b482f679d9f753cd9"
server_key_iv: "0ea3565696c1680def4dfdc9a826b6f1"
server_key_version: "encryptionkey@0"
I20260812 00:02:01.953416 18504 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/minicluster-data/ts-0/wal/instance:
uuid: "3946a5787c6343aab09a8ba21188d912"
format_stamp: "Formatted at 2026-08-12 00:02:01 on dist-test-slave-f0tn"
server_key: "b0782e14c24b0f7b482f679d9f753cd9"
server_key_iv: "0ea3565696c1680def4dfdc9a826b6f1"
server_key_version: "encryptionkey@0"
I20260812 00:02:01.954603 18504 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 00:02:01.955220 18525 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:01.955374 18504 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 00:02:01.955452 18504 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/minicluster-data/ts-0/wal
uuid: "3946a5787c6343aab09a8ba21188d912"
format_stamp: "Formatted at 2026-08-12 00:02:01 on dist-test-slave-f0tn"
server_key: "b0782e14c24b0f7b482f679d9f753cd9"
server_key_iv: "0ea3565696c1680def4dfdc9a826b6f1"
server_key_version: "encryptionkey@0"
I20260812 00:02:01.955518 18504 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:02:01.968344 18504 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:02:01.970320 18504 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:02:01.970435 18504 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:02:01.970651 18504 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:02:01.970948 18504 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:02:01.970980 18504 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:01.971001 18504 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:02:01.971129 18504 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:01.976707 18504 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.65:41527
I20260812 00:02:01.976770 18707 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.65:41527 every 8 connection(s)
I20260812 00:02:01.977043 18504 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
Aug 12 00:02:01 dist-test-slave-f0tn krb5kdc[18330](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492921, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.65@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:02:01.983000 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 18504
I20260812 00:02:01.983119 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/minicluster-data/ts-0/wal/instance
I20260812 00:02:01.983337 12089 external_mini_cluster.cc:1428] Setting key 9a52043ee861255162054db7b55f16f3
I20260812 00:02:01.986131 18470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:01.977734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.65:45397 (local address 127.11.206.126:43243)
0812 00:02:01.977811 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:01.977814 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:01.977994 (+ 180us) server_negotiation.cc:407] Connection header received
0812 00:02:01.978875 (+ 881us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:01.978876 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:01.978886 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:01.978937 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:01.979483 (+ 546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:01.979992 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:01.980947 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:01.981146 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:01.981189 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:01.983299 (+ 2110us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:01.983301 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:01.983301 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:01.983308 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:01.984660 (+ 1352us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:01.985103 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:01.985104 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:01.985104 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:01.985159 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:01.985474 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:01.985475 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:01.985475 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:01.985594 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:01.985649 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:01.985990 (+ 341us) server_negotiation.cc:299] Negotiation successful
0812 00:02:01.986064 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 00:02:01.986369 18710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:01.977700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:43243 (local address 127.11.206.65:45397)
0812 00:02:01.977861 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:01.977901 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:01.978791 (+ 890us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:01.978993 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:01.978996 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:01.979234 (+ 238us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:01.979422 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:01.979427 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:01.980070 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:01.980071 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:01.980887 (+ 816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:01.980889 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:01.981199 (+ 310us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:01.981200 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:01.981296 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:01.981754 (+ 458us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:01.981762 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:01.983181 (+ 1419us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:02:01.984740 (+ 1559us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:01.984747 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:01.984750 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:01.985038 (+ 288us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:01.985216 (+ 178us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:01.985217 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:01.985218 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:01.985412 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:01.985652 (+ 240us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:02:01.985657 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:02:01.985857 (+ 200us) client_negotiation.cc:769] Sending connection context
0812 00:02:01.985964 (+ 107us) client_negotiation.cc:240] Negotiation successful
0812 00:02:01.986142 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":74,"threads_started":1}
I20260812 00:02:01.986933 18708 heartbeater.cc:347] Connected to a master server at 127.11.206.126:43243
I20260812 00:02:01.987039 18708 heartbeater.cc:464] Registering TS with master...
I20260812 00:02:01.987224 18708 heartbeater.cc:511] Master 127.11.206.126:43243 requested a full tablet report, sending...
I20260812 00:02:01.987831 18404 ts_manager.cc:194] Registered new tserver with Master: 3946a5787c6343aab09a8ba21188d912 (127.11.206.65:41527)
I20260812 00:02:01.988801 18404 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.206.65@KRBTEST.COM'} at 127.11.206.65:45397
WARNING: no policy specified for kudu/127.11.206.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.66.keytab.
Entry for principal kudu/127.11.206.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.66.keytab.
I20260812 00:02:02.007956 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.66:0
--local_ip_for_outbound_sockets=127.11.206.66
--webserver_interface=127.11.206.66
--webserver_port=0
--tserver_master_addrs=127.11.206.126:43243
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.66.keytab
--principal=kudu/127.11.206.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:34855
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:02:02.089676 18717 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:02:02.089898 18717 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:02:02.089931 18717 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:02:02.091068 18717 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:02:02.091109 18717 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:02:02.091143 18717 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.66
I20260812 00:02:02.092888 18717 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:34855
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.66.keytab
--principal=kudu/127.11.206.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.206.66
--webserver_port=0
--tserver_master_addrs=127.11.206.126:43243
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18717
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.66
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:02:02.093242 18717 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:02:02.093492 18717 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:02:02.098614 18729 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:02.098645 18717 server_base.cc:1034] running on GCE node
W20260812 00:02:02.098639 18727 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:02.098614 18726 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:02.099004 18717 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:02:02.099251 18717 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:02:02.100389 18717 hybrid_clock.cc:648] HybridClock initialized: now 1786492922100378 us; error 31 us; skew 500 ppm
Aug 12 00:02:02 dist-test-slave-f0tn krb5kdc[18330](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492922, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:02:02.102887 18717 init.cc:377] Logged in from keytab as kudu/127.11.206.66@KRBTEST.COM (short username kudu)
I20260812 00:02:02.103329 18717 webserver.cc:460] Webserver started at http://127.11.206.66:33385/ using document root <none> and password file <none>
I20260812 00:02:02.103509 18717 fs_manager.cc:359] Metadata directory not provided
I20260812 00:02:02.103549 18717 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:02:02.103642 18717 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:02:02.104638 18717 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/minicluster-data/ts-1/data/instance:
uuid: "33af2307be6d4c7698ffafed1ad0fa2e"
format_stamp: "Formatted at 2026-08-12 00:02:02 on dist-test-slave-f0tn"
server_key: "da0f621010c2705f335f19e9a2d64cee"
server_key_iv: "aa449c8a8c0128da9bba3adc84dfafce"
server_key_version: "encryptionkey@0"
I20260812 00:02:02.104948 18717 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/minicluster-data/ts-1/wal/instance:
uuid: "33af2307be6d4c7698ffafed1ad0fa2e"
format_stamp: "Formatted at 2026-08-12 00:02:02 on dist-test-slave-f0tn"
server_key: "da0f621010c2705f335f19e9a2d64cee"
server_key_iv: "aa449c8a8c0128da9bba3adc84dfafce"
server_key_version: "encryptionkey@0"
I20260812 00:02:02.106261 18717 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 00:02:02.107028 18740 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:02.107184 18717 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:02.107268 18717 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/minicluster-data/ts-1/wal
uuid: "33af2307be6d4c7698ffafed1ad0fa2e"
format_stamp: "Formatted at 2026-08-12 00:02:02 on dist-test-slave-f0tn"
server_key: "da0f621010c2705f335f19e9a2d64cee"
server_key_iv: "aa449c8a8c0128da9bba3adc84dfafce"
server_key_version: "encryptionkey@0"
I20260812 00:02:02.107338 18717 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:02:02.118342 18717 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:02:02.120061 18717 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:02:02.120188 18717 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:02:02.120401 18717 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:02:02.120699 18717 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:02:02.120733 18717 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:02.120762 18717 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:02:02.120786 18717 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:02.126446 18717 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.66:41313
I20260812 00:02:02.126485 18931 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.66:41313 every 8 connection(s)
I20260812 00:02:02.126792 18717 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
Aug 12 00:02:02 dist-test-slave-f0tn krb5kdc[18330](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492922, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.66@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:02:02.132669 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 18717
I20260812 00:02:02.132766 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/minicluster-data/ts-1/wal/instance
I20260812 00:02:02.132956 12089 external_mini_cluster.cc:1428] Setting key f025483a3ae85a75197533c388fc66c4
I20260812 00:02:02.135893 18470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:02.127462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.66:58481 (local address 127.11.206.126:43243)
0812 00:02:02.127540 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:02.127543 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:02.127689 (+ 146us) server_negotiation.cc:407] Connection header received
0812 00:02:02.128613 (+ 924us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:02.128614 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:02.128624 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:02.128659 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:02.129287 (+ 628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:02.129844 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:02.130793 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:02.130991 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:02.131037 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:02.133208 (+ 2171us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:02.133209 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:02.133210 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:02.133218 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:02.134546 (+ 1328us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:02.134981 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:02.134982 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:02.134982 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:02.135046 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:02.135305 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:02.135306 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:02.135306 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:02.135432 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:02.135495 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:02.135713 (+ 218us) server_negotiation.cc:299] Negotiation successful
0812 00:02:02.135804 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 00:02:02.135967 18941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:02.127434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:43243 (local address 127.11.206.66:58481)
0812 00:02:02.127581 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:02.127619 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:02.128512 (+ 893us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:02.128724 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:02.128727 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:02.128995 (+ 268us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:02.129213 (+ 218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:02.129219 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:02.129919 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:02.129920 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:02.130713 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:02.130715 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:02.131046 (+ 331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:02.131047 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:02.131158 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:02.131622 (+ 464us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:02.131630 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:02.133114 (+ 1484us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:02:02.134622 (+ 1508us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:02.134629 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:02.134631 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:02.134914 (+ 283us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:02.135111 (+ 197us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:02.135111 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:02.135112 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:02.135252 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:02.135487 (+ 235us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:02:02.135490 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:02:02.135605 (+ 115us) client_negotiation.cc:769] Sending connection context
0812 00:02:02.135680 (+ 75us) client_negotiation.cc:240] Negotiation successful
0812 00:02:02.135803 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":77,"threads_started":1}
I20260812 00:02:02.136420 18935 heartbeater.cc:347] Connected to a master server at 127.11.206.126:43243
I20260812 00:02:02.136504 18935 heartbeater.cc:464] Registering TS with master...
I20260812 00:02:02.136672 18935 heartbeater.cc:511] Master 127.11.206.126:43243 requested a full tablet report, sending...
I20260812 00:02:02.137034 18404 ts_manager.cc:194] Registered new tserver with Master: 33af2307be6d4c7698ffafed1ad0fa2e (127.11.206.66:41313)
I20260812 00:02:02.137431 18404 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.206.66@KRBTEST.COM'} at 127.11.206.66:58481
WARNING: no policy specified for kudu/127.11.206.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.67.keytab.
Entry for principal kudu/127.11.206.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.67.keytab.
I20260812 00:02:02.157701 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.67:0
--local_ip_for_outbound_sockets=127.11.206.67
--webserver_interface=127.11.206.67
--webserver_port=0
--tserver_master_addrs=127.11.206.126:43243
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.67.keytab
--principal=kudu/127.11.206.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:34855
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:02:02.238682 18945 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:02:02.238898 18945 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:02:02.238927 18945 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:02:02.240043 18945 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:02:02.240084 18945 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:02:02.240118 18945 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.67
I20260812 00:02:02.241629 18945 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:34855
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.67.keytab
--principal=kudu/127.11.206.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.206.67
--webserver_port=0
--tserver_master_addrs=127.11.206.126:43243
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18945
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.67
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:02:02.241878 18945 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:02:02.242086 18945 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:02:02.246871 18958 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:02.246862 18954 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:02.246865 18955 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:02.247167 18945 server_base.cc:1034] running on GCE node
I20260812 00:02:02.247380 18945 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:02:02.247603 18945 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:02:02.248741 18945 hybrid_clock.cc:648] HybridClock initialized: now 1786492922248722 us; error 28 us; skew 500 ppm
Aug 12 00:02:02 dist-test-slave-f0tn krb5kdc[18330](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492922, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:02:02.251143 18945 init.cc:377] Logged in from keytab as kudu/127.11.206.67@KRBTEST.COM (short username kudu)
I20260812 00:02:02.251552 18945 webserver.cc:460] Webserver started at http://127.11.206.67:39319/ using document root <none> and password file <none>
I20260812 00:02:02.251745 18945 fs_manager.cc:359] Metadata directory not provided
I20260812 00:02:02.251794 18945 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:02:02.251930 18945 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:02:02.252928 18945 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/minicluster-data/ts-2/data/instance:
uuid: "2446c8b5833a4b55abd6eb9126a3112f"
format_stamp: "Formatted at 2026-08-12 00:02:02 on dist-test-slave-f0tn"
server_key: "cac17779694cb5a34330995b37bd3487"
server_key_iv: "d58dfba2d52e693e12a9692c361033df"
server_key_version: "encryptionkey@0"
I20260812 00:02:02.253266 18945 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/minicluster-data/ts-2/wal/instance:
uuid: "2446c8b5833a4b55abd6eb9126a3112f"
format_stamp: "Formatted at 2026-08-12 00:02:02 on dist-test-slave-f0tn"
server_key: "cac17779694cb5a34330995b37bd3487"
server_key_iv: "d58dfba2d52e693e12a9692c361033df"
server_key_version: "encryptionkey@0"
I20260812 00:02:02.254506 18945 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 00:02:02.255155 18971 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:02.255308 18945 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 00:02:02.255393 18945 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/minicluster-data/ts-2/wal
uuid: "2446c8b5833a4b55abd6eb9126a3112f"
format_stamp: "Formatted at 2026-08-12 00:02:02 on dist-test-slave-f0tn"
server_key: "cac17779694cb5a34330995b37bd3487"
server_key_iv: "d58dfba2d52e693e12a9692c361033df"
server_key_version: "encryptionkey@0"
I20260812 00:02:02.255455 18945 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:02:02.270104 18945 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:02:02.271901 18945 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:02:02.272018 18945 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:02:02.272223 18945 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:02:02.272532 18945 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:02:02.272565 18945 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:02.272585 18945 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:02:02.272598 18945 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:02.278177 18945 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.67:41469
I20260812 00:02:02.278246 19178 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.67:41469 every 8 connection(s)
I20260812 00:02:02.278539 18945 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
I20260812 00:02:02.282465 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 18945
I20260812 00:02:02.282550 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786492899949492-12089-0/minicluster-data/ts-2/wal/instance
I20260812 00:02:02.282714 12089 external_mini_cluster.cc:1428] Setting key e0eb5d5343669f89691ab3711d971ead
Aug 12 00:02:02 dist-test-slave-f0tn krb5kdc[18330](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492922, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.67@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:02:02.287748 18470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:02.279261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.67:56471 (local address 127.11.206.126:43243)
0812 00:02:02.279307 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:02.279310 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:02.279507 (+ 197us) server_negotiation.cc:407] Connection header received
0812 00:02:02.280404 (+ 897us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:02.280405 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:02.280416 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:02.280465 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:02.281045 (+ 580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:02.281626 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:02.282640 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:02.282878 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:02.282955 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:02.285158 (+ 2203us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:02.285159 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:02.285160 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:02.285167 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:02.286519 (+ 1352us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:02.286889 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:02.286890 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:02.286891 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:02.286943 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:02.287158 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:02.287159 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:02.287160 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:02.287269 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:02.287324 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:02.287580 (+ 256us) server_negotiation.cc:299] Negotiation successful
0812 00:02:02.287657 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 00:02:02.287930 19181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:02.279223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:43243 (local address 127.11.206.67:56471)
0812 00:02:02.279404 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:02.279439 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:02.280319 (+ 880us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:02.280526 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:02.280530 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:02.280790 (+ 260us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:02.280984 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:02.280987 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:02.281693 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:02.281694 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:02.282562 (+ 868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:02.282565 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:02.282966 (+ 401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:02.282967 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:02.283099 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:02.283579 (+ 480us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:02.283587 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:02.285075 (+ 1488us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:02:02.286595 (+ 1520us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:02.286609 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:02.286612 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:02.286824 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:02.286995 (+ 171us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:02.286996 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:02.286996 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:02.287104 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:02.287325 (+ 221us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:02:02.287332 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:02:02.287465 (+ 133us) client_negotiation.cc:769] Sending connection context
0812 00:02:02.287553 (+ 88us) client_negotiation.cc:240] Negotiation successful
0812 00:02:02.287718 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":112,"threads_started":1}
I20260812 00:02:02.288306 19179 heartbeater.cc:347] Connected to a master server at 127.11.206.126:43243
I20260812 00:02:02.288405 19179 heartbeater.cc:464] Registering TS with master...
I20260812 00:02:02.288579 19179 heartbeater.cc:511] Master 127.11.206.126:43243 requested a full tablet report, sending...
I20260812 00:02:02.288910 18404 ts_manager.cc:194] Registered new tserver with Master: 2446c8b5833a4b55abd6eb9126a3112f (127.11.206.67:41469)
I20260812 00:02:02.289269 18404 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.206.67@KRBTEST.COM'} at 127.11.206.67:56471
I20260812 00:02:02.294165 12089 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 00:02:02 dist-test-slave-f0tn krb5kdc[18330](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492922, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 00:02:02 dist-test-slave-f0tn krb5kdc[18330](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492922, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.206.65@KRBTEST.COM
I20260812 00:02:02.316566 19193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:02.308999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59124 (local address 127.11.206.65:41527)
0812 00:02:02.309205 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:02.309211 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:02.309225 (+ 14us) server_negotiation.cc:407] Connection header received
0812 00:02:02.309263 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:02.309265 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:02.309280 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:02.309346 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:02.309887 (+ 541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:02.310660 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:02.311416 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:02.311737 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:02.311793 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:02.313847 (+ 2054us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:02.313856 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:02.313857 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:02.313864 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:02.315399 (+ 1535us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:02.315779 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:02.315783 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:02.315783 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:02.315866 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:02.316080 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:02.316081 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:02.316081 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:02.316217 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:02.316331 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:02.316387 (+ 56us) server_negotiation.cc:299] Negotiation successful
0812 00:02:02.316455 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":158,"thread_start_us":95,"threads_started":1}
Aug 12 00:02:02 dist-test-slave-f0tn krb5kdc[18330](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492922, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:02:02.323824 18470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:02.317820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45724 (local address 127.11.206.126:43243)
0812 00:02:02.317868 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:02.317870 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:02.317878 (+ 8us) server_negotiation.cc:407] Connection header received
0812 00:02:02.317933 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:02.317934 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:02.317943 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:02.317983 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:02.318413 (+ 430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:02.318903 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:02.319534 (+ 631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:02.319743 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:02.319792 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:02.321755 (+ 1963us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:02.321756 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:02.321756 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:02.321763 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:02.322989 (+ 1226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:02.323251 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:02.323251 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:02.323252 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:02.323294 (+ 42us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:02.323412 (+ 118us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:02.323412 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:02.323412 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:02.323544 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:02.323611 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:02.323698 (+ 87us) server_negotiation.cc:299] Negotiation successful
0812 00:02:02.323757 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
W20260812 00:02:02.324040 18404 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45724
I20260812 00:02:02.324378 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 18504
I20260812 00:02:02.334259 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 18717
I20260812 00:02:02.369879 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 18945
I20260812 00:02:02.381842 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 18346
2026-08-12T00:02:02Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (1996 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:02:02 dist-test-slave-f0tn krb5kdc[19203](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:02:02 dist-test-slave-f0tn krb5kdc[19203](info): set up 2 sockets
Aug 12 00:02:02 dist-test-slave-f0tn krb5kdc[19203](info): commencing operation
krb5kdc: starting...
W20260812 00:02:03.564179 12089 mini_kdc.cc:121] Time spent starting KDC: real 1.154s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/krb5kdc/test-user.keytab.
Aug 12 00:02:03 dist-test-slave-f0tn krb5kdc[19203](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492923, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:02:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:02:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.206.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab.
Entry for principal kudu/127.11.206.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab.
I20260812 00:02:03.676609 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:43619
--webserver_interface=127.11.206.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab
--principal=kudu/127.11.206.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:40147
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.206.126:43619
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:02:03.756992 19229 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:02:03.757216 19229 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:02:03.757246 19229 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:02:03.758410 19229 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:02:03.758450 19229 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:02:03.758468 19229 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:02:03.758483 19229 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:02:03.758498 19229 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:02:03.759982 19229 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:40147
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.206.126:43619
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab
--principal=kudu/127.11.206.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:43619
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.206.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19229
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:02:03.760236 19229 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:02:03.760450 19229 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:02:03.765136 19243 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:03.765148 19238 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:03.765141 19236 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:03.765319 19229 server_base.cc:1034] running on GCE node
I20260812 00:02:03.765580 19229 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:02:03.765820 19229 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:02:03.766956 19229 hybrid_clock.cc:648] HybridClock initialized: now 1786492923766917 us; error 55 us; skew 500 ppm
Aug 12 00:02:03 dist-test-slave-f0tn krb5kdc[19203](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492923, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:02:03.769414 19229 init.cc:377] Logged in from keytab as kudu/127.11.206.126@KRBTEST.COM (short username kudu)
I20260812 00:02:03.769742 19229 fs_manager.cc:359] Metadata directory not provided
I20260812 00:02:03.769797 19229 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:02:03.769927 19229 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:02:03.770952 19229 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/minicluster-data/master-0/data/instance:
uuid: "a67d7ad38ec04746810b88ac95897c88"
format_stamp: "Formatted at 2026-08-12 00:02:03 on dist-test-slave-f0tn"
server_key: "5746a6bd829b2646c0f4bb36cb7649c1"
server_key_iv: "c74ce94c7d0be35df07b06654f436cfc"
server_key_version: "encryptionkey@0"
I20260812 00:02:03.771310 19229 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/minicluster-data/master-0/wal/instance:
uuid: "a67d7ad38ec04746810b88ac95897c88"
format_stamp: "Formatted at 2026-08-12 00:02:03 on dist-test-slave-f0tn"
server_key: "5746a6bd829b2646c0f4bb36cb7649c1"
server_key_iv: "c74ce94c7d0be35df07b06654f436cfc"
server_key_version: "encryptionkey@0"
I20260812 00:02:03.772492 19229 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:02:03.773104 19253 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:03.773272 19229 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:02:03.773358 19229 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/minicluster-data/master-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/minicluster-data/master-0/wal
uuid: "a67d7ad38ec04746810b88ac95897c88"
format_stamp: "Formatted at 2026-08-12 00:02:03 on dist-test-slave-f0tn"
server_key: "5746a6bd829b2646c0f4bb36cb7649c1"
server_key_iv: "c74ce94c7d0be35df07b06654f436cfc"
server_key_version: "encryptionkey@0"
I20260812 00:02:03.773449 19229 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:02:03.781951 19229 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:02:03.783998 19229 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:02:03.784132 19229 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:02:03.787818 19229 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.126:43619
I20260812 00:02:03.787840 19332 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.126:43619 every 8 connection(s)
I20260812 00:02:03.788142 19229 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
I20260812 00:02:03.789151 19333 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:02:03.791107 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 19229
I20260812 00:02:03.791234 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/minicluster-data/master-0/wal/instance
I20260812 00:02:03.791436 12089 external_mini_cluster.cc:1428] Setting key 7d6c8c97a8b10c6ceade911ce15c63eb
I20260812 00:02:03.791636 19333 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a67d7ad38ec04746810b88ac95897c88: Bootstrap starting.
I20260812 00:02:03.792259 19333 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a67d7ad38ec04746810b88ac95897c88: Neither blocks nor log segments found. Creating new log.
I20260812 00:02:03.792526 19333 log.cc:824] T 00000000000000000000000000000000 P a67d7ad38ec04746810b88ac95897c88: Log is configured to *not* fsync() on all Append() calls
I20260812 00:02:03.793284 19333 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a67d7ad38ec04746810b88ac95897c88: No bootstrap required, opened a new log
I20260812 00:02:03.795251 19333 raft_consensus.cc:348] T 00000000000000000000000000000000 P a67d7ad38ec04746810b88ac95897c88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a67d7ad38ec04746810b88ac95897c88" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 43619 } }
I20260812 00:02:03.795424 19333 raft_consensus.cc:374] T 00000000000000000000000000000000 P a67d7ad38ec04746810b88ac95897c88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:02:03.795478 19333 raft_consensus.cc:729] T 00000000000000000000000000000000 P a67d7ad38ec04746810b88ac95897c88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a67d7ad38ec04746810b88ac95897c88, State: Initialized, Role: FOLLOWER
I20260812 00:02:03.795603 19333 consensus_queue.cc:260] T 00000000000000000000000000000000 P a67d7ad38ec04746810b88ac95897c88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a67d7ad38ec04746810b88ac95897c88" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 43619 } }
I20260812 00:02:03.795666 19333 raft_consensus.cc:388] T 00000000000000000000000000000000 P a67d7ad38ec04746810b88ac95897c88 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:02:03.795696 19333 raft_consensus.cc:482] T 00000000000000000000000000000000 P a67d7ad38ec04746810b88ac95897c88 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:02:03.795751 19333 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a67d7ad38ec04746810b88ac95897c88 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:02:03.796332 19333 raft_consensus.cc:504] T 00000000000000000000000000000000 P a67d7ad38ec04746810b88ac95897c88 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a67d7ad38ec04746810b88ac95897c88" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 43619 } }
I20260812 00:02:03.796437 19333 leader_election.cc:302] T 00000000000000000000000000000000 P a67d7ad38ec04746810b88ac95897c88 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a67d7ad38ec04746810b88ac95897c88; no voters:
I20260812 00:02:03.796638 19333 leader_election.cc:288] T 00000000000000000000000000000000 P a67d7ad38ec04746810b88ac95897c88 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:02:03.796680 19343 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a67d7ad38ec04746810b88ac95897c88 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:02:03.796867 19343 raft_consensus.cc:686] T 00000000000000000000000000000000 P a67d7ad38ec04746810b88ac95897c88 [term 1 LEADER]: Becoming Leader. State: Replica: a67d7ad38ec04746810b88ac95897c88, State: Running, Role: LEADER
I20260812 00:02:03.796908 19333 sys_catalog.cc:564] T 00000000000000000000000000000000 P a67d7ad38ec04746810b88ac95897c88 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:02:03.797034 19343 consensus_queue.cc:237] T 00000000000000000000000000000000 P a67d7ad38ec04746810b88ac95897c88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a67d7ad38ec04746810b88ac95897c88" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 43619 } }
I20260812 00:02:03.797439 19345 sys_catalog.cc:455] T 00000000000000000000000000000000 P a67d7ad38ec04746810b88ac95897c88 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a67d7ad38ec04746810b88ac95897c88" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a67d7ad38ec04746810b88ac95897c88" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 43619 } } }
I20260812 00:02:03.797452 19344 sys_catalog.cc:455] T 00000000000000000000000000000000 P a67d7ad38ec04746810b88ac95897c88 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a67d7ad38ec04746810b88ac95897c88. Latest consensus state: current_term: 1 leader_uuid: "a67d7ad38ec04746810b88ac95897c88" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a67d7ad38ec04746810b88ac95897c88" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 43619 } } }
I20260812 00:02:03.797617 19344 sys_catalog.cc:458] T 00000000000000000000000000000000 P a67d7ad38ec04746810b88ac95897c88 [sys.catalog]: This master's current role is: LEADER
I20260812 00:02:03.797832 19345 sys_catalog.cc:458] T 00000000000000000000000000000000 P a67d7ad38ec04746810b88ac95897c88 [sys.catalog]: This master's current role is: LEADER
I20260812 00:02:03.798164 19358 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
Aug 12 00:02:03 dist-test-slave-f0tn krb5kdc[19203](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492923, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:02:03.798766 19358 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:02:03.800318 19358 catalog_manager.cc:1347] Generated new cluster ID: 29d9413b17e74feca7e9483dc6004bc9
I20260812 00:02:03.800375 19358 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:02:03.802366 19338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:03.791895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33254 (local address 127.11.206.126:43619)
0812 00:02:03.792090 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:03.792100 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:03.792133 (+ 33us) server_negotiation.cc:407] Connection header received
0812 00:02:03.792592 (+ 459us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:03.792602 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:03.792663 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:03.792812 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:03.793568 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:03.794407 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:03.795464 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:03.795998 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:03.796078 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:03.798734 (+ 2656us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:03.798738 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:03.798739 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:03.798750 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:03.800743 (+ 1993us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:03.801111 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:03.801114 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:03.801115 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:03.801219 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:03.801411 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:03.801412 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:03.801412 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:03.801727 (+ 315us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:03.801899 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:03.801996 (+ 97us) server_negotiation.cc:299] Negotiation successful
0812 00:02:03.802143 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":93,"threads_started":1}
I20260812 00:02:03.823858 19358 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:02:03.824656 19358 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:02:03.835610 19358 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a67d7ad38ec04746810b88ac95897c88: Generated new TSK 0
I20260812 00:02:03.835855 19358 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.206.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.65.keytab.
Entry for principal kudu/127.11.206.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.65.keytab.
I20260812 00:02:03.869102 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.65:0
--local_ip_for_outbound_sockets=127.11.206.65
--webserver_interface=127.11.206.65
--webserver_port=0
--tserver_master_addrs=127.11.206.126:43619
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.65.keytab
--principal=kudu/127.11.206.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:40147
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:02:03.950299 19380 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:02:03.950495 19380 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:02:03.950527 19380 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:02:03.951637 19380 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:02:03.951673 19380 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:02:03.951709 19380 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.65
I20260812 00:02:03.953269 19380 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:40147
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.65.keytab
--principal=kudu/127.11.206.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.206.65
--webserver_port=0
--tserver_master_addrs=127.11.206.126:43619
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19380
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.65
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:02:03.953518 19380 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:02:03.953735 19380 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:02:03.958398 19389 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:03.958415 19387 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:03.958407 19393 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:03.958593 19380 server_base.cc:1034] running on GCE node
I20260812 00:02:03.958813 19380 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:02:03.959022 19380 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:02:03.960147 19380 hybrid_clock.cc:648] HybridClock initialized: now 1786492923960138 us; error 27 us; skew 500 ppm
Aug 12 00:02:03 dist-test-slave-f0tn krb5kdc[19203](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492923, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:02:03.962702 19380 init.cc:377] Logged in from keytab as kudu/127.11.206.65@KRBTEST.COM (short username kudu)
I20260812 00:02:03.963021 19380 fs_manager.cc:359] Metadata directory not provided
I20260812 00:02:03.963068 19380 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:02:03.963161 19380 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:02:03.964110 19380 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/minicluster-data/ts-0/data/instance:
uuid: "af1e64d410714230996197f5de8a1e3c"
format_stamp: "Formatted at 2026-08-12 00:02:03 on dist-test-slave-f0tn"
server_key: "18fa0cd55cd0a0edbf28a2f112691066"
server_key_iv: "81d970445639acb9cf22c294203e83ed"
server_key_version: "encryptionkey@0"
I20260812 00:02:03.964397 19380 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/minicluster-data/ts-0/wal/instance:
uuid: "af1e64d410714230996197f5de8a1e3c"
format_stamp: "Formatted at 2026-08-12 00:02:03 on dist-test-slave-f0tn"
server_key: "18fa0cd55cd0a0edbf28a2f112691066"
server_key_iv: "81d970445639acb9cf22c294203e83ed"
server_key_version: "encryptionkey@0"
I20260812 00:02:03.965543 19380 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 00:02:03.966176 19402 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:03.966321 19380 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:02:03.966390 19380 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/minicluster-data/ts-0/wal
uuid: "af1e64d410714230996197f5de8a1e3c"
format_stamp: "Formatted at 2026-08-12 00:02:03 on dist-test-slave-f0tn"
server_key: "18fa0cd55cd0a0edbf28a2f112691066"
server_key_iv: "81d970445639acb9cf22c294203e83ed"
server_key_version: "encryptionkey@0"
I20260812 00:02:03.966454 19380 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:02:03.979830 19380 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:02:03.981968 19380 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:02:03.982098 19380 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:02:03.982313 19380 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:02:03.982617 19380 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:02:03.982650 19380 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:03.982679 19380 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:02:03.982702 19380 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:03.988346 19380 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.65:44999
I20260812 00:02:03.988379 19589 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.65:44999 every 8 connection(s)
I20260812 00:02:03.988649 19380 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
I20260812 00:02:03.993803 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 19380
I20260812 00:02:03.993892 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/minicluster-data/ts-0/wal/instance
I20260812 00:02:03.994050 12089 external_mini_cluster.cc:1428] Setting key 32d026ff76fa8ac7950288db38433a4c
Aug 12 00:02:03 dist-test-slave-f0tn krb5kdc[19203](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492923, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.65@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:02:03.998132 19338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:03.989370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.65:34455 (local address 127.11.206.126:43619)
0812 00:02:03.989444 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:03.989446 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:03.989618 (+ 172us) server_negotiation.cc:407] Connection header received
0812 00:02:03.990125 (+ 507us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:03.990127 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:03.990141 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:03.990193 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:03.991170 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:03.991694 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:03.992701 (+ 1007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:03.992916 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:03.992972 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:03.995220 (+ 2248us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:03.995222 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:03.995222 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:03.995229 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:03.996592 (+ 1363us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:03.997070 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:03.997071 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:03.997072 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:03.997125 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:03.997418 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:03.997419 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:03.997419 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:03.997529 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:03.997589 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:03.997942 (+ 353us) server_negotiation.cc:299] Negotiation successful
0812 00:02:03.998042 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260812 00:02:03.998242 19592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:03.989323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:43619 (local address 127.11.206.65:34455)
0812 00:02:03.989491 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:03.989535 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:03.990021 (+ 486us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:03.990276 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:03.990281 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:03.990551 (+ 270us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:03.991060 (+ 509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:03.991065 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:03.991779 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:03.991781 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:03.992609 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:03.992612 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:03.992986 (+ 374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:03.992987 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:03.993111 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:03.993594 (+ 483us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:03.993602 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:03.995133 (+ 1531us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:02:03.996665 (+ 1532us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:03.996672 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:03.996675 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:03.997006 (+ 331us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:03.997179 (+ 173us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:03.997180 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:03.997181 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:03.997321 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:03.997620 (+ 299us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:02:03.997626 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:02:03.997765 (+ 139us) client_negotiation.cc:769] Sending connection context
0812 00:02:03.997906 (+ 141us) client_negotiation.cc:240] Negotiation successful
0812 00:02:03.998038 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":86,"threads_started":1}
I20260812 00:02:03.998766 19590 heartbeater.cc:347] Connected to a master server at 127.11.206.126:43619
I20260812 00:02:03.998857 19590 heartbeater.cc:464] Registering TS with master...
I20260812 00:02:03.999001 19590 heartbeater.cc:511] Master 127.11.206.126:43619 requested a full tablet report, sending...
I20260812 00:02:03.999524 19277 ts_manager.cc:194] Registered new tserver with Master: af1e64d410714230996197f5de8a1e3c (127.11.206.65:44999)
I20260812 00:02:04.000125 19277 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.206.65@KRBTEST.COM'} at 127.11.206.65:34455
WARNING: no policy specified for kudu/127.11.206.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.66.keytab.
Entry for principal kudu/127.11.206.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.66.keytab.
I20260812 00:02:04.019766 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.66:0
--local_ip_for_outbound_sockets=127.11.206.66
--webserver_interface=127.11.206.66
--webserver_port=0
--tserver_master_addrs=127.11.206.126:43619
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.66.keytab
--principal=kudu/127.11.206.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:40147
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:02:04.101323 19598 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:02:04.101577 19598 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:02:04.101601 19598 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:02:04.102821 19598 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:02:04.102867 19598 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:02:04.102895 19598 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.66
I20260812 00:02:04.104441 19598 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:40147
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.66.keytab
--principal=kudu/127.11.206.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.206.66
--webserver_port=0
--tserver_master_addrs=127.11.206.126:43619
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19598
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.66
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:02:04.104672 19598 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:02:04.104910 19598 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:02:04.109833 19609 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:04.109833 19613 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:04.109848 19598 server_base.cc:1034] running on GCE node
W20260812 00:02:04.109872 19605 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:04.110245 19598 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:02:04.110498 19598 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:02:04.111635 19598 hybrid_clock.cc:648] HybridClock initialized: now 1786492924111623 us; error 24 us; skew 500 ppm
Aug 12 00:02:04 dist-test-slave-f0tn krb5kdc[19203](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492924, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:02:04.114202 19598 init.cc:377] Logged in from keytab as kudu/127.11.206.66@KRBTEST.COM (short username kudu)
I20260812 00:02:04.114542 19598 fs_manager.cc:359] Metadata directory not provided
I20260812 00:02:04.114591 19598 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:02:04.114717 19598 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:02:04.115754 19598 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/minicluster-data/ts-1/data/instance:
uuid: "9dd52ca2b8ed4a3eb94b280ae17fed0e"
format_stamp: "Formatted at 2026-08-12 00:02:04 on dist-test-slave-f0tn"
server_key: "261cbe85bee80e6fdf7a85a6bfb7c845"
server_key_iv: "72e7cd9f60e071790390d7a3470e1542"
server_key_version: "encryptionkey@0"
I20260812 00:02:04.116082 19598 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/minicluster-data/ts-1/wal/instance:
uuid: "9dd52ca2b8ed4a3eb94b280ae17fed0e"
format_stamp: "Formatted at 2026-08-12 00:02:04 on dist-test-slave-f0tn"
server_key: "261cbe85bee80e6fdf7a85a6bfb7c845"
server_key_iv: "72e7cd9f60e071790390d7a3470e1542"
server_key_version: "encryptionkey@0"
I20260812 00:02:04.117323 19598 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:02:04.118046 19622 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:04.118199 19598 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:02:04.118289 19598 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/minicluster-data/ts-1/wal
uuid: "9dd52ca2b8ed4a3eb94b280ae17fed0e"
format_stamp: "Formatted at 2026-08-12 00:02:04 on dist-test-slave-f0tn"
server_key: "261cbe85bee80e6fdf7a85a6bfb7c845"
server_key_iv: "72e7cd9f60e071790390d7a3470e1542"
server_key_version: "encryptionkey@0"
I20260812 00:02:04.118348 19598 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:02:04.135243 19598 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:02:04.136997 19598 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:02:04.137135 19598 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:02:04.137367 19598 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:02:04.137701 19598 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:02:04.137737 19598 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:04.137766 19598 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:02:04.137789 19598 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:04.143170 19598 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.66:38481
I20260812 00:02:04.143229 19811 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.66:38481 every 8 connection(s)
I20260812 00:02:04.143486 19598 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
I20260812 00:02:04.144737 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 19598
I20260812 00:02:04.144830 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/minicluster-data/ts-1/wal/instance
I20260812 00:02:04.145030 12089 external_mini_cluster.cc:1428] Setting key 0c3694af94c22445f550af8c959de26f
Aug 12 00:02:04 dist-test-slave-f0tn krb5kdc[19203](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492924, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.66@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:02:04.153024 19338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:04.144186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.66:39749 (local address 127.11.206.126:43619)
0812 00:02:04.144275 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:04.144277 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:04.144414 (+ 137us) server_negotiation.cc:407] Connection header received
0812 00:02:04.145000 (+ 586us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:04.145001 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:04.145012 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:04.145054 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:04.146244 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:04.146728 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:04.147833 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:04.148114 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:04.148185 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:04.150436 (+ 2251us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:04.150438 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:04.150438 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:04.150446 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:04.151743 (+ 1297us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:04.152123 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:04.152125 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:04.152125 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:04.152179 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:04.152405 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:04.152406 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:04.152406 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:04.152520 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:04.152577 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:04.152846 (+ 269us) server_negotiation.cc:299] Negotiation successful
0812 00:02:04.152933 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260812 00:02:04.153194 19815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:04.144141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:43619 (local address 127.11.206.66:39749)
0812 00:02:04.144296 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:04.144332 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:04.144901 (+ 569us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:04.145130 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:04.145134 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:04.145498 (+ 364us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:04.146151 (+ 653us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:04.146159 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:04.146813 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:04.146814 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:04.147739 (+ 925us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:04.147741 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:04.148204 (+ 463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:04.148205 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:04.148343 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:04.148814 (+ 471us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:04.148824 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:04.150344 (+ 1520us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:02:04.151827 (+ 1483us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:04.151834 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:04.151837 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:04.152056 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:04.152232 (+ 176us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:04.152233 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:04.152234 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:04.152348 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:04.152575 (+ 227us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:02:04.152582 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:02:04.152724 (+ 142us) client_negotiation.cc:769] Sending connection context
0812 00:02:04.152815 (+ 91us) client_negotiation.cc:240] Negotiation successful
0812 00:02:04.152970 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":80,"threads_started":1}
WARNING: no policy specified for kudu/127.11.206.67@KRBTEST.COM; defaulting to no policy
I20260812 00:02:04.153651 19813 heartbeater.cc:347] Connected to a master server at 127.11.206.126:43619
I20260812 00:02:04.153743 19813 heartbeater.cc:464] Registering TS with master...
I20260812 00:02:04.153882 19813 heartbeater.cc:511] Master 127.11.206.126:43619 requested a full tablet report, sending...
I20260812 00:02:04.154304 19277 ts_manager.cc:194] Registered new tserver with Master: 9dd52ca2b8ed4a3eb94b280ae17fed0e (127.11.206.66:38481)
I20260812 00:02:04.154670 19277 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.206.66@KRBTEST.COM'} at 127.11.206.66:39749
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.67.keytab.
Entry for principal kudu/127.11.206.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.67.keytab.
I20260812 00:02:04.168923 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.67:0
--local_ip_for_outbound_sockets=127.11.206.67
--webserver_interface=127.11.206.67
--webserver_port=0
--tserver_master_addrs=127.11.206.126:43619
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.67.keytab
--principal=kudu/127.11.206.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:40147
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:02:04.251026 19819 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:02:04.251231 19819 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:02:04.251255 19819 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:02:04.252364 19819 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:02:04.252404 19819 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:02:04.252429 19819 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.67
I20260812 00:02:04.253981 19819 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:40147
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.67.keytab
--principal=kudu/127.11.206.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.206.67
--webserver_port=0
--tserver_master_addrs=127.11.206.126:43619
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19819
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.67
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:02:04.254216 19819 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:02:04.254416 19819 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:02:04.259163 19832 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:04.259159 19831 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:04.259181 19836 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:04.259251 19819 server_base.cc:1034] running on GCE node
I20260812 00:02:04.259589 19819 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:02:04.259785 19819 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:02:04.260949 19819 hybrid_clock.cc:648] HybridClock initialized: now 1786492924260939 us; error 28 us; skew 500 ppm
Aug 12 00:02:04 dist-test-slave-f0tn krb5kdc[19203](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492924, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:02:04.263496 19819 init.cc:377] Logged in from keytab as kudu/127.11.206.67@KRBTEST.COM (short username kudu)
I20260812 00:02:04.263836 19819 fs_manager.cc:359] Metadata directory not provided
I20260812 00:02:04.263885 19819 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:02:04.264000 19819 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:02:04.265018 19819 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/minicluster-data/ts-2/data/instance:
uuid: "08faaacf397a4eb19e481993764c12f0"
format_stamp: "Formatted at 2026-08-12 00:02:04 on dist-test-slave-f0tn"
server_key: "34fff65f9b36d71d7e612f7673a959cf"
server_key_iv: "c2d7457856e44ca8a9adaea21d4f8603"
server_key_version: "encryptionkey@0"
I20260812 00:02:04.265337 19819 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/minicluster-data/ts-2/wal/instance:
uuid: "08faaacf397a4eb19e481993764c12f0"
format_stamp: "Formatted at 2026-08-12 00:02:04 on dist-test-slave-f0tn"
server_key: "34fff65f9b36d71d7e612f7673a959cf"
server_key_iv: "c2d7457856e44ca8a9adaea21d4f8603"
server_key_version: "encryptionkey@0"
I20260812 00:02:04.266546 19819 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 00:02:04.267216 19844 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:04.267371 19819 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 00:02:04.267472 19819 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/minicluster-data/ts-2/wal
uuid: "08faaacf397a4eb19e481993764c12f0"
format_stamp: "Formatted at 2026-08-12 00:02:04 on dist-test-slave-f0tn"
server_key: "34fff65f9b36d71d7e612f7673a959cf"
server_key_iv: "c2d7457856e44ca8a9adaea21d4f8603"
server_key_version: "encryptionkey@0"
I20260812 00:02:04.267535 19819 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:02:04.292366 19819 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:02:04.294345 19819 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:02:04.294485 19819 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:02:04.294711 19819 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:02:04.295086 19819 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:02:04.295120 19819 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:04.295151 19819 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:02:04.295167 19819 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:04.300755 19819 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.67:40075
I20260812 00:02:04.300794 20052 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.67:40075 every 8 connection(s)
I20260812 00:02:04.301044 19819 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
I20260812 00:02:04.303880 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 19819
I20260812 00:02:04.303974 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/minicluster-data/ts-2/wal/instance
I20260812 00:02:04.304143 12089 external_mini_cluster.cc:1428] Setting key 1ed5dc75b11cfd37544b055c598373e5
Aug 12 00:02:04 dist-test-slave-f0tn krb5kdc[19203](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492924, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.67@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:02:04.310061 19338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:04.301707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.67:50409 (local address 127.11.206.126:43619)
0812 00:02:04.301755 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:04.301757 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:04.301976 (+ 219us) server_negotiation.cc:407] Connection header received
0812 00:02:04.302537 (+ 561us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:04.302538 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:04.302548 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:04.302596 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:04.303503 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:04.304160 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:04.305361 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:04.305628 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:04.305683 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:04.307586 (+ 1903us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:04.307587 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:04.307588 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:04.307595 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:04.308822 (+ 1227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:04.309179 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:04.309181 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:04.309181 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:04.309235 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:04.309475 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:04.309476 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:04.309476 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:04.309585 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:04.309641 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:04.309895 (+ 254us) server_negotiation.cc:299] Negotiation successful
0812 00:02:04.309972 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 00:02:04.310225 20055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:04.301702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:43619 (local address 127.11.206.67:50409)
0812 00:02:04.301862 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:04.301899 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:04.302447 (+ 548us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:04.302665 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:04.302668 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:04.302948 (+ 280us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:04.303436 (+ 488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:04.303441 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:04.304240 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:04.304241 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:04.305296 (+ 1055us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:04.305298 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:04.305691 (+ 393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:04.305692 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:04.305801 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:04.306184 (+ 383us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:04.306192 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:04.307501 (+ 1309us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:02:04.308896 (+ 1395us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:04.308903 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:04.308905 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:04.309116 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:04.309290 (+ 174us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:04.309291 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:04.309291 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:04.309423 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:04.309639 (+ 216us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:02:04.309646 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:02:04.309780 (+ 134us) client_negotiation.cc:769] Sending connection context
0812 00:02:04.309869 (+ 89us) client_negotiation.cc:240] Negotiation successful
0812 00:02:04.310016 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":97,"threads_started":1}
I20260812 00:02:04.310649 20053 heartbeater.cc:347] Connected to a master server at 127.11.206.126:43619
I20260812 00:02:04.310741 20053 heartbeater.cc:464] Registering TS with master...
I20260812 00:02:04.310878 20053 heartbeater.cc:511] Master 127.11.206.126:43619 requested a full tablet report, sending...
I20260812 00:02:04.311223 19277 ts_manager.cc:194] Registered new tserver with Master: 08faaacf397a4eb19e481993764c12f0 (127.11.206.67:40075)
I20260812 00:02:04.311583 19277 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.206.67@KRBTEST.COM'} at 127.11.206.67:50409
I20260812 00:02:04.315503 12089 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:02:04.321734 19338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:04.316674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33260 (local address 127.11.206.126:43619)
0812 00:02:04.316719 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:04.316721 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:04.316817 (+ 96us) server_negotiation.cc:407] Connection header received
0812 00:02:04.316856 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:04.316856 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:04.316864 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:04.316909 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:04.317437 (+ 528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:04.317901 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:04.318546 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:04.318710 (+ 164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:04.318747 (+ 37us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:04.319688 (+ 941us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:04.319689 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:04.319689 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:04.319695 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:04.320843 (+ 1148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:04.321124 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:04.321125 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:04.321125 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:04.321173 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:04.321304 (+ 131us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:04.321305 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:04.321305 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:04.321466 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:04.321540 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:04.321617 (+ 77us) server_negotiation.cc:299] Negotiation successful
0812 00:02:04.321673 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260812 00:02:04.323088 19277 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33260:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:02:04.324661 19277 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:02:04.330780 20072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:04.327052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57440 (local address 127.11.206.67:40075)
0812 00:02:04.327215 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:04.327219 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:04.327230 (+ 11us) server_negotiation.cc:407] Connection header received
0812 00:02:04.327271 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:04.327273 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:04.327354 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:04.327606 (+ 252us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:02:04.327665 (+ 59us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:04.328319 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:04.329781 (+ 1462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:04.330452 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:04.330513 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:04.330562 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:04.330656 (+ 94us) server_negotiation.cc:299] Negotiation successful
0812 00:02:04.330700 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":90,"threads_started":1}
I20260812 00:02:04.330834 20069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:04.326953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.67:40075 (local address 127.0.0.1:57440)
0812 00:02:04.327082 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:04.327093 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:04.327143 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:04.327449 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:04.327450 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:04.327452 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:02:04.327510 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:04.327511 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:04.328405 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:04.328406 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:04.329698 (+ 1292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:04.329701 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:04.330518 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:04.330519 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:04.330576 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:04.330579 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:02:04.330633 (+ 54us) client_negotiation.cc:240] Negotiation successful
0812 00:02:04.330712 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"mutex_wait_us":41,"thread_start_us":38,"threads_started":1}
I20260812 00:02:04.331044 20071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:04.326922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37064 (local address 127.11.206.66:38481)
0812 00:02:04.327260 (+ 338us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:04.327264 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:04.327271 (+ 7us) server_negotiation.cc:407] Connection header received
0812 00:02:04.327307 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:04.327310 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:04.327324 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:04.327528 (+ 204us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:02:04.327606 (+ 78us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:04.328604 (+ 998us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:04.329646 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:04.330374 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:04.330452 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:04.330517 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:04.330921 (+ 404us) server_negotiation.cc:299] Negotiation successful
0812 00:02:04.330968 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":289,"thread_start_us":79,"threads_started":1}
I20260812 00:02:04.330834 20067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:04.326806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.66:38481 (local address 127.0.0.1:37064)
0812 00:02:04.327032 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:04.327041 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:04.327079 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:04.327421 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:04.327421 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:04.327423 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:02:04.327463 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:04.327465 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:04.328682 (+ 1217us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:04.328683 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:04.329576 (+ 893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:04.329579 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:04.330460 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:04.330461 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:04.330539 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:04.330556 (+ 17us) client_negotiation.cc:769] Sending connection context
0812 00:02:04.330633 (+ 77us) client_negotiation.cc:240] Negotiation successful
0812 00:02:04.330711 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":216,"mutex_wait_us":3,"thread_start_us":58,"threads_started":1}
I20260812 00:02:04.331604 19934 tablet_service.cc:1467] Processing CreateTablet for tablet 75dcee306b1a4668b23b0247974ea827 (DEFAULT_TABLE table=test-table [id=2edcbd3f446548d0bc9422bb36ad010c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:02:04.331812 19706 tablet_service.cc:1467] Processing CreateTablet for tablet 75dcee306b1a4668b23b0247974ea827 (DEFAULT_TABLE table=test-table [id=2edcbd3f446548d0bc9422bb36ad010c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:02:04.332018 19934 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75dcee306b1a4668b23b0247974ea827. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:02:04.332041 20064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:04.326715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39276 (local address 127.11.206.65:44999)
0812 00:02:04.326919 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:04.326924 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:04.326935 (+ 11us) server_negotiation.cc:407] Connection header received
0812 00:02:04.326977 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:04.326980 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:04.326995 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:04.327075 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:02:04.327320 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:04.328444 (+ 1124us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:04.330597 (+ 2153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:04.331525 (+ 928us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:04.331591 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:04.331646 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:04.331915 (+ 269us) server_negotiation.cc:299] Negotiation successful
0812 00:02:04.331962 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":172,"thread_start_us":93,"threads_started":1}
I20260812 00:02:04.332170 19706 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75dcee306b1a4668b23b0247974ea827. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:02:04.332221 20063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:04.326587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.65:44999 (local address 127.0.0.1:39276)
0812 00:02:04.326714 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:04.326756 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:04.326815 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:04.327174 (+ 359us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:04.327177 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:04.327179 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:02:04.327244 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:04.327245 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:04.328533 (+ 1288us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:04.328534 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:04.329700 (+ 1166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:04.329702 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:04.331681 (+ 1979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:04.331682 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:04.331764 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:04.331768 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:02:04.331892 (+ 124us) client_negotiation.cc:240] Negotiation successful
0812 00:02:04.331937 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":101,"mutex_wait_us":3,"thread_start_us":71,"threads_started":1}
I20260812 00:02:04.332890 19488 tablet_service.cc:1467] Processing CreateTablet for tablet 75dcee306b1a4668b23b0247974ea827 (DEFAULT_TABLE table=test-table [id=2edcbd3f446548d0bc9422bb36ad010c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:02:04.333230 19488 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75dcee306b1a4668b23b0247974ea827. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:02:04.334949 20076 tablet_bootstrap.cc:492] T 75dcee306b1a4668b23b0247974ea827 P 9dd52ca2b8ed4a3eb94b280ae17fed0e: Bootstrap starting.
I20260812 00:02:04.335391 20077 tablet_bootstrap.cc:492] T 75dcee306b1a4668b23b0247974ea827 P 08faaacf397a4eb19e481993764c12f0: Bootstrap starting.
I20260812 00:02:04.335711 20076 tablet_bootstrap.cc:654] T 75dcee306b1a4668b23b0247974ea827 P 9dd52ca2b8ed4a3eb94b280ae17fed0e: Neither blocks nor log segments found. Creating new log.
I20260812 00:02:04.336045 20077 tablet_bootstrap.cc:654] T 75dcee306b1a4668b23b0247974ea827 P 08faaacf397a4eb19e481993764c12f0: Neither blocks nor log segments found. Creating new log.
I20260812 00:02:04.336339 20079 tablet_bootstrap.cc:492] T 75dcee306b1a4668b23b0247974ea827 P af1e64d410714230996197f5de8a1e3c: Bootstrap starting.
I20260812 00:02:04.336445 20076 log.cc:824] T 75dcee306b1a4668b23b0247974ea827 P 9dd52ca2b8ed4a3eb94b280ae17fed0e: Log is configured to *not* fsync() on all Append() calls
I20260812 00:02:04.336635 20077 log.cc:824] T 75dcee306b1a4668b23b0247974ea827 P 08faaacf397a4eb19e481993764c12f0: Log is configured to *not* fsync() on all Append() calls
I20260812 00:02:04.336998 20079 tablet_bootstrap.cc:654] T 75dcee306b1a4668b23b0247974ea827 P af1e64d410714230996197f5de8a1e3c: Neither blocks nor log segments found. Creating new log.
I20260812 00:02:04.337299 20076 tablet_bootstrap.cc:492] T 75dcee306b1a4668b23b0247974ea827 P 9dd52ca2b8ed4a3eb94b280ae17fed0e: No bootstrap required, opened a new log
I20260812 00:02:04.337355 20076 ts_tablet_manager.cc:1397] T 75dcee306b1a4668b23b0247974ea827 P 9dd52ca2b8ed4a3eb94b280ae17fed0e: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 00:02:04.337538 20079 log.cc:824] T 75dcee306b1a4668b23b0247974ea827 P af1e64d410714230996197f5de8a1e3c: Log is configured to *not* fsync() on all Append() calls
I20260812 00:02:04.337783 20077 tablet_bootstrap.cc:492] T 75dcee306b1a4668b23b0247974ea827 P 08faaacf397a4eb19e481993764c12f0: No bootstrap required, opened a new log
I20260812 00:02:04.337855 20077 ts_tablet_manager.cc:1397] T 75dcee306b1a4668b23b0247974ea827 P 08faaacf397a4eb19e481993764c12f0: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 00:02:04.338416 20079 tablet_bootstrap.cc:492] T 75dcee306b1a4668b23b0247974ea827 P af1e64d410714230996197f5de8a1e3c: No bootstrap required, opened a new log
I20260812 00:02:04.338486 20079 ts_tablet_manager.cc:1397] T 75dcee306b1a4668b23b0247974ea827 P af1e64d410714230996197f5de8a1e3c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 00:02:04.338973 20076 raft_consensus.cc:348] T 75dcee306b1a4668b23b0247974ea827 P 9dd52ca2b8ed4a3eb94b280ae17fed0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af1e64d410714230996197f5de8a1e3c" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 44999 } } peers { permanent_uuid: "9dd52ca2b8ed4a3eb94b280ae17fed0e" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 38481 } } peers { permanent_uuid: "08faaacf397a4eb19e481993764c12f0" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 40075 } }
I20260812 00:02:04.339115 20076 raft_consensus.cc:374] T 75dcee306b1a4668b23b0247974ea827 P 9dd52ca2b8ed4a3eb94b280ae17fed0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:02:04.339147 20076 raft_consensus.cc:729] T 75dcee306b1a4668b23b0247974ea827 P 9dd52ca2b8ed4a3eb94b280ae17fed0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd52ca2b8ed4a3eb94b280ae17fed0e, State: Initialized, Role: FOLLOWER
I20260812 00:02:04.339272 20076 consensus_queue.cc:260] T 75dcee306b1a4668b23b0247974ea827 P 9dd52ca2b8ed4a3eb94b280ae17fed0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af1e64d410714230996197f5de8a1e3c" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 44999 } } peers { permanent_uuid: "9dd52ca2b8ed4a3eb94b280ae17fed0e" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 38481 } } peers { permanent_uuid: "08faaacf397a4eb19e481993764c12f0" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 40075 } }
I20260812 00:02:04.339529 19813 heartbeater.cc:503] Master 127.11.206.126:43619 was elected leader, sending a full tablet report...
I20260812 00:02:04.339538 20076 ts_tablet_manager.cc:1428] T 75dcee306b1a4668b23b0247974ea827 P 9dd52ca2b8ed4a3eb94b280ae17fed0e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 00:02:04.339781 20077 raft_consensus.cc:348] T 75dcee306b1a4668b23b0247974ea827 P 08faaacf397a4eb19e481993764c12f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af1e64d410714230996197f5de8a1e3c" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 44999 } } peers { permanent_uuid: "9dd52ca2b8ed4a3eb94b280ae17fed0e" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 38481 } } peers { permanent_uuid: "08faaacf397a4eb19e481993764c12f0" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 40075 } }
I20260812 00:02:04.339944 20077 raft_consensus.cc:374] T 75dcee306b1a4668b23b0247974ea827 P 08faaacf397a4eb19e481993764c12f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:02:04.339985 20077 raft_consensus.cc:729] T 75dcee306b1a4668b23b0247974ea827 P 08faaacf397a4eb19e481993764c12f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08faaacf397a4eb19e481993764c12f0, State: Initialized, Role: FOLLOWER
I20260812 00:02:04.340119 20077 consensus_queue.cc:260] T 75dcee306b1a4668b23b0247974ea827 P 08faaacf397a4eb19e481993764c12f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af1e64d410714230996197f5de8a1e3c" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 44999 } } peers { permanent_uuid: "9dd52ca2b8ed4a3eb94b280ae17fed0e" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 38481 } } peers { permanent_uuid: "08faaacf397a4eb19e481993764c12f0" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 40075 } }
I20260812 00:02:04.340391 20077 ts_tablet_manager.cc:1428] T 75dcee306b1a4668b23b0247974ea827 P 08faaacf397a4eb19e481993764c12f0: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260812 00:02:04.340384 20079 raft_consensus.cc:348] T 75dcee306b1a4668b23b0247974ea827 P af1e64d410714230996197f5de8a1e3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af1e64d410714230996197f5de8a1e3c" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 44999 } } peers { permanent_uuid: "9dd52ca2b8ed4a3eb94b280ae17fed0e" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 38481 } } peers { permanent_uuid: "08faaacf397a4eb19e481993764c12f0" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 40075 } }
I20260812 00:02:04.340515 20053 heartbeater.cc:503] Master 127.11.206.126:43619 was elected leader, sending a full tablet report...
I20260812 00:02:04.340541 20079 raft_consensus.cc:374] T 75dcee306b1a4668b23b0247974ea827 P af1e64d410714230996197f5de8a1e3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:02:04.340575 20079 raft_consensus.cc:729] T 75dcee306b1a4668b23b0247974ea827 P af1e64d410714230996197f5de8a1e3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af1e64d410714230996197f5de8a1e3c, State: Initialized, Role: FOLLOWER
I20260812 00:02:04.340682 20079 consensus_queue.cc:260] T 75dcee306b1a4668b23b0247974ea827 P af1e64d410714230996197f5de8a1e3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af1e64d410714230996197f5de8a1e3c" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 44999 } } peers { permanent_uuid: "9dd52ca2b8ed4a3eb94b280ae17fed0e" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 38481 } } peers { permanent_uuid: "08faaacf397a4eb19e481993764c12f0" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 40075 } }
I20260812 00:02:04.340951 20079 ts_tablet_manager.cc:1428] T 75dcee306b1a4668b23b0247974ea827 P af1e64d410714230996197f5de8a1e3c: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260812 00:02:04.341009 19590 heartbeater.cc:503] Master 127.11.206.126:43619 was elected leader, sending a full tablet report...
W20260812 00:02:04.394028 19814 tablet.cc:2369] T 75dcee306b1a4668b23b0247974ea827 P 9dd52ca2b8ed4a3eb94b280ae17fed0e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 00:02:04.489420 19591 tablet.cc:2369] T 75dcee306b1a4668b23b0247974ea827 P af1e64d410714230996197f5de8a1e3c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:02:04.524847 20093 raft_consensus.cc:482] T 75dcee306b1a4668b23b0247974ea827 P af1e64d410714230996197f5de8a1e3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:02:04.524978 20093 raft_consensus.cc:504] T 75dcee306b1a4668b23b0247974ea827 P af1e64d410714230996197f5de8a1e3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af1e64d410714230996197f5de8a1e3c" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 44999 } } peers { permanent_uuid: "9dd52ca2b8ed4a3eb94b280ae17fed0e" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 38481 } } peers { permanent_uuid: "08faaacf397a4eb19e481993764c12f0" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 40075 } }
I20260812 00:02:04.525331 20093 leader_election.cc:288] T 75dcee306b1a4668b23b0247974ea827 P af1e64d410714230996197f5de8a1e3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9dd52ca2b8ed4a3eb94b280ae17fed0e (127.11.206.66:38481), 08faaacf397a4eb19e481993764c12f0 (127.11.206.67:40075)
I20260812 00:02:04.528842 20071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:04.525627 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.65:48999 (local address 127.11.206.66:38481)
0812 00:02:04.525682 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:04.525684 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:04.525758 (+ 74us) server_negotiation.cc:407] Connection header received
0812 00:02:04.525836 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:04.525838 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:04.525862 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:04.525908 (+ 46us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:02:04.526076 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:04.526633 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:04.527977 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:04.528530 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:04.528602 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:04.528612 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:04.528740 (+ 128us) server_negotiation.cc:299] Negotiation successful
0812 00:02:04.528776 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 00:02:04.528844 20094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:04.525539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.66:38481 (local address 127.11.206.65:48999)
0812 00:02:04.525656 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:04.525683 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:04.525765 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:04.525918 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:04.525919 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:04.525921 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:02:04.526015 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:04.526018 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:04.526723 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:04.526724 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:04.527886 (+ 1162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:04.527888 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:04.528602 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:04.528603 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:04.528657 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:04.528661 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:02:04.528722 (+ 61us) client_negotiation.cc:240] Negotiation successful
0812 00:02:04.528764 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":68,"threads_started":1}
I20260812 00:02:04.528905 20072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:04.525895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.65:41043 (local address 127.11.206.67:40075)
0812 00:02:04.525945 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:04.525947 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:04.525954 (+ 7us) server_negotiation.cc:407] Connection header received
0812 00:02:04.525977 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:04.525979 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:04.525988 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:04.526040 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:02:04.526203 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:04.526868 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:04.528081 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:04.528627 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:04.528684 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:04.528690 (+ 6us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:04.528813 (+ 123us) server_negotiation.cc:299] Negotiation successful
0812 00:02:04.528848 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 00:02:04.529244 19732 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75dcee306b1a4668b23b0247974ea827" candidate_uuid: "af1e64d410714230996197f5de8a1e3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd52ca2b8ed4a3eb94b280ae17fed0e" is_pre_election: true
I20260812 00:02:04.529335 20095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:04.525697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.67:40075 (local address 127.11.206.65:41043)
0812 00:02:04.525791 (+ 94us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:04.525802 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:04.525858 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:04.526059 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:04.526060 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:04.526062 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:02:04.526138 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:04.526140 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:04.526938 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:04.526938 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:04.528010 (+ 1072us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:04.528012 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:04.528690 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:04.528691 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:04.528756 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:04.528758 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 00:02:04.528804 (+ 46us) client_negotiation.cc:240] Negotiation successful
0812 00:02:04.528833 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":82,"thread_start_us":65,"threads_started":1}
I20260812 00:02:04.529402 19732 raft_consensus.cc:2454] T 75dcee306b1a4668b23b0247974ea827 P 9dd52ca2b8ed4a3eb94b280ae17fed0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1e64d410714230996197f5de8a1e3c in term 0.
I20260812 00:02:04.529618 19405 leader_election.cc:302] T 75dcee306b1a4668b23b0247974ea827 P af1e64d410714230996197f5de8a1e3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9dd52ca2b8ed4a3eb94b280ae17fed0e, af1e64d410714230996197f5de8a1e3c; no voters:
I20260812 00:02:04.529736 20093 raft_consensus.cc:2781] T 75dcee306b1a4668b23b0247974ea827 P af1e64d410714230996197f5de8a1e3c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:02:04.529811 20093 raft_consensus.cc:482] T 75dcee306b1a4668b23b0247974ea827 P af1e64d410714230996197f5de8a1e3c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:02:04.529851 20093 raft_consensus.cc:3037] T 75dcee306b1a4668b23b0247974ea827 P af1e64d410714230996197f5de8a1e3c [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:02:04.529963 19974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75dcee306b1a4668b23b0247974ea827" candidate_uuid: "af1e64d410714230996197f5de8a1e3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08faaacf397a4eb19e481993764c12f0" is_pre_election: true
I20260812 00:02:04.530104 19974 raft_consensus.cc:2454] T 75dcee306b1a4668b23b0247974ea827 P 08faaacf397a4eb19e481993764c12f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af1e64d410714230996197f5de8a1e3c in term 0.
I20260812 00:02:04.530759 20093 raft_consensus.cc:504] T 75dcee306b1a4668b23b0247974ea827 P af1e64d410714230996197f5de8a1e3c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af1e64d410714230996197f5de8a1e3c" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 44999 } } peers { permanent_uuid: "9dd52ca2b8ed4a3eb94b280ae17fed0e" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 38481 } } peers { permanent_uuid: "08faaacf397a4eb19e481993764c12f0" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 40075 } }
I20260812 00:02:04.530870 20093 leader_election.cc:288] T 75dcee306b1a4668b23b0247974ea827 P af1e64d410714230996197f5de8a1e3c [CANDIDATE]: Term 1 election: Requested vote from peers 9dd52ca2b8ed4a3eb94b280ae17fed0e (127.11.206.66:38481), 08faaacf397a4eb19e481993764c12f0 (127.11.206.67:40075)
I20260812 00:02:04.531035 19974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75dcee306b1a4668b23b0247974ea827" candidate_uuid: "af1e64d410714230996197f5de8a1e3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08faaacf397a4eb19e481993764c12f0"
I20260812 00:02:04.531049 19732 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75dcee306b1a4668b23b0247974ea827" candidate_uuid: "af1e64d410714230996197f5de8a1e3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dd52ca2b8ed4a3eb94b280ae17fed0e"
I20260812 00:02:04.531121 19732 raft_consensus.cc:3037] T 75dcee306b1a4668b23b0247974ea827 P 9dd52ca2b8ed4a3eb94b280ae17fed0e [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:02:04.531132 19974 raft_consensus.cc:3037] T 75dcee306b1a4668b23b0247974ea827 P 08faaacf397a4eb19e481993764c12f0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:02:04.531982 19974 raft_consensus.cc:2454] T 75dcee306b1a4668b23b0247974ea827 P 08faaacf397a4eb19e481993764c12f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1e64d410714230996197f5de8a1e3c in term 1.
I20260812 00:02:04.531981 19732 raft_consensus.cc:2454] T 75dcee306b1a4668b23b0247974ea827 P 9dd52ca2b8ed4a3eb94b280ae17fed0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af1e64d410714230996197f5de8a1e3c in term 1.
I20260812 00:02:04.532158 19405 leader_election.cc:302] T 75dcee306b1a4668b23b0247974ea827 P af1e64d410714230996197f5de8a1e3c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9dd52ca2b8ed4a3eb94b280ae17fed0e, af1e64d410714230996197f5de8a1e3c; no voters:
I20260812 00:02:04.532249 20093 raft_consensus.cc:2781] T 75dcee306b1a4668b23b0247974ea827 P af1e64d410714230996197f5de8a1e3c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:02:04.532424 20093 raft_consensus.cc:686] T 75dcee306b1a4668b23b0247974ea827 P af1e64d410714230996197f5de8a1e3c [term 1 LEADER]: Becoming Leader. State: Replica: af1e64d410714230996197f5de8a1e3c, State: Running, Role: LEADER
I20260812 00:02:04.532548 20093 consensus_queue.cc:237] T 75dcee306b1a4668b23b0247974ea827 P af1e64d410714230996197f5de8a1e3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af1e64d410714230996197f5de8a1e3c" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 44999 } } peers { permanent_uuid: "9dd52ca2b8ed4a3eb94b280ae17fed0e" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 38481 } } peers { permanent_uuid: "08faaacf397a4eb19e481993764c12f0" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 40075 } }
I20260812 00:02:04.533428 19276 catalog_manager.cc:5495] T 75dcee306b1a4668b23b0247974ea827 P af1e64d410714230996197f5de8a1e3c reported cstate change: term changed from 0 to 1, leader changed from <none> to af1e64d410714230996197f5de8a1e3c (127.11.206.65). New cstate: current_term: 1 leader_uuid: "af1e64d410714230996197f5de8a1e3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af1e64d410714230996197f5de8a1e3c" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 44999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9dd52ca2b8ed4a3eb94b280ae17fed0e" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 38481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08faaacf397a4eb19e481993764c12f0" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 40075 } health_report { overall_health: UNKNOWN } } }
W20260812 00:02:04.551527 20054 tablet.cc:2369] T 75dcee306b1a4668b23b0247974ea827 P 08faaacf397a4eb19e481993764c12f0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:02:04.554759 20064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:04.552715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39278 (local address 127.11.206.65:44999)
0812 00:02:04.552768 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:04.552769 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:04.552777 (+ 8us) server_negotiation.cc:407] Connection header received
0812 00:02:04.552811 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:04.552812 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:04.552829 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:04.552888 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:02:04.552996 (+ 108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:04.553510 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:04.554201 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:04.554384 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:04.554429 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:04.554520 (+ 91us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:02:04.554618 (+ 98us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:02:04.554670 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:04.554683 (+ 13us) server_negotiation.cc:299] Negotiation successful
0812 00:02:04.554699 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260812 00:02:04.556510 19974 raft_consensus.cc:1261] T 75dcee306b1a4668b23b0247974ea827 P 08faaacf397a4eb19e481993764c12f0 [term 1 FOLLOWER]: Refusing update from remote peer af1e64d410714230996197f5de8a1e3c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:02:04.556522 19732 raft_consensus.cc:1261] T 75dcee306b1a4668b23b0247974ea827 P 9dd52ca2b8ed4a3eb94b280ae17fed0e [term 1 FOLLOWER]: Refusing update from remote peer af1e64d410714230996197f5de8a1e3c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:02:04.556838 20093 consensus_queue.cc:1035] T 75dcee306b1a4668b23b0247974ea827 P af1e64d410714230996197f5de8a1e3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9dd52ca2b8ed4a3eb94b280ae17fed0e" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 38481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:02:04.556984 20097 consensus_queue.cc:1035] T 75dcee306b1a4668b23b0247974ea827 P af1e64d410714230996197f5de8a1e3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "08faaacf397a4eb19e481993764c12f0" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 40075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:02:04.559993 20102 mvcc.cc:205] Tried to move back new op lower bound from 7317475018980933632 to 7317475018885906432. Current Snapshot: MvccSnapshot[applied={T|T < 7317475018980933632 or (T in {7317475018980933632})}]
I20260812 00:02:04.560132 20103 mvcc.cc:205] Tried to move back new op lower bound from 7317475018980933632 to 7317475018885906432. Current Snapshot: MvccSnapshot[applied={T|T < 7317475018980933632 or (T in {7317475018980933632})}]
I20260812 00:02:04.561367 19277 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33260:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:02:04.561487 19277 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33260:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:02:04.562229 19277 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a67d7ad38ec04746810b88ac95897c88: Sending DeleteTablet for 3 replicas of tablet 75dcee306b1a4668b23b0247974ea827
I20260812 00:02:04.562557 19706 tablet_service.cc:1514] Processing DeleteTablet for tablet 75dcee306b1a4668b23b0247974ea827 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:02:04 UTC) from {username='kudu', principal='kudu/127.11.206.126@KRBTEST.COM'} at 127.0.0.1:37064
I20260812 00:02:04.562626 19488 tablet_service.cc:1514] Processing DeleteTablet for tablet 75dcee306b1a4668b23b0247974ea827 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:02:04 UTC) from {username='kudu', principal='kudu/127.11.206.126@KRBTEST.COM'} at 127.0.0.1:39276
I20260812 00:02:04.562640 19934 tablet_service.cc:1514] Processing DeleteTablet for tablet 75dcee306b1a4668b23b0247974ea827 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:02:04 UTC) from {username='kudu', principal='kudu/127.11.206.126@KRBTEST.COM'} at 127.0.0.1:57440
I20260812 00:02:04.562907 20118 tablet_replica.cc:330] T 75dcee306b1a4668b23b0247974ea827 P af1e64d410714230996197f5de8a1e3c: stopping tablet replica
I20260812 00:02:04.563009 20118 raft_consensus.cc:2229] T 75dcee306b1a4668b23b0247974ea827 P af1e64d410714230996197f5de8a1e3c [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:02:04.563107 20118 raft_consensus.cc:2258] T 75dcee306b1a4668b23b0247974ea827 P af1e64d410714230996197f5de8a1e3c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:02:04.563155 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 19380
I20260812 00:02:04.563246 20117 tablet_replica.cc:330] T 75dcee306b1a4668b23b0247974ea827 P 9dd52ca2b8ed4a3eb94b280ae17fed0e: stopping tablet replica
I20260812 00:02:04.563331 20117 raft_consensus.cc:2229] T 75dcee306b1a4668b23b0247974ea827 P 9dd52ca2b8ed4a3eb94b280ae17fed0e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:02:04.563410 20117 raft_consensus.cc:2258] T 75dcee306b1a4668b23b0247974ea827 P 9dd52ca2b8ed4a3eb94b280ae17fed0e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:02:04.564035 20117 ts_tablet_manager.cc:1905] T 75dcee306b1a4668b23b0247974ea827 P 9dd52ca2b8ed4a3eb94b280ae17fed0e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:02:04.565354 20119 tablet_replica.cc:330] T 75dcee306b1a4668b23b0247974ea827 P 08faaacf397a4eb19e481993764c12f0: stopping tablet replica
I20260812 00:02:04.565424 20117 ts_tablet_manager.cc:1918] T 75dcee306b1a4668b23b0247974ea827 P 9dd52ca2b8ed4a3eb94b280ae17fed0e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:02:04.565485 20117 log.cc:1196] T 75dcee306b1a4668b23b0247974ea827 P 9dd52ca2b8ed4a3eb94b280ae17fed0e: Deleting WAL directory at /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/minicluster-data/ts-1/wal/wals/75dcee306b1a4668b23b0247974ea827
I20260812 00:02:04.565493 20119 raft_consensus.cc:2229] T 75dcee306b1a4668b23b0247974ea827 P 08faaacf397a4eb19e481993764c12f0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:02:04.565600 20119 raft_consensus.cc:2258] T 75dcee306b1a4668b23b0247974ea827 P 08faaacf397a4eb19e481993764c12f0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:02:04.565757 20117 ts_tablet_manager.cc:1939] T 75dcee306b1a4668b23b0247974ea827 P 9dd52ca2b8ed4a3eb94b280ae17fed0e: Deleting consensus metadata
I20260812 00:02:04.566725 19255 catalog_manager.cc:4841] TS 9dd52ca2b8ed4a3eb94b280ae17fed0e (127.11.206.66:38481): tablet 75dcee306b1a4668b23b0247974ea827 (table test-table [id=2edcbd3f446548d0bc9422bb36ad010c]) successfully deleted
I20260812 00:02:04.568971 20119 ts_tablet_manager.cc:1905] T 75dcee306b1a4668b23b0247974ea827 P 08faaacf397a4eb19e481993764c12f0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:02:04.570343 20119 ts_tablet_manager.cc:1918] T 75dcee306b1a4668b23b0247974ea827 P 08faaacf397a4eb19e481993764c12f0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:02:04.570420 20119 log.cc:1196] T 75dcee306b1a4668b23b0247974ea827 P 08faaacf397a4eb19e481993764c12f0: Deleting WAL directory at /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786492899949492-12089-0/minicluster-data/ts-2/wal/wals/75dcee306b1a4668b23b0247974ea827
I20260812 00:02:04.570613 20119 ts_tablet_manager.cc:1939] T 75dcee306b1a4668b23b0247974ea827 P 08faaacf397a4eb19e481993764c12f0: Deleting consensus metadata
I20260812 00:02:04.570997 19255 catalog_manager.cc:4841] TS 08faaacf397a4eb19e481993764c12f0 (127.11.206.67:40075): tablet 75dcee306b1a4668b23b0247974ea827 (table test-table [id=2edcbd3f446548d0bc9422bb36ad010c]) successfully deleted
W20260812 00:02:04.577045 19255 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.206.65:44999 (error 108)
I20260812 00:02:04.577577 20069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:04.577463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.65:44999 (local address 127.0.0.1:39294)
0812 00:02:04.577510 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:04.577547 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.65:44999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
I20260812 00:02:04.577677 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 19598
W20260812 00:02:04.577718 19255 catalog_manager.cc:4584] TS af1e64d410714230996197f5de8a1e3c (127.11.206.65:44999): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 75dcee306b1a4668b23b0247974ea827: Network error: Client connection negotiation failed: client connection to 127.11.206.65:44999: connect: Connection refused (error 111)
I20260812 00:02:04.604552 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 19819
I20260812 00:02:04.613691 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 19229
2026-08-12T00:02:04Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2230 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-12T00:02:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:02:04Z Disabled control of system clock
I20260812 00:02:04.648731 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492899949492-12089-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492899949492-12089-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492899949492-12089-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:43887
--webserver_interface=127.11.206.126
--webserver_port=0
--builtin_ntp_servers=127.11.206.84:43205
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.206.126:43887
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260812 00:02:04.729174 20127 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:02:04.729394 20127 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:02:04.729416 20127 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:02:04.730537 20127 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:02:04.730585 20127 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:02:04.730598 20127 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:02:04.730609 20127 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:02:04.730633 20127 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:02:04.731987 20127 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:43205
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492899949492-12089-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492899949492-12089-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.206.126:43887
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:43887
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.206.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20127
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492899949492-12089-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:02:04.732210 20127 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:02:04.732488 20127 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:02:04.737131 20143 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:04.737166 20127 server_base.cc:1034] running on GCE node
W20260812 00:02:04.737143 20142 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:04.737133 20147 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:04.737680 20127 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:02:04.737969 20127 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:02:04.739107 20127 hybrid_clock.cc:648] HybridClock initialized: now 1786492924739095 us; error 28 us; skew 500 ppm
I20260812 00:02:04.740221 20127 webserver.cc:460] Webserver started at http://127.11.206.126:37695/ using document root <none> and password file <none>
I20260812 00:02:04.740429 20127 fs_manager.cc:359] Metadata directory not provided
I20260812 00:02:04.740476 20127 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:02:04.740597 20127 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:02:04.741657 20127 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492899949492-12089-0/minicluster-data/master-0/data/instance:
uuid: "6f3350934f5d49499b013ee229df4527"
format_stamp: "Formatted at 2026-08-12 00:02:04 on dist-test-slave-f0tn"
server_key: "27442b1c42ed3e53221c2517bd4f3cfd"
server_key_iv: "7363f80245797bd220866846695ae2de"
server_key_version: "encryptionkey@0"
I20260812 00:02:04.742002 20127 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492899949492-12089-0/minicluster-data/master-0/wal/instance:
uuid: "6f3350934f5d49499b013ee229df4527"
format_stamp: "Formatted at 2026-08-12 00:02:04 on dist-test-slave-f0tn"
server_key: "27442b1c42ed3e53221c2517bd4f3cfd"
server_key_iv: "7363f80245797bd220866846695ae2de"
server_key_version: "encryptionkey@0"
I20260812 00:02:04.743253 20127 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 00:02:04.743906 20155 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:04.744072 20127 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:02:04.744153 20127 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492899949492-12089-0/minicluster-data/master-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492899949492-12089-0/minicluster-data/master-0/wal
uuid: "6f3350934f5d49499b013ee229df4527"
format_stamp: "Formatted at 2026-08-12 00:02:04 on dist-test-slave-f0tn"
server_key: "27442b1c42ed3e53221c2517bd4f3cfd"
server_key_iv: "7363f80245797bd220866846695ae2de"
server_key_version: "encryptionkey@0"
I20260812 00:02:04.744215 20127 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492899949492-12089-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492899949492-12089-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492899949492-12089-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:02:04.747419 20127 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:02:04.747648 20127 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:02:04.747771 20127 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:02:04.751298 20127 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.126:43887
I20260812 00:02:04.751331 20246 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.126:43887 every 8 connection(s)
I20260812 00:02:04.751616 20127 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
I20260812 00:02:04.752236 20247 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:02:04.752537 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 20127
I20260812 00:02:04.752637 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492899949492-12089-0/minicluster-data/master-0/wal/instance
I20260812 00:02:04.752810 12089 external_mini_cluster.cc:1428] Setting key 0d6e013668c7147908360f3d976516d7
I20260812 00:02:04.755314 20260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:04.753303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43256 (local address 127.11.206.126:43887)
0812 00:02:04.753523 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:04.753532 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:04.753564 (+ 32us) server_negotiation.cc:407] Connection header received
0812 00:02:04.754145 (+ 581us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:04.754154 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:04.754210 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:04.754352 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:04.754908 (+ 556us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:04.754911 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:04.754912 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:02:04.754916 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:04.754963 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:02:04.754976 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:04.755050 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:04.755082 (+ 32us) server_negotiation.cc:299] Negotiation successful
0812 00:02:04.755136 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":94,"threads_started":1}
I20260812 00:02:04.755918 20247 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6f3350934f5d49499b013ee229df4527: Bootstrap starting.
I20260812 00:02:04.756520 20247 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6f3350934f5d49499b013ee229df4527: Neither blocks nor log segments found. Creating new log.
I20260812 00:02:04.756735 20247 log.cc:824] T 00000000000000000000000000000000 P 6f3350934f5d49499b013ee229df4527: Log is configured to *not* fsync() on all Append() calls
I20260812 00:02:04.757354 20247 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6f3350934f5d49499b013ee229df4527: No bootstrap required, opened a new log
I20260812 00:02:04.758680 20247 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6f3350934f5d49499b013ee229df4527 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f3350934f5d49499b013ee229df4527" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 43887 } }
I20260812 00:02:04.758810 20247 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6f3350934f5d49499b013ee229df4527 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:02:04.758832 20247 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6f3350934f5d49499b013ee229df4527 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f3350934f5d49499b013ee229df4527, State: Initialized, Role: FOLLOWER
I20260812 00:02:04.758947 20247 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6f3350934f5d49499b013ee229df4527 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f3350934f5d49499b013ee229df4527" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 43887 } }
I20260812 00:02:04.759021 20247 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6f3350934f5d49499b013ee229df4527 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:02:04.759053 20247 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6f3350934f5d49499b013ee229df4527 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:02:04.759101 20247 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6f3350934f5d49499b013ee229df4527 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:02:04.759584 20247 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6f3350934f5d49499b013ee229df4527 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f3350934f5d49499b013ee229df4527" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 43887 } }
I20260812 00:02:04.759678 20247 leader_election.cc:302] T 00000000000000000000000000000000 P 6f3350934f5d49499b013ee229df4527 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6f3350934f5d49499b013ee229df4527; no voters:
I20260812 00:02:04.759833 20247 leader_election.cc:288] T 00000000000000000000000000000000 P 6f3350934f5d49499b013ee229df4527 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:02:04.760083 20263 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6f3350934f5d49499b013ee229df4527 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:02:04.760097 20247 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6f3350934f5d49499b013ee229df4527 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:02:04.760202 20263 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6f3350934f5d49499b013ee229df4527 [term 1 LEADER]: Becoming Leader. State: Replica: 6f3350934f5d49499b013ee229df4527, State: Running, Role: LEADER
I20260812 00:02:04.760305 20263 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6f3350934f5d49499b013ee229df4527 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f3350934f5d49499b013ee229df4527" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 43887 } }
I20260812 00:02:04.760607 20263 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6f3350934f5d49499b013ee229df4527 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6f3350934f5d49499b013ee229df4527. Latest consensus state: current_term: 1 leader_uuid: "6f3350934f5d49499b013ee229df4527" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f3350934f5d49499b013ee229df4527" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 43887 } } }
I20260812 00:02:04.760680 20263 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6f3350934f5d49499b013ee229df4527 [sys.catalog]: This master's current role is: LEADER
I20260812 00:02:04.760833 20264 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6f3350934f5d49499b013ee229df4527 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6f3350934f5d49499b013ee229df4527" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f3350934f5d49499b013ee229df4527" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 43887 } } }
I20260812 00:02:04.760892 20264 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6f3350934f5d49499b013ee229df4527 [sys.catalog]: This master's current role is: LEADER
I20260812 00:02:04.761525 20277 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:02:04.762105 20277 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:02:04.763469 20277 catalog_manager.cc:1347] Generated new cluster ID: ab8491ab295d41a8bf352cc18f35bbd8
I20260812 00:02:04.763522 20277 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:02:04.788479 20277 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:02:04.788691 20277 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:02:04.794976 20277 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6f3350934f5d49499b013ee229df4527: Generated new TSK 0
I20260812 00:02:04.795150 20277 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:02:04.806267 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492899949492-12089-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492899949492-12089-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492899949492-12089-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.65:0
--local_ip_for_outbound_sockets=127.11.206.65
--webserver_interface=127.11.206.65
--webserver_port=0
--tserver_master_addrs=127.11.206.126:43887
--builtin_ntp_servers=127.11.206.84:43205
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260812 00:02:04.888078 20291 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:02:04.888281 20291 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:02:04.888302 20291 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:02:04.889463 20291 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:02:04.889500 20291 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:02:04.889524 20291 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.65
I20260812 00:02:04.890970 20291 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:43205
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492899949492-12089-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492899949492-12089-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.206.65
--webserver_port=0
--tserver_master_addrs=127.11.206.126:43887
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20291
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.65
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492899949492-12089-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:02:04.891184 20291 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:02:04.891472 20291 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:02:04.896147 20302 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:04.896142 20299 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:04.896143 20308 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:04.896553 20291 server_base.cc:1034] running on GCE node
I20260812 00:02:04.896734 20291 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:02:04.896940 20291 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:02:04.898067 20291 hybrid_clock.cc:648] HybridClock initialized: now 1786492924898056 us; error 27 us; skew 500 ppm
I20260812 00:02:04.902776 20291 webserver.cc:460] Webserver started at http://127.11.206.65:42795/ using document root <none> and password file <none>
I20260812 00:02:04.902972 20291 fs_manager.cc:359] Metadata directory not provided
I20260812 00:02:04.903012 20291 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:02:04.903102 20291 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:02:04.904127 20291 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492899949492-12089-0/minicluster-data/ts-0/data/instance:
uuid: "8c933def15664303a76211ddba89c5b1"
format_stamp: "Formatted at 2026-08-12 00:02:04 on dist-test-slave-f0tn"
server_key: "518a811e17c7b72be6c2e0a51889411e"
server_key_iv: "2d07e08f074dcf15634cf40f74a9024f"
server_key_version: "encryptionkey@0"
I20260812 00:02:04.904419 20291 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492899949492-12089-0/minicluster-data/ts-0/wal/instance:
uuid: "8c933def15664303a76211ddba89c5b1"
format_stamp: "Formatted at 2026-08-12 00:02:04 on dist-test-slave-f0tn"
server_key: "518a811e17c7b72be6c2e0a51889411e"
server_key_iv: "2d07e08f074dcf15634cf40f74a9024f"
server_key_version: "encryptionkey@0"
I20260812 00:02:04.905623 20291 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 00:02:04.906292 20316 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:04.906453 20291 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:02:04.906536 20291 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492899949492-12089-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492899949492-12089-0/minicluster-data/ts-0/wal
uuid: "8c933def15664303a76211ddba89c5b1"
format_stamp: "Formatted at 2026-08-12 00:02:04 on dist-test-slave-f0tn"
server_key: "518a811e17c7b72be6c2e0a51889411e"
server_key_iv: "2d07e08f074dcf15634cf40f74a9024f"
server_key_version: "encryptionkey@0"
I20260812 00:02:04.906594 20291 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492899949492-12089-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492899949492-12089-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492899949492-12089-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:02:04.910023 20291 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:02:04.910235 20291 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:02:04.910322 20291 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:02:04.910466 20291 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:02:04.910718 20291 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:02:04.910748 20291 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:04.910768 20291 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:02:04.910796 20291 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:04.916090 20291 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.65:35303
I20260812 00:02:04.916152 20514 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.65:35303 every 8 connection(s)
I20260812 00:02:04.916428 20291 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
I20260812 00:02:04.919246 20260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:04.917161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.65:46795 (local address 127.11.206.126:43887)
0812 00:02:04.917243 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:04.917245 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:04.917431 (+ 186us) server_negotiation.cc:407] Connection header received
0812 00:02:04.917908 (+ 477us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:04.917909 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:04.917914 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:04.917964 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:04.919064 (+ 1100us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:04.919065 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:04.919065 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:02:04.919068 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:04.919081 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:02:04.919084 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:04.919123 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:04.919181 (+ 58us) server_negotiation.cc:299] Negotiation successful
0812 00:02:04.919195 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260812 00:02:04.919411 20518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:04.917078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:43887 (local address 127.11.206.65:46795)
0812 00:02:04.917299 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:04.917333 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:04.917826 (+ 493us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:04.918023 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:04.918026 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:04.918036 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:04.918920 (+ 884us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:02:04.918920 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:04.918948 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:02:04.918976 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:02:04.919130 (+ 154us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:02:04.919133 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:02:04.919135 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 00:02:04.919184 (+ 49us) client_negotiation.cc:240] Negotiation successful
0812 00:02:04.919231 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":92,"threads_started":1}
I20260812 00:02:04.919858 20515 heartbeater.cc:347] Connected to a master server at 127.11.206.126:43887
I20260812 00:02:04.919946 20515 heartbeater.cc:464] Registering TS with master...
I20260812 00:02:04.920089 20515 heartbeater.cc:511] Master 127.11.206.126:43887 requested a full tablet report, sending...
I20260812 00:02:04.920575 20188 ts_manager.cc:194] Registered new tserver with Master: 8c933def15664303a76211ddba89c5b1 (127.11.206.65:35303)
I20260812 00:02:04.921154 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 20291
I20260812 00:02:04.921233 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492899949492-12089-0/minicluster-data/ts-0/wal/instance
I20260812 00:02:04.921402 12089 external_mini_cluster.cc:1428] Setting key 7ba0ab343ded9d01cce8ca8f32a36b34
I20260812 00:02:04.922226 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492899949492-12089-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492899949492-12089-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492899949492-12089-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.66:0
--local_ip_for_outbound_sockets=127.11.206.66
--webserver_interface=127.11.206.66
--webserver_port=0
--tserver_master_addrs=127.11.206.126:43887
--builtin_ntp_servers=127.11.206.84:43205
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260812 00:02:05.003315 20519 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:02:05.003512 20519 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:02:05.003535 20519 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:02:05.004657 20519 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:02:05.004696 20519 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:02:05.004719 20519 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.66
I20260812 00:02:05.006063 20519 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:43205
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492899949492-12089-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492899949492-12089-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.206.66
--webserver_port=0
--tserver_master_addrs=127.11.206.126:43887
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20519
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.66
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492899949492-12089-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:02:05.006307 20519 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:02:05.006585 20519 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:02:05.011570 20526 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:05.011557 20531 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:05.011617 20519 server_base.cc:1034] running on GCE node
W20260812 00:02:05.011605 20525 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:05.011957 20519 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:02:05.012151 20519 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:02:05.013300 20519 hybrid_clock.cc:648] HybridClock initialized: now 1786492925013291 us; error 28 us; skew 500 ppm
I20260812 00:02:05.014523 20519 webserver.cc:460] Webserver started at http://127.11.206.66:34579/ using document root <none> and password file <none>
I20260812 00:02:05.014751 20519 fs_manager.cc:359] Metadata directory not provided
I20260812 00:02:05.014799 20519 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:02:05.014922 20519 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:02:05.015949 20519 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492899949492-12089-0/minicluster-data/ts-1/data/instance:
uuid: "03c78cfa1fcd4c4e9611fde68f0395e9"
format_stamp: "Formatted at 2026-08-12 00:02:05 on dist-test-slave-f0tn"
server_key: "5dd6e20293874ef2764b95ba2e7c15ca"
server_key_iv: "e581b05fb1a86bef63cb634e5207a156"
server_key_version: "encryptionkey@0"
I20260812 00:02:05.016296 20519 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492899949492-12089-0/minicluster-data/ts-1/wal/instance:
uuid: "03c78cfa1fcd4c4e9611fde68f0395e9"
format_stamp: "Formatted at 2026-08-12 00:02:05 on dist-test-slave-f0tn"
server_key: "5dd6e20293874ef2764b95ba2e7c15ca"
server_key_iv: "e581b05fb1a86bef63cb634e5207a156"
server_key_version: "encryptionkey@0"
I20260812 00:02:05.017588 20519 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:02:05.018301 20546 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:05.018491 20519 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:02:05.018584 20519 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492899949492-12089-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492899949492-12089-0/minicluster-data/ts-1/wal
uuid: "03c78cfa1fcd4c4e9611fde68f0395e9"
format_stamp: "Formatted at 2026-08-12 00:02:05 on dist-test-slave-f0tn"
server_key: "5dd6e20293874ef2764b95ba2e7c15ca"
server_key_iv: "e581b05fb1a86bef63cb634e5207a156"
server_key_version: "encryptionkey@0"
I20260812 00:02:05.018638 20519 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492899949492-12089-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492899949492-12089-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492899949492-12089-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:02:05.021871 20519 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:02:05.022084 20519 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:02:05.022172 20519 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:02:05.022322 20519 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:02:05.022563 20519 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:02:05.022593 20519 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:05.022614 20519 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:02:05.022629 20519 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:05.027909 20519 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.66:39349
I20260812 00:02:05.027969 20762 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.66:39349 every 8 connection(s)
I20260812 00:02:05.028196 20519 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
I20260812 00:02:05.031143 20260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:05.028832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.66:41651 (local address 127.11.206.126:43887)
0812 00:02:05.028890 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:05.028891 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:05.029181 (+ 290us) server_negotiation.cc:407] Connection header received
0812 00:02:05.029803 (+ 622us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:05.029804 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:05.029810 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:05.029856 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:05.030969 (+ 1113us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:05.030970 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:05.030970 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:02:05.030973 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:05.030983 (+ 10us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:02:05.030985 (+ 2us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:05.031019 (+ 34us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:05.031077 (+ 58us) server_negotiation.cc:299] Negotiation successful
0812 00:02:05.031086 (+ 9us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260812 00:02:05.031315 20778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:05.028809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:43887 (local address 127.11.206.66:41651)
0812 00:02:05.028997 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:05.029030 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:05.029703 (+ 673us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:05.029922 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:05.029925 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:05.029934 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:05.030848 (+ 914us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:02:05.030849 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:05.030877 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:02:05.030905 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:02:05.031029 (+ 124us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:02:05.031032 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:02:05.031035 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:02:05.031083 (+ 48us) client_negotiation.cc:240] Negotiation successful
0812 00:02:05.031133 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":94,"threads_started":1}
I20260812 00:02:05.031783 20770 heartbeater.cc:347] Connected to a master server at 127.11.206.126:43887
I20260812 00:02:05.031873 20770 heartbeater.cc:464] Registering TS with master...
I20260812 00:02:05.032012 20770 heartbeater.cc:511] Master 127.11.206.126:43887 requested a full tablet report, sending...
I20260812 00:02:05.032325 20188 ts_manager.cc:194] Registered new tserver with Master: 03c78cfa1fcd4c4e9611fde68f0395e9 (127.11.206.66:39349)
I20260812 00:02:05.036913 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 20519
I20260812 00:02:05.037000 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492899949492-12089-0/minicluster-data/ts-1/wal/instance
I20260812 00:02:05.037170 12089 external_mini_cluster.cc:1428] Setting key 77fcc828b9ad64d85c61bf9004563fe0
I20260812 00:02:05.038093 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492899949492-12089-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492899949492-12089-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492899949492-12089-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.67:0
--local_ip_for_outbound_sockets=127.11.206.67
--webserver_interface=127.11.206.67
--webserver_port=0
--tserver_master_addrs=127.11.206.126:43887
--builtin_ntp_servers=127.11.206.84:43205
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260812 00:02:05.119270 20779 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:02:05.119472 20779 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:02:05.119491 20779 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:02:05.120631 20779 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:02:05.120671 20779 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:02:05.120705 20779 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.67
I20260812 00:02:05.122203 20779 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:43205
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492899949492-12089-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492899949492-12089-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.206.67
--webserver_port=0
--tserver_master_addrs=127.11.206.126:43887
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20779
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.67
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492899949492-12089-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:02:05.122421 20779 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:02:05.122694 20779 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:02:05.127542 20797 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:05.127564 20779 server_base.cc:1034] running on GCE node
W20260812 00:02:05.127521 20793 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:05.127498 20795 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:05.127882 20779 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:02:05.128116 20779 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:02:05.129256 20779 hybrid_clock.cc:648] HybridClock initialized: now 1786492925129239 us; error 32 us; skew 500 ppm
I20260812 00:02:05.130475 20779 webserver.cc:460] Webserver started at http://127.11.206.67:39471/ using document root <none> and password file <none>
I20260812 00:02:05.130715 20779 fs_manager.cc:359] Metadata directory not provided
I20260812 00:02:05.130764 20779 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:02:05.130893 20779 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:02:05.131932 20779 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492899949492-12089-0/minicluster-data/ts-2/data/instance:
uuid: "87bec59d5df74ef28620162cb95c8018"
format_stamp: "Formatted at 2026-08-12 00:02:05 on dist-test-slave-f0tn"
server_key: "06ab59879cbdd2c6ec6e7f401a42df82"
server_key_iv: "5ef2d6ecf4e82e17182aa2425bf7c5f9"
server_key_version: "encryptionkey@0"
I20260812 00:02:05.132274 20779 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492899949492-12089-0/minicluster-data/ts-2/wal/instance:
uuid: "87bec59d5df74ef28620162cb95c8018"
format_stamp: "Formatted at 2026-08-12 00:02:05 on dist-test-slave-f0tn"
server_key: "06ab59879cbdd2c6ec6e7f401a42df82"
server_key_iv: "5ef2d6ecf4e82e17182aa2425bf7c5f9"
server_key_version: "encryptionkey@0"
I20260812 00:02:05.133486 20779 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:02:05.134181 20808 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:05.134328 20779 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:02:05.134408 20779 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492899949492-12089-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492899949492-12089-0/minicluster-data/ts-2/wal
uuid: "87bec59d5df74ef28620162cb95c8018"
format_stamp: "Formatted at 2026-08-12 00:02:05 on dist-test-slave-f0tn"
server_key: "06ab59879cbdd2c6ec6e7f401a42df82"
server_key_iv: "5ef2d6ecf4e82e17182aa2425bf7c5f9"
server_key_version: "encryptionkey@0"
I20260812 00:02:05.134474 20779 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492899949492-12089-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492899949492-12089-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492899949492-12089-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:02:05.137727 20779 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:02:05.137955 20779 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:02:05.138067 20779 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:02:05.138257 20779 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:02:05.138526 20779 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:02:05.138557 20779 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:05.138582 20779 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:02:05.138607 20779 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:05.144006 20779 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.67:35189
I20260812 00:02:05.144066 21039 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.67:35189 every 8 connection(s)
I20260812 00:02:05.144345 20779 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
I20260812 00:02:05.147094 20260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:05.144995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.67:40765 (local address 127.11.206.126:43887)
0812 00:02:05.145075 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:05.145077 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:05.145267 (+ 190us) server_negotiation.cc:407] Connection header received
0812 00:02:05.145745 (+ 478us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:05.145746 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:05.145752 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:05.145802 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:05.146899 (+ 1097us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:05.146901 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:05.146901 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:02:05.146905 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:05.146918 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:02:05.146922 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:05.146966 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:05.147031 (+ 65us) server_negotiation.cc:299] Negotiation successful
0812 00:02:05.147043 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 00:02:05.147282 21043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:05.144978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:43887 (local address 127.11.206.67:40765)
0812 00:02:05.145146 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:05.145178 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:05.145660 (+ 482us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:05.145856 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:05.145860 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:05.145868 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:05.146772 (+ 904us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:02:05.146773 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:05.146800 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:02:05.146827 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:02:05.146979 (+ 152us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:02:05.146981 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:02:05.146983 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 00:02:05.147032 (+ 49us) client_negotiation.cc:240] Negotiation successful
0812 00:02:05.147078 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":79,"threads_started":1}
I20260812 00:02:05.147675 21041 heartbeater.cc:347] Connected to a master server at 127.11.206.126:43887
I20260812 00:02:05.147753 21041 heartbeater.cc:464] Registering TS with master...
I20260812 00:02:05.147866 21041 heartbeater.cc:511] Master 127.11.206.126:43887 requested a full tablet report, sending...
I20260812 00:02:05.148186 20188 ts_manager.cc:194] Registered new tserver with Master: 87bec59d5df74ef28620162cb95c8018 (127.11.206.67:35189)
I20260812 00:02:05.152680 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 20779
I20260812 00:02:05.152773 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492899949492-12089-0/minicluster-data/ts-2/wal/instance
I20260812 00:02:05.152932 12089 external_mini_cluster.cc:1428] Setting key 2c8173adb697f8ecc644556a3068f5a8
I20260812 00:02:05.153791 12089 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:02:05.156014 20260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:05.154989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43272 (local address 127.11.206.126:43887)
0812 00:02:05.155053 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:05.155055 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:05.155152 (+ 97us) server_negotiation.cc:407] Connection header received
0812 00:02:05.155206 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:05.155207 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:05.155212 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:05.155259 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:05.155809 (+ 550us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:05.155810 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:05.155811 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:02:05.155815 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:05.155829 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:02:05.155833 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:05.155874 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:05.155932 (+ 58us) server_negotiation.cc:299] Negotiation successful
0812 00:02:05.155946 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260812 00:02:05.157529 20188 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43272:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:02:05.158993 20188 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:02:05.162599 21071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:05.161244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.67:35189 (local address 127.0.0.1:34364)
0812 00:02:05.161522 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:05.161531 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:05.161574 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:05.161983 (+ 409us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:05.161984 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:05.161986 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:05.162236 (+ 250us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:02:05.162237 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:05.162241 (+ 4us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:02:05.162250 (+ 9us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:02:05.162453 (+ 203us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:02:05.162460 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:02:05.162463 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:02:05.162523 (+ 60us) client_negotiation.cc:240] Negotiation successful
0812 00:02:05.162536 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":264,"thread_start_us":71,"threads_started":1}
I20260812 00:02:05.162676 21066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:05.160988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.66:39349 (local address 127.0.0.1:38812)
0812 00:02:05.161147 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:05.161185 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:05.161235 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:05.161659 (+ 424us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:05.161665 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:05.161671 (+ 6us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:05.162163 (+ 492us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:02:05.162164 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:05.162179 (+ 15us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:02:05.162202 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:02:05.162522 (+ 320us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:02:05.162523 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:02:05.162523 (+ 0us) client_negotiation.cc:769] Sending connection context
0812 00:02:05.162564 (+ 41us) client_negotiation.cc:240] Negotiation successful
0812 00:02:05.162577 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":79,"threads_started":1}
I20260812 00:02:05.162812 21073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:05.161344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34364 (local address 127.11.206.67:35189)
0812 00:02:05.161543 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:05.161548 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:05.161576 (+ 28us) server_negotiation.cc:407] Connection header received
0812 00:02:05.161616 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:05.161618 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:05.161627 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:05.161694 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:05.162322 (+ 628us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:05.162330 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:05.162331 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:02:05.162334 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:05.162367 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:02:05.162388 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:05.162442 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:05.162720 (+ 278us) server_negotiation.cc:299] Negotiation successful
0812 00:02:05.162737 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":164,"thread_start_us":96,"threads_started":1}
I20260812 00:02:05.163009 21063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:05.161007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.65:35303 (local address 127.0.0.1:44528)
0812 00:02:05.161366 (+ 359us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:05.161396 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:05.161437 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:05.161667 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:05.161668 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:05.161686 (+ 18us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:05.162424 (+ 738us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:02:05.162425 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:05.162432 (+ 7us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:02:05.162444 (+ 12us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:02:05.162913 (+ 469us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:02:05.162914 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:02:05.162914 (+ 0us) client_negotiation.cc:769] Sending connection context
0812 00:02:05.162945 (+ 31us) client_negotiation.cc:240] Negotiation successful
0812 00:02:05.162956 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":347,"thread_start_us":86,"threads_started":1}
I20260812 00:02:05.163046 21070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:05.161150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38812 (local address 127.11.206.66:39349)
0812 00:02:05.161543 (+ 393us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:05.161546 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:05.161555 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:02:05.161579 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:05.161583 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:05.161589 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:05.161657 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:05.162280 (+ 623us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:05.162289 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:05.162289 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:02:05.162293 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:05.162329 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:02:05.162350 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:05.162390 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:05.162579 (+ 189us) server_negotiation.cc:299] Negotiation successful
0812 00:02:05.162594 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":356,"thread_start_us":83,"threads_started":1}
I20260812 00:02:05.163292 21072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:05.161335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44528 (local address 127.11.206.65:35303)
0812 00:02:05.161503 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:05.161507 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:05.161519 (+ 12us) server_negotiation.cc:407] Connection header received
0812 00:02:05.161546 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:05.161548 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:05.161558 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:05.162521 (+ 963us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:05.162786 (+ 265us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:05.162789 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:05.162789 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:02:05.162792 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:05.162820 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:02:05.162833 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:05.163173 (+ 340us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:05.163197 (+ 24us) server_negotiation.cc:299] Negotiation successful
0812 00:02:05.163213 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":95,"threads_started":1}
I20260812 00:02:05.163475 20896 tablet_service.cc:1467] Processing CreateTablet for tablet b4d76e3a233048e188dc7095978315d8 (DEFAULT_TABLE table=test-table [id=8fd518c6ddb5474fbf5b49b639fb2d10]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:02:05.163626 20631 tablet_service.cc:1467] Processing CreateTablet for tablet b4d76e3a233048e188dc7095978315d8 (DEFAULT_TABLE table=test-table [id=8fd518c6ddb5474fbf5b49b639fb2d10]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:02:05.163856 20896 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b4d76e3a233048e188dc7095978315d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:02:05.163805 20405 tablet_service.cc:1467] Processing CreateTablet for tablet b4d76e3a233048e188dc7095978315d8 (DEFAULT_TABLE table=test-table [id=8fd518c6ddb5474fbf5b49b639fb2d10]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:02:05.163892 20631 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b4d76e3a233048e188dc7095978315d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:02:05.164048 20405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b4d76e3a233048e188dc7095978315d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:02:05.166805 21075 tablet_bootstrap.cc:492] T b4d76e3a233048e188dc7095978315d8 P 8c933def15664303a76211ddba89c5b1: Bootstrap starting.
I20260812 00:02:05.167253 21079 tablet_bootstrap.cc:492] T b4d76e3a233048e188dc7095978315d8 P 03c78cfa1fcd4c4e9611fde68f0395e9: Bootstrap starting.
I20260812 00:02:05.167423 21075 tablet_bootstrap.cc:654] T b4d76e3a233048e188dc7095978315d8 P 8c933def15664303a76211ddba89c5b1: Neither blocks nor log segments found. Creating new log.
I20260812 00:02:05.167683 21075 log.cc:824] T b4d76e3a233048e188dc7095978315d8 P 8c933def15664303a76211ddba89c5b1: Log is configured to *not* fsync() on all Append() calls
I20260812 00:02:05.167824 21079 tablet_bootstrap.cc:654] T b4d76e3a233048e188dc7095978315d8 P 03c78cfa1fcd4c4e9611fde68f0395e9: Neither blocks nor log segments found. Creating new log.
I20260812 00:02:05.168139 21079 log.cc:824] T b4d76e3a233048e188dc7095978315d8 P 03c78cfa1fcd4c4e9611fde68f0395e9: Log is configured to *not* fsync() on all Append() calls
I20260812 00:02:05.168460 21075 tablet_bootstrap.cc:492] T b4d76e3a233048e188dc7095978315d8 P 8c933def15664303a76211ddba89c5b1: No bootstrap required, opened a new log
I20260812 00:02:05.168467 21076 tablet_bootstrap.cc:492] T b4d76e3a233048e188dc7095978315d8 P 87bec59d5df74ef28620162cb95c8018: Bootstrap starting.
I20260812 00:02:05.168519 21075 ts_tablet_manager.cc:1397] T b4d76e3a233048e188dc7095978315d8 P 8c933def15664303a76211ddba89c5b1: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 00:02:05.168967 21076 tablet_bootstrap.cc:654] T b4d76e3a233048e188dc7095978315d8 P 87bec59d5df74ef28620162cb95c8018: Neither blocks nor log segments found. Creating new log.
I20260812 00:02:05.169219 21076 log.cc:824] T b4d76e3a233048e188dc7095978315d8 P 87bec59d5df74ef28620162cb95c8018: Log is configured to *not* fsync() on all Append() calls
I20260812 00:02:05.169709 21079 tablet_bootstrap.cc:492] T b4d76e3a233048e188dc7095978315d8 P 03c78cfa1fcd4c4e9611fde68f0395e9: No bootstrap required, opened a new log
I20260812 00:02:05.169762 21079 ts_tablet_manager.cc:1397] T b4d76e3a233048e188dc7095978315d8 P 03c78cfa1fcd4c4e9611fde68f0395e9: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260812 00:02:05.170584 21075 raft_consensus.cc:348] T b4d76e3a233048e188dc7095978315d8 P 8c933def15664303a76211ddba89c5b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c933def15664303a76211ddba89c5b1" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 35303 } } peers { permanent_uuid: "03c78cfa1fcd4c4e9611fde68f0395e9" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 39349 } } peers { permanent_uuid: "87bec59d5df74ef28620162cb95c8018" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 35189 } }
I20260812 00:02:05.170717 21075 raft_consensus.cc:374] T b4d76e3a233048e188dc7095978315d8 P 8c933def15664303a76211ddba89c5b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:02:05.170747 21075 raft_consensus.cc:729] T b4d76e3a233048e188dc7095978315d8 P 8c933def15664303a76211ddba89c5b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c933def15664303a76211ddba89c5b1, State: Initialized, Role: FOLLOWER
I20260812 00:02:05.170862 21075 consensus_queue.cc:260] T b4d76e3a233048e188dc7095978315d8 P 8c933def15664303a76211ddba89c5b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c933def15664303a76211ddba89c5b1" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 35303 } } peers { permanent_uuid: "03c78cfa1fcd4c4e9611fde68f0395e9" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 39349 } } peers { permanent_uuid: "87bec59d5df74ef28620162cb95c8018" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 35189 } }
I20260812 00:02:05.171123 21075 ts_tablet_manager.cc:1428] T b4d76e3a233048e188dc7095978315d8 P 8c933def15664303a76211ddba89c5b1: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 00:02:05.171175 20515 heartbeater.cc:503] Master 127.11.206.126:43887 was elected leader, sending a full tablet report...
I20260812 00:02:05.171690 21079 raft_consensus.cc:348] T b4d76e3a233048e188dc7095978315d8 P 03c78cfa1fcd4c4e9611fde68f0395e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c933def15664303a76211ddba89c5b1" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 35303 } } peers { permanent_uuid: "03c78cfa1fcd4c4e9611fde68f0395e9" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 39349 } } peers { permanent_uuid: "87bec59d5df74ef28620162cb95c8018" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 35189 } }
I20260812 00:02:05.171810 21079 raft_consensus.cc:374] T b4d76e3a233048e188dc7095978315d8 P 03c78cfa1fcd4c4e9611fde68f0395e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:02:05.171838 21079 raft_consensus.cc:729] T b4d76e3a233048e188dc7095978315d8 P 03c78cfa1fcd4c4e9611fde68f0395e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03c78cfa1fcd4c4e9611fde68f0395e9, State: Initialized, Role: FOLLOWER
I20260812 00:02:05.171948 21079 consensus_queue.cc:260] T b4d76e3a233048e188dc7095978315d8 P 03c78cfa1fcd4c4e9611fde68f0395e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c933def15664303a76211ddba89c5b1" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 35303 } } peers { permanent_uuid: "03c78cfa1fcd4c4e9611fde68f0395e9" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 39349 } } peers { permanent_uuid: "87bec59d5df74ef28620162cb95c8018" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 35189 } }
I20260812 00:02:05.172202 21079 ts_tablet_manager.cc:1428] T b4d76e3a233048e188dc7095978315d8 P 03c78cfa1fcd4c4e9611fde68f0395e9: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260812 00:02:05.172251 20770 heartbeater.cc:503] Master 127.11.206.126:43887 was elected leader, sending a full tablet report...
I20260812 00:02:05.172801 21076 tablet_bootstrap.cc:492] T b4d76e3a233048e188dc7095978315d8 P 87bec59d5df74ef28620162cb95c8018: No bootstrap required, opened a new log
I20260812 00:02:05.172915 21076 ts_tablet_manager.cc:1397] T b4d76e3a233048e188dc7095978315d8 P 87bec59d5df74ef28620162cb95c8018: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.001s
I20260812 00:02:05.174782 21076 raft_consensus.cc:348] T b4d76e3a233048e188dc7095978315d8 P 87bec59d5df74ef28620162cb95c8018 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c933def15664303a76211ddba89c5b1" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 35303 } } peers { permanent_uuid: "03c78cfa1fcd4c4e9611fde68f0395e9" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 39349 } } peers { permanent_uuid: "87bec59d5df74ef28620162cb95c8018" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 35189 } }
I20260812 00:02:05.174901 21076 raft_consensus.cc:374] T b4d76e3a233048e188dc7095978315d8 P 87bec59d5df74ef28620162cb95c8018 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:02:05.174921 21076 raft_consensus.cc:729] T b4d76e3a233048e188dc7095978315d8 P 87bec59d5df74ef28620162cb95c8018 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87bec59d5df74ef28620162cb95c8018, State: Initialized, Role: FOLLOWER
I20260812 00:02:05.175022 21076 consensus_queue.cc:260] T b4d76e3a233048e188dc7095978315d8 P 87bec59d5df74ef28620162cb95c8018 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c933def15664303a76211ddba89c5b1" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 35303 } } peers { permanent_uuid: "03c78cfa1fcd4c4e9611fde68f0395e9" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 39349 } } peers { permanent_uuid: "87bec59d5df74ef28620162cb95c8018" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 35189 } }
I20260812 00:02:05.175246 21076 ts_tablet_manager.cc:1428] T b4d76e3a233048e188dc7095978315d8 P 87bec59d5df74ef28620162cb95c8018: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260812 00:02:05.175282 21041 heartbeater.cc:503] Master 127.11.206.126:43887 was elected leader, sending a full tablet report...
W20260812 00:02:05.278685 20774 tablet.cc:2369] T b4d76e3a233048e188dc7095978315d8 P 03c78cfa1fcd4c4e9611fde68f0395e9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:02:05.280537 21089 raft_consensus.cc:482] T b4d76e3a233048e188dc7095978315d8 P 87bec59d5df74ef28620162cb95c8018 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:02:05.280648 21089 raft_consensus.cc:504] T b4d76e3a233048e188dc7095978315d8 P 87bec59d5df74ef28620162cb95c8018 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c933def15664303a76211ddba89c5b1" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 35303 } } peers { permanent_uuid: "03c78cfa1fcd4c4e9611fde68f0395e9" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 39349 } } peers { permanent_uuid: "87bec59d5df74ef28620162cb95c8018" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 35189 } }
I20260812 00:02:05.280982 21089 leader_election.cc:288] T b4d76e3a233048e188dc7095978315d8 P 87bec59d5df74ef28620162cb95c8018 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8c933def15664303a76211ddba89c5b1 (127.11.206.65:35303), 03c78cfa1fcd4c4e9611fde68f0395e9 (127.11.206.66:39349)
I20260812 00:02:05.282212 21043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:05.281171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.65:35303 (local address 127.11.206.67:46789)
0812 00:02:05.281226 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:05.281238 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:05.281294 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:05.281461 (+ 167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:05.281462 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:05.281464 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:05.281919 (+ 455us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:02:05.281920 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:05.281928 (+ 8us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:02:05.281942 (+ 14us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:02:05.282110 (+ 168us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:02:05.282111 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:02:05.282112 (+ 1us) client_negotiation.cc:769] Sending connection context
0812 00:02:05.282145 (+ 33us) client_negotiation.cc:240] Negotiation successful
0812 00:02:05.282157 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260812 00:02:05.282359 21072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:05.281287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.67:46789 (local address 127.11.206.65:35303)
0812 00:02:05.281332 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:05.281334 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:05.281342 (+ 8us) server_negotiation.cc:407] Connection header received
0812 00:02:05.281368 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:05.281369 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:05.281398 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:05.281449 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:05.282015 (+ 566us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:05.282016 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:05.282016 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:02:05.282021 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:05.282043 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:02:05.282048 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:05.282113 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:05.282272 (+ 159us) server_negotiation.cc:299] Negotiation successful
0812 00:02:05.282288 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 00:02:05.282397 21070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:05.281244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.67:52313 (local address 127.11.206.66:39349)
0812 00:02:05.281303 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:05.281305 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:05.281459 (+ 154us) server_negotiation.cc:407] Connection header received
0812 00:02:05.281523 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:05.281524 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:05.281530 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:05.281581 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:05.282166 (+ 585us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:05.282168 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:05.282168 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:02:05.282173 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:05.282190 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:02:05.282195 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:05.282242 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:05.282324 (+ 82us) server_negotiation.cc:299] Negotiation successful
0812 00:02:05.282338 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260812 00:02:05.282562 21090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:05.281180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.66:39349 (local address 127.11.206.67:52313)
0812 00:02:05.281367 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:05.281399 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:05.281462 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:05.281589 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:05.281589 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:05.281592 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:05.282083 (+ 491us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:02:05.282083 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:05.282090 (+ 7us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:02:05.282103 (+ 13us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:02:05.282245 (+ 142us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:02:05.282246 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:02:05.282246 (+ 0us) client_negotiation.cc:769] Sending connection context
0812 00:02:05.282468 (+ 222us) client_negotiation.cc:240] Negotiation successful
0812 00:02:05.282482 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172,"mutex_wait_us":4,"thread_start_us":116,"threads_started":1}
I20260812 00:02:05.282729 20433 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4d76e3a233048e188dc7095978315d8" candidate_uuid: "87bec59d5df74ef28620162cb95c8018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c933def15664303a76211ddba89c5b1" is_pre_election: true
I20260812 00:02:05.282902 20433 raft_consensus.cc:2454] T b4d76e3a233048e188dc7095978315d8 P 8c933def15664303a76211ddba89c5b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87bec59d5df74ef28620162cb95c8018 in term 0.
I20260812 00:02:05.282891 20672 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4d76e3a233048e188dc7095978315d8" candidate_uuid: "87bec59d5df74ef28620162cb95c8018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03c78cfa1fcd4c4e9611fde68f0395e9" is_pre_election: true
I20260812 00:02:05.283041 20672 raft_consensus.cc:2454] T b4d76e3a233048e188dc7095978315d8 P 03c78cfa1fcd4c4e9611fde68f0395e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87bec59d5df74ef28620162cb95c8018 in term 0.
I20260812 00:02:05.283135 20811 leader_election.cc:302] T b4d76e3a233048e188dc7095978315d8 P 87bec59d5df74ef28620162cb95c8018 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87bec59d5df74ef28620162cb95c8018, 8c933def15664303a76211ddba89c5b1; no voters:
I20260812 00:02:05.283267 21089 raft_consensus.cc:2781] T b4d76e3a233048e188dc7095978315d8 P 87bec59d5df74ef28620162cb95c8018 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:02:05.283335 21089 raft_consensus.cc:482] T b4d76e3a233048e188dc7095978315d8 P 87bec59d5df74ef28620162cb95c8018 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:02:05.283365 21089 raft_consensus.cc:3037] T b4d76e3a233048e188dc7095978315d8 P 87bec59d5df74ef28620162cb95c8018 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:02:05.284096 21089 raft_consensus.cc:504] T b4d76e3a233048e188dc7095978315d8 P 87bec59d5df74ef28620162cb95c8018 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c933def15664303a76211ddba89c5b1" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 35303 } } peers { permanent_uuid: "03c78cfa1fcd4c4e9611fde68f0395e9" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 39349 } } peers { permanent_uuid: "87bec59d5df74ef28620162cb95c8018" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 35189 } }
I20260812 00:02:05.284230 21089 leader_election.cc:288] T b4d76e3a233048e188dc7095978315d8 P 87bec59d5df74ef28620162cb95c8018 [CANDIDATE]: Term 1 election: Requested vote from peers 8c933def15664303a76211ddba89c5b1 (127.11.206.65:35303), 03c78cfa1fcd4c4e9611fde68f0395e9 (127.11.206.66:39349)
I20260812 00:02:05.284370 20672 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4d76e3a233048e188dc7095978315d8" candidate_uuid: "87bec59d5df74ef28620162cb95c8018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03c78cfa1fcd4c4e9611fde68f0395e9"
I20260812 00:02:05.284452 20672 raft_consensus.cc:3037] T b4d76e3a233048e188dc7095978315d8 P 03c78cfa1fcd4c4e9611fde68f0395e9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:02:05.284462 20433 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4d76e3a233048e188dc7095978315d8" candidate_uuid: "87bec59d5df74ef28620162cb95c8018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c933def15664303a76211ddba89c5b1"
I20260812 00:02:05.284526 20433 raft_consensus.cc:3037] T b4d76e3a233048e188dc7095978315d8 P 8c933def15664303a76211ddba89c5b1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:02:05.285406 20433 raft_consensus.cc:2454] T b4d76e3a233048e188dc7095978315d8 P 8c933def15664303a76211ddba89c5b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87bec59d5df74ef28620162cb95c8018 in term 1.
I20260812 00:02:05.285406 20672 raft_consensus.cc:2454] T b4d76e3a233048e188dc7095978315d8 P 03c78cfa1fcd4c4e9611fde68f0395e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87bec59d5df74ef28620162cb95c8018 in term 1.
I20260812 00:02:05.285571 20813 leader_election.cc:302] T b4d76e3a233048e188dc7095978315d8 P 87bec59d5df74ef28620162cb95c8018 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03c78cfa1fcd4c4e9611fde68f0395e9, 87bec59d5df74ef28620162cb95c8018; no voters:
I20260812 00:02:05.285660 21089 raft_consensus.cc:2781] T b4d76e3a233048e188dc7095978315d8 P 87bec59d5df74ef28620162cb95c8018 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:02:05.285816 21089 raft_consensus.cc:686] T b4d76e3a233048e188dc7095978315d8 P 87bec59d5df74ef28620162cb95c8018 [term 1 LEADER]: Becoming Leader. State: Replica: 87bec59d5df74ef28620162cb95c8018, State: Running, Role: LEADER
I20260812 00:02:05.285907 21089 consensus_queue.cc:237] T b4d76e3a233048e188dc7095978315d8 P 87bec59d5df74ef28620162cb95c8018 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c933def15664303a76211ddba89c5b1" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 35303 } } peers { permanent_uuid: "03c78cfa1fcd4c4e9611fde68f0395e9" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 39349 } } peers { permanent_uuid: "87bec59d5df74ef28620162cb95c8018" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 35189 } }
I20260812 00:02:05.286744 20188 catalog_manager.cc:5495] T b4d76e3a233048e188dc7095978315d8 P 87bec59d5df74ef28620162cb95c8018 reported cstate change: term changed from 0 to 1, leader changed from <none> to 87bec59d5df74ef28620162cb95c8018 (127.11.206.67). New cstate: current_term: 1 leader_uuid: "87bec59d5df74ef28620162cb95c8018" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c933def15664303a76211ddba89c5b1" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 35303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03c78cfa1fcd4c4e9611fde68f0395e9" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87bec59d5df74ef28620162cb95c8018" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 35189 } health_report { overall_health: HEALTHY } } }
I20260812 00:02:05.308275 21073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:05.307393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34366 (local address 127.11.206.67:35189)
0812 00:02:05.307454 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:05.307456 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:05.307466 (+ 10us) server_negotiation.cc:407] Connection header received
0812 00:02:05.307529 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:05.307530 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:05.307545 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:05.307586 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:05.308073 (+ 487us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:05.308075 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:05.308075 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:02:05.308079 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:05.308093 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:02:05.308097 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:05.308141 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:05.308181 (+ 40us) server_negotiation.cc:299] Negotiation successful
0812 00:02:05.308196 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260812 00:02:05.310297 20672 raft_consensus.cc:1261] T b4d76e3a233048e188dc7095978315d8 P 03c78cfa1fcd4c4e9611fde68f0395e9 [term 1 FOLLOWER]: Refusing update from remote peer 87bec59d5df74ef28620162cb95c8018: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:02:05.310322 20433 raft_consensus.cc:1261] T b4d76e3a233048e188dc7095978315d8 P 8c933def15664303a76211ddba89c5b1 [term 1 FOLLOWER]: Refusing update from remote peer 87bec59d5df74ef28620162cb95c8018: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:02:05.310669 21092 consensus_queue.cc:1035] T b4d76e3a233048e188dc7095978315d8 P 87bec59d5df74ef28620162cb95c8018 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c933def15664303a76211ddba89c5b1" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 35303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:02:05.310819 21089 consensus_queue.cc:1035] T b4d76e3a233048e188dc7095978315d8 P 87bec59d5df74ef28620162cb95c8018 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03c78cfa1fcd4c4e9611fde68f0395e9" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:02:05.313369 21100 mvcc.cc:205] Tried to move back new op lower bound from 7317475022067982336 to 7317475021971701760. Current Snapshot: MvccSnapshot[applied={T|T < 7317475022067982336}]
I20260812 00:02:05.313925 21098 mvcc.cc:205] Tried to move back new op lower bound from 7317475022067982336 to 7317475021971701760. Current Snapshot: MvccSnapshot[applied={T|T < 7317475022067982336}]
I20260812 00:02:05.315805 20188 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:43272:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:02:05.315888 20188 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:43272:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:02:05.316628 20188 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6f3350934f5d49499b013ee229df4527: Sending DeleteTablet for 3 replicas of tablet b4d76e3a233048e188dc7095978315d8
I20260812 00:02:05.316948 20405 tablet_service.cc:1514] Processing DeleteTablet for tablet b4d76e3a233048e188dc7095978315d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:02:05 UTC) from {username='slave'} at 127.0.0.1:44528
I20260812 00:02:05.317154 20631 tablet_service.cc:1514] Processing DeleteTablet for tablet b4d76e3a233048e188dc7095978315d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:02:05 UTC) from {username='slave'} at 127.0.0.1:38812
I20260812 00:02:05.317313 21109 tablet_replica.cc:330] T b4d76e3a233048e188dc7095978315d8 P 8c933def15664303a76211ddba89c5b1: stopping tablet replica
I20260812 00:02:05.317358 20896 tablet_service.cc:1514] Processing DeleteTablet for tablet b4d76e3a233048e188dc7095978315d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:02:05 UTC) from {username='slave'} at 127.0.0.1:34364
I20260812 00:02:05.317358 21110 tablet_replica.cc:330] T b4d76e3a233048e188dc7095978315d8 P 03c78cfa1fcd4c4e9611fde68f0395e9: stopping tablet replica
I20260812 00:02:05.317458 21109 raft_consensus.cc:2229] T b4d76e3a233048e188dc7095978315d8 P 8c933def15664303a76211ddba89c5b1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:02:05.317571 21109 raft_consensus.cc:2258] T b4d76e3a233048e188dc7095978315d8 P 8c933def15664303a76211ddba89c5b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:02:05.317641 21110 raft_consensus.cc:2229] T b4d76e3a233048e188dc7095978315d8 P 03c78cfa1fcd4c4e9611fde68f0395e9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:02:05.317669 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 20291
I20260812 00:02:05.317788 21110 raft_consensus.cc:2258] T b4d76e3a233048e188dc7095978315d8 P 03c78cfa1fcd4c4e9611fde68f0395e9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:02:05.327116 21110 ts_tablet_manager.cc:1905] T b4d76e3a233048e188dc7095978315d8 P 03c78cfa1fcd4c4e9611fde68f0395e9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:02:05.328681 21110 ts_tablet_manager.cc:1918] T b4d76e3a233048e188dc7095978315d8 P 03c78cfa1fcd4c4e9611fde68f0395e9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:02:05.328804 21110 log.cc:1196] T b4d76e3a233048e188dc7095978315d8 P 03c78cfa1fcd4c4e9611fde68f0395e9: Deleting WAL directory at /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492899949492-12089-0/minicluster-data/ts-1/wal/wals/b4d76e3a233048e188dc7095978315d8
I20260812 00:02:05.329046 21110 ts_tablet_manager.cc:1939] T b4d76e3a233048e188dc7095978315d8 P 03c78cfa1fcd4c4e9611fde68f0395e9: Deleting consensus metadata
I20260812 00:02:05.330567 21113 tablet_replica.cc:330] T b4d76e3a233048e188dc7095978315d8 P 87bec59d5df74ef28620162cb95c8018: stopping tablet replica
I20260812 00:02:05.330708 21113 raft_consensus.cc:2229] T b4d76e3a233048e188dc7095978315d8 P 87bec59d5df74ef28620162cb95c8018 [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:02:05.330827 21113 raft_consensus.cc:2258] T b4d76e3a233048e188dc7095978315d8 P 87bec59d5df74ef28620162cb95c8018 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:02:05.331358 21113 ts_tablet_manager.cc:1905] T b4d76e3a233048e188dc7095978315d8 P 87bec59d5df74ef28620162cb95c8018: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:02:05.331481 20158 catalog_manager.cc:4841] TS 03c78cfa1fcd4c4e9611fde68f0395e9 (127.11.206.66:39349): tablet b4d76e3a233048e188dc7095978315d8 (table test-table [id=8fd518c6ddb5474fbf5b49b639fb2d10]) successfully deleted
I20260812 00:02:05.332947 21113 ts_tablet_manager.cc:1918] T b4d76e3a233048e188dc7095978315d8 P 87bec59d5df74ef28620162cb95c8018: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:02:05.333017 21113 log.cc:1196] T b4d76e3a233048e188dc7095978315d8 P 87bec59d5df74ef28620162cb95c8018: Deleting WAL directory at /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786492899949492-12089-0/minicluster-data/ts-2/wal/wals/b4d76e3a233048e188dc7095978315d8
I20260812 00:02:05.333316 21113 ts_tablet_manager.cc:1939] T b4d76e3a233048e188dc7095978315d8 P 87bec59d5df74ef28620162cb95c8018: Deleting consensus metadata
I20260812 00:02:05.333885 20158 catalog_manager.cc:4841] TS 87bec59d5df74ef28620162cb95c8018 (127.11.206.67:35189): tablet b4d76e3a233048e188dc7095978315d8 (table test-table [id=8fd518c6ddb5474fbf5b49b639fb2d10]) successfully deleted
W20260812 00:02:05.334967 20156 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.206.65:35303 (error 108)
I20260812 00:02:05.335490 21063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:05.335348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.65:35303 (local address 127.0.0.1:44530)
0812 00:02:05.335402 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:05.335450 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.65:35303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260812 00:02:05.335556 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 20519
W20260812 00:02:05.349684 20156 catalog_manager.cc:4584] TS 8c933def15664303a76211ddba89c5b1 (127.11.206.65:35303): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b4d76e3a233048e188dc7095978315d8: Network error: Client connection negotiation failed: client connection to 127.11.206.65:35303: connect: Connection refused (error 111)
I20260812 00:02:05.354592 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 20779
I20260812 00:02:05.364440 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 20127
2026-08-12T00:02:05Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (753 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260812 00:02:05.394951 12089 mini_oidc.cc:152] Starting JWKS server
I20260812 00:02:05.396034 12089 webserver.cc:460] Webserver started at https://127.0.0.1:34595/ using document root <none> and password file <none>
I20260812 00:02:05.396133 12089 mini_oidc.cc:189] Starting OIDC Discovery server
I20260812 00:02:05.396303 12089 webserver.cc:460] Webserver started at http://127.0.0.1:39365/ using document root <none> and password file <none>
2026-08-12T00:02:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:02:05Z Disabled control of system clock
I20260812 00:02:05.404181 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786492899949492-12089-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786492899949492-12089-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786492899949492-12089-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:43279
--webserver_interface=127.11.206.126
--webserver_port=0
--builtin_ntp_servers=127.11.206.84:42037
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.206.126:43279
--enable_jwt_token_auth=true
--jwks_url=https://localhost:34595/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786492899949492-12089-0/testchainca.cert with env {}
W20260812 00:02:05.490118 21122 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:02:05.490376 21122 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:02:05.490402 21122 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:02:05.492044 21122 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:02:05.492125 21122 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:02:05.492138 21122 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:02:05.492151 21122 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:02:05.492165 21122 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260812 00:02:05.492177 21122 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260812 00:02:05.492187 21122 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:34595/jwks.json
I20260812 00:02:05.494426 21122 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:42037
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786492899949492-12089-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786492899949492-12089-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.206.126:43279
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:43279
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:34595/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.206.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786492899949492-12089-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21122
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786492899949492-12089-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:02:05.494793 21122 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:02:05.495152 21122 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:02:05.501211 21139 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:05.501333 21122 server_base.cc:1034] running on GCE node
W20260812 00:02:05.501240 21140 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:05.501276 21144 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:05.501993 21122 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:02:05.502389 21122 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:02:05.503605 21122 hybrid_clock.cc:648] HybridClock initialized: now 1786492925503576 us; error 48 us; skew 500 ppm
I20260812 00:02:05.505190 21122 webserver.cc:460] Webserver started at http://127.11.206.126:36787/ using document root <none> and password file <none>
I20260812 00:02:05.505513 21122 fs_manager.cc:359] Metadata directory not provided
I20260812 00:02:05.505578 21122 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:02:05.505708 21122 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:02:05.506920 21122 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786492899949492-12089-0/minicluster-data/master-0/data/instance:
uuid: "d60b6daa6fac4feeb2b8e7f9d9fae76b"
format_stamp: "Formatted at 2026-08-12 00:02:05 on dist-test-slave-f0tn"
server_key: "2757916851ca20b9d099ab45fc1ed501"
server_key_iv: "a8e94a73bb93d637ec9964df9ec7f0e5"
server_key_version: "encryptionkey@0"
I20260812 00:02:05.507335 21122 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786492899949492-12089-0/minicluster-data/master-0/wal/instance:
uuid: "d60b6daa6fac4feeb2b8e7f9d9fae76b"
format_stamp: "Formatted at 2026-08-12 00:02:05 on dist-test-slave-f0tn"
server_key: "2757916851ca20b9d099ab45fc1ed501"
server_key_iv: "a8e94a73bb93d637ec9964df9ec7f0e5"
server_key_version: "encryptionkey@0"
I20260812 00:02:05.508920 21122 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 00:02:05.509843 21157 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:05.510028 21122 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260812 00:02:05.510159 21122 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786492899949492-12089-0/minicluster-data/master-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786492899949492-12089-0/minicluster-data/master-0/wal
uuid: "d60b6daa6fac4feeb2b8e7f9d9fae76b"
format_stamp: "Formatted at 2026-08-12 00:02:05 on dist-test-slave-f0tn"
server_key: "2757916851ca20b9d099ab45fc1ed501"
server_key_iv: "a8e94a73bb93d637ec9964df9ec7f0e5"
server_key_version: "encryptionkey@0"
I20260812 00:02:05.510246 21122 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786492899949492-12089-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786492899949492-12089-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786492899949492-12089-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:02:05.562651 21122 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:02:05.562994 21122 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:02:05.563153 21122 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:02:05.567029 21122 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.126:43279
I20260812 00:02:05.567093 21250 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.126:43279 every 8 connection(s)
I20260812 00:02:05.567437 21122 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
I20260812 00:02:05.568395 21251 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:02:05.569258 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 21122
I20260812 00:02:05.569350 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786492899949492-12089-0/minicluster-data/master-0/wal/instance
I20260812 00:02:05.569550 12089 external_mini_cluster.cc:1428] Setting key 0d7dbb427be00a93fab3816fd634ff2b
I20260812 00:02:05.571600 21251 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d60b6daa6fac4feeb2b8e7f9d9fae76b: Bootstrap starting.
I20260812 00:02:05.572302 21251 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d60b6daa6fac4feeb2b8e7f9d9fae76b: Neither blocks nor log segments found. Creating new log.
I20260812 00:02:05.572588 21251 log.cc:824] T 00000000000000000000000000000000 P d60b6daa6fac4feeb2b8e7f9d9fae76b: Log is configured to *not* fsync() on all Append() calls
I20260812 00:02:05.573307 21251 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d60b6daa6fac4feeb2b8e7f9d9fae76b: No bootstrap required, opened a new log
I20260812 00:02:05.575525 21254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:05.570055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54642 (local address 127.11.206.126:43279)
0812 00:02:05.570265 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:05.570274 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:05.570309 (+ 35us) server_negotiation.cc:407] Connection header received
0812 00:02:05.570759 (+ 450us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:05.570769 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:05.570854 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:05.571003 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:05.571216 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:05.572523 (+ 1307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:05.573419 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:05.574037 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:05.574178 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:05.574795 (+ 617us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:05.574799 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:05.574800 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:02:05.575004 (+ 204us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:05.575052 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:02:05.575067 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:05.575157 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:05.575222 (+ 65us) server_negotiation.cc:299] Negotiation successful
0812 00:02:05.575310 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":81,"threads_started":1}
I20260812 00:02:05.575711 21251 raft_consensus.cc:348] T 00000000000000000000000000000000 P d60b6daa6fac4feeb2b8e7f9d9fae76b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d60b6daa6fac4feeb2b8e7f9d9fae76b" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 43279 } }
I20260812 00:02:05.575843 21251 raft_consensus.cc:374] T 00000000000000000000000000000000 P d60b6daa6fac4feeb2b8e7f9d9fae76b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:02:05.575874 21251 raft_consensus.cc:729] T 00000000000000000000000000000000 P d60b6daa6fac4feeb2b8e7f9d9fae76b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d60b6daa6fac4feeb2b8e7f9d9fae76b, State: Initialized, Role: FOLLOWER
I20260812 00:02:05.575989 21251 consensus_queue.cc:260] T 00000000000000000000000000000000 P d60b6daa6fac4feeb2b8e7f9d9fae76b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d60b6daa6fac4feeb2b8e7f9d9fae76b" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 43279 } }
I20260812 00:02:05.576048 21251 raft_consensus.cc:388] T 00000000000000000000000000000000 P d60b6daa6fac4feeb2b8e7f9d9fae76b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:02:05.576113 21251 raft_consensus.cc:482] T 00000000000000000000000000000000 P d60b6daa6fac4feeb2b8e7f9d9fae76b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:02:05.576166 21251 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d60b6daa6fac4feeb2b8e7f9d9fae76b [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:02:05.576462 12089 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:02:05.576731 21251 raft_consensus.cc:504] T 00000000000000000000000000000000 P d60b6daa6fac4feeb2b8e7f9d9fae76b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d60b6daa6fac4feeb2b8e7f9d9fae76b" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 43279 } }
I20260812 00:02:05.576821 21251 leader_election.cc:302] T 00000000000000000000000000000000 P d60b6daa6fac4feeb2b8e7f9d9fae76b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d60b6daa6fac4feeb2b8e7f9d9fae76b; no voters:
I20260812 00:02:05.576941 21251 leader_election.cc:288] T 00000000000000000000000000000000 P d60b6daa6fac4feeb2b8e7f9d9fae76b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:02:05.577001 21256 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d60b6daa6fac4feeb2b8e7f9d9fae76b [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:02:05.577118 21256 raft_consensus.cc:686] T 00000000000000000000000000000000 P d60b6daa6fac4feeb2b8e7f9d9fae76b [term 1 LEADER]: Becoming Leader. State: Replica: d60b6daa6fac4feeb2b8e7f9d9fae76b, State: Running, Role: LEADER
I20260812 00:02:05.577212 21251 sys_catalog.cc:564] T 00000000000000000000000000000000 P d60b6daa6fac4feeb2b8e7f9d9fae76b [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:02:05.577258 21256 consensus_queue.cc:237] T 00000000000000000000000000000000 P d60b6daa6fac4feeb2b8e7f9d9fae76b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d60b6daa6fac4feeb2b8e7f9d9fae76b" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 43279 } }
I20260812 00:02:05.577677 21259 sys_catalog.cc:455] T 00000000000000000000000000000000 P d60b6daa6fac4feeb2b8e7f9d9fae76b [sys.catalog]: SysCatalogTable state changed. Reason: New leader d60b6daa6fac4feeb2b8e7f9d9fae76b. Latest consensus state: current_term: 1 leader_uuid: "d60b6daa6fac4feeb2b8e7f9d9fae76b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d60b6daa6fac4feeb2b8e7f9d9fae76b" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 43279 } } }
I20260812 00:02:05.577769 21259 sys_catalog.cc:458] T 00000000000000000000000000000000 P d60b6daa6fac4feeb2b8e7f9d9fae76b [sys.catalog]: This master's current role is: LEADER
I20260812 00:02:05.577951 21257 sys_catalog.cc:455] T 00000000000000000000000000000000 P d60b6daa6fac4feeb2b8e7f9d9fae76b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d60b6daa6fac4feeb2b8e7f9d9fae76b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d60b6daa6fac4feeb2b8e7f9d9fae76b" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 43279 } } }
I20260812 00:02:05.577991 21265 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:02:05.578017 21257 sys_catalog.cc:458] T 00000000000000000000000000000000 P d60b6daa6fac4feeb2b8e7f9d9fae76b [sys.catalog]: This master's current role is: LEADER
I20260812 00:02:05.578853 21265 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:02:05.580356 21265 catalog_manager.cc:1347] Generated new cluster ID: e5b0311d54bc4c22bc5c4cf5fda31983
I20260812 00:02:05.580410 21265 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:02:05.589098 21265 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:02:05.589674 21265 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:02:05.593326 21265 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d60b6daa6fac4feeb2b8e7f9d9fae76b: Generated new TSK 0
I20260812 00:02:05.593519 21265 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260812 00:02:05.621313 21301 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260812 00:02:05.621510 21301 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
W20260812 00:02:05.621979 21298 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:02:05.604807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:43279 (local address 127.0.0.1:54656)
0812 00:02:05.604996 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:05.605006 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:05.605077 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:05.605296 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:05.605297 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:05.605299 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0812 00:02:05.605358 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:05.605360 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:05.606031 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:05.606032 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:05.606640 (+ 608us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:05.606642 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:05.606999 (+ 357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:05.607000 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:05.607061 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:05.607082 (+ 21us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0812 00:02:05.621610 (+ 14528us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34595/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0812 00:02:05.621707 (+ 97us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.11.206.126:43279: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34595/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":83,"threads_started":1}
I20260812 00:02:05.622296 21254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:05.604902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54656 (local address 127.11.206.126:43279)
0812 00:02:05.604950 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:05.604952 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:05.605070 (+ 118us) server_negotiation.cc:407] Connection header received
0812 00:02:05.605174 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:05.605175 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:05.605187 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:05.605285 (+ 98us) server_negotiation.cc:226] Negotiated authn=JWT
0812 00:02:05.605434 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:05.605954 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:05.606717 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:05.606923 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:05.606980 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:05.607186 (+ 206us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0812 00:02:05.621441 (+ 14255us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34595/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0812 00:02:05.622212 (+ 771us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:54656: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34595/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":25}
W20260812 00:02:05.622373 21254 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:54656: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34595/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.11.206.126:43279: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34595/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260812 00:02:05.622455 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 21122
2026-08-12T00:02:05Z chronyd exiting
I20260812 00:02:05.667902 12089 test_util.cc:175] -----------------------------------------------
I20260812 00:02:05.667989 12089 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786492899949492-12089-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (274 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260812 00:02:05.668771 12089 mini_oidc.cc:152] Starting JWKS server
I20260812 00:02:05.669490 12089 webserver.cc:460] Webserver started at https://127.0.0.1:45413/ using document root <none> and password file <none>
I20260812 00:02:05.669536 12089 mini_oidc.cc:189] Starting OIDC Discovery server
I20260812 00:02:05.669689 12089 webserver.cc:460] Webserver started at http://127.0.0.1:37319/ using document root <none> and password file <none>
2026-08-12T00:02:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:02:05Z Disabled control of system clock
I20260812 00:02:05.677706 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786492899949492-12089-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786492899949492-12089-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786492899949492-12089-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:40601
--webserver_interface=127.11.206.126
--webserver_port=0
--builtin_ntp_servers=127.11.206.84:45133
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.206.126:40601
--enable_jwt_token_auth=true
--jwks_url=https://localhost:45413/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786492899949492-12089-0/testchainca.cert with env {}
W20260812 00:02:05.757500 21322 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:02:05.757711 21322 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:02:05.757732 21322 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:02:05.758873 21322 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:02:05.758912 21322 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:02:05.758924 21322 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:02:05.758946 21322 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:02:05.758970 21322 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260812 00:02:05.758991 21322 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260812 00:02:05.759012 21322 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:45413/jwks.json
I20260812 00:02:05.760505 21322 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:45133
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786492899949492-12089-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786492899949492-12089-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.206.126:40601
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:40601
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:45413/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.206.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786492899949492-12089-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21322
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786492899949492-12089-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:02:05.760735 21322 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:02:05.760957 21322 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:02:05.765587 21333 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:05.765591 21329 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:05.765811 21335 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:05.765818 21322 server_base.cc:1034] running on GCE node
I20260812 00:02:05.766079 21322 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:02:05.766338 21322 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:02:05.767488 21322 hybrid_clock.cc:648] HybridClock initialized: now 1786492925767476 us; error 33 us; skew 500 ppm
I20260812 00:02:05.768733 21322 webserver.cc:460] Webserver started at http://127.11.206.126:46551/ using document root <none> and password file <none>
I20260812 00:02:05.768941 21322 fs_manager.cc:359] Metadata directory not provided
I20260812 00:02:05.768988 21322 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:02:05.769129 21322 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:02:05.770177 21322 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786492899949492-12089-0/minicluster-data/master-0/data/instance:
uuid: "8b9cd6e8fd7547e58258b4155ea4ddf9"
format_stamp: "Formatted at 2026-08-12 00:02:05 on dist-test-slave-f0tn"
server_key: "beeed01a3cadf15f8d0b92641b552d1c"
server_key_iv: "5d4e96bdb0716cba314c8a05e336e9a1"
server_key_version: "encryptionkey@0"
I20260812 00:02:05.770521 21322 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786492899949492-12089-0/minicluster-data/master-0/wal/instance:
uuid: "8b9cd6e8fd7547e58258b4155ea4ddf9"
format_stamp: "Formatted at 2026-08-12 00:02:05 on dist-test-slave-f0tn"
server_key: "beeed01a3cadf15f8d0b92641b552d1c"
server_key_iv: "5d4e96bdb0716cba314c8a05e336e9a1"
server_key_version: "encryptionkey@0"
I20260812 00:02:05.771786 21322 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260812 00:02:05.772493 21344 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:05.772626 21322 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 00:02:05.772709 21322 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786492899949492-12089-0/minicluster-data/master-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786492899949492-12089-0/minicluster-data/master-0/wal
uuid: "8b9cd6e8fd7547e58258b4155ea4ddf9"
format_stamp: "Formatted at 2026-08-12 00:02:05 on dist-test-slave-f0tn"
server_key: "beeed01a3cadf15f8d0b92641b552d1c"
server_key_iv: "5d4e96bdb0716cba314c8a05e336e9a1"
server_key_version: "encryptionkey@0"
I20260812 00:02:05.772778 21322 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786492899949492-12089-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786492899949492-12089-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786492899949492-12089-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:02:05.788726 21322 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:02:05.789049 21322 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:02:05.789178 21322 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:02:05.792973 21322 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.126:40601
I20260812 00:02:05.793012 21441 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.126:40601 every 8 connection(s)
I20260812 00:02:05.793336 21322 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
I20260812 00:02:05.794032 21446 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:02:05.796787 21446 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b9cd6e8fd7547e58258b4155ea4ddf9: Bootstrap starting.
I20260812 00:02:05.797358 21446 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8b9cd6e8fd7547e58258b4155ea4ddf9: Neither blocks nor log segments found. Creating new log.
I20260812 00:02:05.797657 21446 log.cc:824] T 00000000000000000000000000000000 P 8b9cd6e8fd7547e58258b4155ea4ddf9: Log is configured to *not* fsync() on all Append() calls
I20260812 00:02:05.798400 21446 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b9cd6e8fd7547e58258b4155ea4ddf9: No bootstrap required, opened a new log
I20260812 00:02:05.799984 21446 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8b9cd6e8fd7547e58258b4155ea4ddf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b9cd6e8fd7547e58258b4155ea4ddf9" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 40601 } }
I20260812 00:02:05.800129 21446 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8b9cd6e8fd7547e58258b4155ea4ddf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:02:05.800153 21446 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8b9cd6e8fd7547e58258b4155ea4ddf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b9cd6e8fd7547e58258b4155ea4ddf9, State: Initialized, Role: FOLLOWER
I20260812 00:02:05.800271 21446 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8b9cd6e8fd7547e58258b4155ea4ddf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b9cd6e8fd7547e58258b4155ea4ddf9" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 40601 } }
I20260812 00:02:05.800347 21446 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8b9cd6e8fd7547e58258b4155ea4ddf9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:02:05.800375 21446 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8b9cd6e8fd7547e58258b4155ea4ddf9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:02:05.800408 21446 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8b9cd6e8fd7547e58258b4155ea4ddf9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:02:05.800901 21446 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8b9cd6e8fd7547e58258b4155ea4ddf9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b9cd6e8fd7547e58258b4155ea4ddf9" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 40601 } }
I20260812 00:02:05.800987 21446 leader_election.cc:302] T 00000000000000000000000000000000 P 8b9cd6e8fd7547e58258b4155ea4ddf9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8b9cd6e8fd7547e58258b4155ea4ddf9; no voters:
I20260812 00:02:05.801117 21446 leader_election.cc:288] T 00000000000000000000000000000000 P 8b9cd6e8fd7547e58258b4155ea4ddf9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:02:05.801169 21451 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8b9cd6e8fd7547e58258b4155ea4ddf9 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:02:05.801338 21446 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8b9cd6e8fd7547e58258b4155ea4ddf9 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:02:05.801342 21451 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8b9cd6e8fd7547e58258b4155ea4ddf9 [term 1 LEADER]: Becoming Leader. State: Replica: 8b9cd6e8fd7547e58258b4155ea4ddf9, State: Running, Role: LEADER
I20260812 00:02:05.801492 21451 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8b9cd6e8fd7547e58258b4155ea4ddf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b9cd6e8fd7547e58258b4155ea4ddf9" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 40601 } }
I20260812 00:02:05.801684 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 21322
I20260812 00:02:05.801803 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786492899949492-12089-0/minicluster-data/master-0/wal/instance
I20260812 00:02:05.801996 12089 external_mini_cluster.cc:1428] Setting key 94c4fa301687db75a721b84e317f0736
I20260812 00:02:05.802526 21454 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b9cd6e8fd7547e58258b4155ea4ddf9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8b9cd6e8fd7547e58258b4155ea4ddf9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b9cd6e8fd7547e58258b4155ea4ddf9" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 40601 } } }
I20260812 00:02:05.802628 21454 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b9cd6e8fd7547e58258b4155ea4ddf9 [sys.catalog]: This master's current role is: LEADER
I20260812 00:02:05.802824 21455 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b9cd6e8fd7547e58258b4155ea4ddf9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8b9cd6e8fd7547e58258b4155ea4ddf9. Latest consensus state: current_term: 1 leader_uuid: "8b9cd6e8fd7547e58258b4155ea4ddf9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b9cd6e8fd7547e58258b4155ea4ddf9" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 40601 } } }
I20260812 00:02:05.803115 21455 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b9cd6e8fd7547e58258b4155ea4ddf9 [sys.catalog]: This master's current role is: LEADER
W20260812 00:02:05.803349 21485 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8b9cd6e8fd7547e58258b4155ea4ddf9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 00:02:05.803403 21485 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 00:02:05.803509 21483 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:02:05.803682 21483 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:02:05.805842 21483 catalog_manager.cc:1347] Generated new cluster ID: 1ef252303d5f4fd9a0ad41d88a1cafda
I20260812 00:02:05.805896 21483 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:02:05.807555 21482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:05.802628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53012 (local address 127.11.206.126:40601)
0812 00:02:05.802866 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:05.802875 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:05.802908 (+ 33us) server_negotiation.cc:407] Connection header received
0812 00:02:05.803029 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:05.803037 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:05.803111 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:05.803262 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:05.803518 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:05.804735 (+ 1217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:05.805581 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:05.806075 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:05.806185 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:05.806877 (+ 692us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:05.806881 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:05.806881 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:02:05.807076 (+ 195us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:05.807116 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:02:05.807130 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:05.807188 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:05.807273 (+ 85us) server_negotiation.cc:299] Negotiation successful
0812 00:02:05.807345 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":70,"threads_started":1}
I20260812 00:02:05.808424 12089 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:02:05.823259 21483 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:02:05.823783 21483 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:02:05.830194 21483 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8b9cd6e8fd7547e58258b4155ea4ddf9: Generated new TSK 0
I20260812 00:02:05.830367 21483 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260812 00:02:05.860738 21501 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260812 00:02:05.860831 21501 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260812 00:02:05.861097 21482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:05.839181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53022 (local address 127.11.206.126:40601)
0812 00:02:05.839227 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:05.839229 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:05.839307 (+ 78us) server_negotiation.cc:407] Connection header received
0812 00:02:05.839384 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:05.839385 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:05.839395 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:05.839456 (+ 61us) server_negotiation.cc:226] Negotiated authn=JWT
0812 00:02:05.839588 (+ 132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:05.840097 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:05.841218 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:05.841467 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:05.841518 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:05.841699 (+ 181us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0812 00:02:05.860882 (+ 19183us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45413/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0812 00:02:05.861038 (+ 156us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:53022: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45413/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":24}
W20260812 00:02:05.861150 21482 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:53022: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45413/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260812 00:02:05.861207 21500 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:02:05.839085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:40601 (local address 127.0.0.1:53022)
0812 00:02:05.839234 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:05.839245 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:05.839313 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:05.839464 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:05.839465 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:05.839467 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0812 00:02:05.839529 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:05.839532 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:05.840164 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:05.840165 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:05.841141 (+ 976us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:05.841145 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:05.841536 (+ 391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:05.841537 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:05.841602 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:05.841608 (+ 6us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0812 00:02:05.860993 (+ 19385us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45413/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0812 00:02:05.861106 (+ 113us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.11.206.126:40601: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45413/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":88,"threads_started":1}
I20260812 00:02:05.861563 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 21322
2026-08-12T00:02:05Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (242 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260812 00:02:05.911337 12089 mini_oidc.cc:152] Starting JWKS server
I20260812 00:02:05.912009 12089 webserver.cc:460] Webserver started at https://127.0.0.1:45081/ using document root <none> and password file <none>
I20260812 00:02:05.912055 12089 mini_oidc.cc:189] Starting OIDC Discovery server
I20260812 00:02:05.912195 12089 webserver.cc:460] Webserver started at http://127.0.0.1:40289/ using document root <none> and password file <none>
2026-08-12T00:02:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:02:05Z Disabled control of system clock
I20260812 00:02:05.919911 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786492899949492-12089-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786492899949492-12089-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786492899949492-12089-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:45507
--webserver_interface=127.11.206.126
--webserver_port=0
--builtin_ntp_servers=127.11.206.84:44579
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.206.126:45507
--enable_jwt_token_auth=true
--jwks_url=https://localhost:45081/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260812 00:02:06.000671 21510 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:02:06.000897 21510 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:02:06.000927 21510 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:02:06.002140 21510 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:02:06.002185 21510 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:02:06.002202 21510 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:02:06.002218 21510 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:02:06.002234 21510 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260812 00:02:06.002265 21510 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260812 00:02:06.002290 21510 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:45081/jwks.json
I20260812 00:02:06.003701 21510 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:44579
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786492899949492-12089-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786492899949492-12089-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.206.126:45507
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:45507
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:45081/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.206.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21510
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786492899949492-12089-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:02:06.003979 21510 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:02:06.004287 21510 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:02:06.009202 21525 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:06.009188 21519 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:06.009187 21521 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:06.009262 21510 server_base.cc:1034] running on GCE node
I20260812 00:02:06.009627 21510 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:02:06.009917 21510 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:02:06.011081 21510 hybrid_clock.cc:648] HybridClock initialized: now 1786492926011063 us; error 33 us; skew 500 ppm
I20260812 00:02:06.012403 21510 webserver.cc:460] Webserver started at http://127.11.206.126:45177/ using document root <none> and password file <none>
I20260812 00:02:06.012651 21510 fs_manager.cc:359] Metadata directory not provided
I20260812 00:02:06.012702 21510 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:02:06.012837 21510 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:02:06.013936 21510 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786492899949492-12089-0/minicluster-data/master-0/data/instance:
uuid: "147dbc9177854d558d224b55290b542a"
format_stamp: "Formatted at 2026-08-12 00:02:06 on dist-test-slave-f0tn"
server_key: "1a1357a10049fc22164d292a90e8e19a"
server_key_iv: "77deed9fb4feef6e3392246ccccba0b0"
server_key_version: "encryptionkey@0"
I20260812 00:02:06.014292 21510 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786492899949492-12089-0/minicluster-data/master-0/wal/instance:
uuid: "147dbc9177854d558d224b55290b542a"
format_stamp: "Formatted at 2026-08-12 00:02:06 on dist-test-slave-f0tn"
server_key: "1a1357a10049fc22164d292a90e8e19a"
server_key_iv: "77deed9fb4feef6e3392246ccccba0b0"
server_key_version: "encryptionkey@0"
I20260812 00:02:06.015544 21510 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 00:02:06.016224 21534 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:06.016381 21510 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:02:06.016466 21510 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786492899949492-12089-0/minicluster-data/master-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786492899949492-12089-0/minicluster-data/master-0/wal
uuid: "147dbc9177854d558d224b55290b542a"
format_stamp: "Formatted at 2026-08-12 00:02:06 on dist-test-slave-f0tn"
server_key: "1a1357a10049fc22164d292a90e8e19a"
server_key_iv: "77deed9fb4feef6e3392246ccccba0b0"
server_key_version: "encryptionkey@0"
I20260812 00:02:06.016528 21510 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786492899949492-12089-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786492899949492-12089-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786492899949492-12089-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:02:06.028221 21510 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:02:06.028568 21510 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:02:06.028707 21510 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:02:06.032616 21510 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.126:45507
I20260812 00:02:06.032665 21631 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.126:45507 every 8 connection(s)
I20260812 00:02:06.033010 21510 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
I20260812 00:02:06.033609 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 21510
I20260812 00:02:06.033702 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786492899949492-12089-0/minicluster-data/master-0/wal/instance
I20260812 00:02:06.033756 21632 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:02:06.033876 12089 external_mini_cluster.cc:1428] Setting key 30397d8b2a63d6083c670300bac2cbb0
I20260812 00:02:06.036424 21632 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 147dbc9177854d558d224b55290b542a: Bootstrap starting.
I20260812 00:02:06.037047 21632 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 147dbc9177854d558d224b55290b542a: Neither blocks nor log segments found. Creating new log.
I20260812 00:02:06.037351 21632 log.cc:824] T 00000000000000000000000000000000 P 147dbc9177854d558d224b55290b542a: Log is configured to *not* fsync() on all Append() calls
I20260812 00:02:06.038102 21632 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 147dbc9177854d558d224b55290b542a: No bootstrap required, opened a new log
I20260812 00:02:06.039672 21638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:06.034714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48500 (local address 127.11.206.126:45507)
0812 00:02:06.034904 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:06.034911 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:06.034936 (+ 25us) server_negotiation.cc:407] Connection header received
0812 00:02:06.035363 (+ 427us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:06.035369 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:06.035431 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:06.035549 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:06.035806 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:06.036888 (+ 1082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:06.037889 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:06.038319 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:06.038410 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:06.039058 (+ 648us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:06.039062 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:06.039063 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:02:06.039220 (+ 157us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:06.039258 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:02:06.039270 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:06.039319 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:06.039407 (+ 88us) server_negotiation.cc:299] Negotiation successful
0812 00:02:06.039472 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":71,"threads_started":1}
I20260812 00:02:06.040285 21632 raft_consensus.cc:348] T 00000000000000000000000000000000 P 147dbc9177854d558d224b55290b542a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "147dbc9177854d558d224b55290b542a" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 45507 } }
I20260812 00:02:06.040458 21632 raft_consensus.cc:374] T 00000000000000000000000000000000 P 147dbc9177854d558d224b55290b542a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:02:06.040508 21632 raft_consensus.cc:729] T 00000000000000000000000000000000 P 147dbc9177854d558d224b55290b542a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 147dbc9177854d558d224b55290b542a, State: Initialized, Role: FOLLOWER
I20260812 00:02:06.040624 12089 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:02:06.040648 21632 consensus_queue.cc:260] T 00000000000000000000000000000000 P 147dbc9177854d558d224b55290b542a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "147dbc9177854d558d224b55290b542a" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 45507 } }
I20260812 00:02:06.040729 21632 raft_consensus.cc:388] T 00000000000000000000000000000000 P 147dbc9177854d558d224b55290b542a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:02:06.040766 21632 raft_consensus.cc:482] T 00000000000000000000000000000000 P 147dbc9177854d558d224b55290b542a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:02:06.040810 21632 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 147dbc9177854d558d224b55290b542a [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:02:06.041332 21632 raft_consensus.cc:504] T 00000000000000000000000000000000 P 147dbc9177854d558d224b55290b542a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "147dbc9177854d558d224b55290b542a" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 45507 } }
I20260812 00:02:06.041460 21632 leader_election.cc:302] T 00000000000000000000000000000000 P 147dbc9177854d558d224b55290b542a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 147dbc9177854d558d224b55290b542a; no voters:
I20260812 00:02:06.041621 21632 leader_election.cc:288] T 00000000000000000000000000000000 P 147dbc9177854d558d224b55290b542a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:02:06.041736 21642 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 147dbc9177854d558d224b55290b542a [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:02:06.041885 21632 sys_catalog.cc:564] T 00000000000000000000000000000000 P 147dbc9177854d558d224b55290b542a [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:02:06.041910 21642 raft_consensus.cc:686] T 00000000000000000000000000000000 P 147dbc9177854d558d224b55290b542a [term 1 LEADER]: Becoming Leader. State: Replica: 147dbc9177854d558d224b55290b542a, State: Running, Role: LEADER
I20260812 00:02:06.041990 21642 consensus_queue.cc:237] T 00000000000000000000000000000000 P 147dbc9177854d558d224b55290b542a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "147dbc9177854d558d224b55290b542a" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 45507 } }
I20260812 00:02:06.042340 21643 sys_catalog.cc:455] T 00000000000000000000000000000000 P 147dbc9177854d558d224b55290b542a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "147dbc9177854d558d224b55290b542a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "147dbc9177854d558d224b55290b542a" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 45507 } } }
I20260812 00:02:06.042424 21643 sys_catalog.cc:458] T 00000000000000000000000000000000 P 147dbc9177854d558d224b55290b542a [sys.catalog]: This master's current role is: LEADER
I20260812 00:02:06.042578 21646 sys_catalog.cc:455] T 00000000000000000000000000000000 P 147dbc9177854d558d224b55290b542a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 147dbc9177854d558d224b55290b542a. Latest consensus state: current_term: 1 leader_uuid: "147dbc9177854d558d224b55290b542a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "147dbc9177854d558d224b55290b542a" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 45507 } } }
I20260812 00:02:06.042616 21660 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:02:06.042660 21646 sys_catalog.cc:458] T 00000000000000000000000000000000 P 147dbc9177854d558d224b55290b542a [sys.catalog]: This master's current role is: LEADER
I20260812 00:02:06.043166 21660 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:02:06.044756 21660 catalog_manager.cc:1347] Generated new cluster ID: 4a89ee8095d54721ac06e3c40629be3f
I20260812 00:02:06.044804 21660 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:02:06.065615 21660 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:02:06.066177 21660 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:02:06.073031 21660 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 147dbc9177854d558d224b55290b542a: Generated new TSK 0
I20260812 00:02:06.073239 21660 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:02:06.087842 21638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:06.084139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48514 (local address 127.11.206.126:45507)
0812 00:02:06.084193 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:06.084195 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:06.084317 (+ 122us) server_negotiation.cc:407] Connection header received
0812 00:02:06.084399 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:06.084400 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:06.084412 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:06.084475 (+ 63us) server_negotiation.cc:226] Negotiated authn=JWT
0812 00:02:06.084621 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:06.085107 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:06.086297 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:06.086489 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:06.086534 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:06.086701 (+ 167us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0812 00:02:06.087607 (+ 906us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45081/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0812 00:02:06.087754 (+ 147us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:48514: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45081/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":29}
W20260812 00:02:06.087913 21638 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:48514: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45081/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260812 00:02:06.088209 21691 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:02:06.084068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:45507 (local address 127.0.0.1:48514)
0812 00:02:06.084243 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:06.084255 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:06.084330 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:06.084484 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:06.084485 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:06.084488 (+ 3us) client_negotiation.cc:189] Negotiated authn=JWT
0812 00:02:06.084568 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:06.084570 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:06.085194 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:06.085195 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:06.086216 (+ 1021us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:06.086221 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:06.086551 (+ 330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:06.086552 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:06.086613 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:06.086618 (+ 5us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0812 00:02:06.087716 (+ 1098us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45081/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0812 00:02:06.087827 (+ 111us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.11.206.126:45507: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45081/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":82,"threads_started":1}
I20260812 00:02:06.088486 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 21510
E20260812 00:02:06.112222 21692 webserver.cc:533] Webserver: sslize failed:
E20260812 00:02:06.112314 21692 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-12T00:02:06Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (240 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-12T00:02:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:02:06Z Disabled control of system clock
I20260812 00:02:06.159525 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786492899949492-12089-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786492899949492-12089-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786492899949492-12089-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:43551
--webserver_interface=127.11.206.126
--webserver_port=0
--builtin_ntp_servers=127.11.206.84:35837
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.206.126:43551
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786492899949492-12089-0/testchainca.cert with env {}
W20260812 00:02:06.240376 21699 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:02:06.240589 21699 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:02:06.240612 21699 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:02:06.241827 21699 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:02:06.241870 21699 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:02:06.241882 21699 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:02:06.241894 21699 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:02:06.241904 21699 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260812 00:02:06.241927 21699 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260812 00:02:06.241950 21699 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260812 00:02:06.243484 21699 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:35837
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786492899949492-12089-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786492899949492-12089-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.206.126:43551
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:43551
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.206.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786492899949492-12089-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21699
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786492899949492-12089-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:02:06.243722 21699 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:02:06.243922 21699 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:02:06.248703 21717 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:06.248678 21714 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:06.248690 21713 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:06.248935 21699 server_base.cc:1034] running on GCE node
I20260812 00:02:06.249136 21699 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:02:06.249437 21699 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:02:06.250586 21699 hybrid_clock.cc:648] HybridClock initialized: now 1786492926250570 us; error 28 us; skew 500 ppm
I20260812 00:02:06.251857 21699 webserver.cc:460] Webserver started at http://127.11.206.126:35665/ using document root <none> and password file <none>
I20260812 00:02:06.252090 21699 fs_manager.cc:359] Metadata directory not provided
I20260812 00:02:06.252143 21699 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:02:06.252274 21699 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:02:06.253327 21699 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786492899949492-12089-0/minicluster-data/master-0/data/instance:
uuid: "29b8546b243446aba25f0126b6ace996"
format_stamp: "Formatted at 2026-08-12 00:02:06 on dist-test-slave-f0tn"
server_key: "28ab53a274e2fc8a58bb609b9691e72a"
server_key_iv: "7fad75197544ce474da4e71fc9399641"
server_key_version: "encryptionkey@0"
I20260812 00:02:06.253728 21699 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786492899949492-12089-0/minicluster-data/master-0/wal/instance:
uuid: "29b8546b243446aba25f0126b6ace996"
format_stamp: "Formatted at 2026-08-12 00:02:06 on dist-test-slave-f0tn"
server_key: "28ab53a274e2fc8a58bb609b9691e72a"
server_key_iv: "7fad75197544ce474da4e71fc9399641"
server_key_version: "encryptionkey@0"
I20260812 00:02:06.254951 21699 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:02:06.255661 21725 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:06.255815 21699 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:02:06.255900 21699 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786492899949492-12089-0/minicluster-data/master-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786492899949492-12089-0/minicluster-data/master-0/wal
uuid: "29b8546b243446aba25f0126b6ace996"
format_stamp: "Formatted at 2026-08-12 00:02:06 on dist-test-slave-f0tn"
server_key: "28ab53a274e2fc8a58bb609b9691e72a"
server_key_iv: "7fad75197544ce474da4e71fc9399641"
server_key_version: "encryptionkey@0"
I20260812 00:02:06.255980 21699 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786492899949492-12089-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786492899949492-12089-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786492899949492-12089-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:02:06.266193 21699 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:02:06.266513 21699 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:02:06.266646 21699 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:02:06.270530 21699 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.126:43551
I20260812 00:02:06.270572 21814 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.126:43551 every 8 connection(s)
I20260812 00:02:06.270915 21699 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
I20260812 00:02:06.271981 21816 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:02:06.273766 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 21699
I20260812 00:02:06.273860 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786492899949492-12089-0/minicluster-data/master-0/wal/instance
I20260812 00:02:06.274025 12089 external_mini_cluster.cc:1428] Setting key 028179885ec8d6a072914ab1bcbbcd00
I20260812 00:02:06.274767 21816 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 29b8546b243446aba25f0126b6ace996: Bootstrap starting.
I20260812 00:02:06.275512 21816 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 29b8546b243446aba25f0126b6ace996: Neither blocks nor log segments found. Creating new log.
I20260812 00:02:06.275876 21816 log.cc:824] T 00000000000000000000000000000000 P 29b8546b243446aba25f0126b6ace996: Log is configured to *not* fsync() on all Append() calls
I20260812 00:02:06.276686 21816 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 29b8546b243446aba25f0126b6ace996: No bootstrap required, opened a new log
I20260812 00:02:06.278981 21816 raft_consensus.cc:348] T 00000000000000000000000000000000 P 29b8546b243446aba25f0126b6ace996 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29b8546b243446aba25f0126b6ace996" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 43551 } }
I20260812 00:02:06.279160 21816 raft_consensus.cc:374] T 00000000000000000000000000000000 P 29b8546b243446aba25f0126b6ace996 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:02:06.279202 21816 raft_consensus.cc:729] T 00000000000000000000000000000000 P 29b8546b243446aba25f0126b6ace996 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29b8546b243446aba25f0126b6ace996, State: Initialized, Role: FOLLOWER
I20260812 00:02:06.279347 21816 consensus_queue.cc:260] T 00000000000000000000000000000000 P 29b8546b243446aba25f0126b6ace996 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29b8546b243446aba25f0126b6ace996" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 43551 } }
I20260812 00:02:06.279456 21816 raft_consensus.cc:388] T 00000000000000000000000000000000 P 29b8546b243446aba25f0126b6ace996 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:02:06.279505 21816 raft_consensus.cc:482] T 00000000000000000000000000000000 P 29b8546b243446aba25f0126b6ace996 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:02:06.279572 21816 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 29b8546b243446aba25f0126b6ace996 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:02:06.280236 21825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:06.274569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37560 (local address 127.11.206.126:43551)
0812 00:02:06.274802 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:06.274811 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:06.274849 (+ 38us) server_negotiation.cc:407] Connection header received
0812 00:02:06.275446 (+ 597us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:06.275457 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:06.275548 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:06.275733 (+ 185us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:06.276003 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:06.277270 (+ 1267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:06.278087 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:06.278752 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:06.278890 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:06.279577 (+ 687us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:06.279582 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:06.279582 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:02:06.279765 (+ 183us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:06.279799 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:02:06.279810 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:06.279860 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:06.279971 (+ 111us) server_negotiation.cc:299] Negotiation successful
0812 00:02:06.280035 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":89,"threads_started":1}
I20260812 00:02:06.280246 21816 raft_consensus.cc:504] T 00000000000000000000000000000000 P 29b8546b243446aba25f0126b6ace996 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29b8546b243446aba25f0126b6ace996" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 43551 } }
I20260812 00:02:06.280408 21816 leader_election.cc:302] T 00000000000000000000000000000000 P 29b8546b243446aba25f0126b6ace996 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 29b8546b243446aba25f0126b6ace996; no voters:
I20260812 00:02:06.280619 21816 leader_election.cc:288] T 00000000000000000000000000000000 P 29b8546b243446aba25f0126b6ace996 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:02:06.280646 21827 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 29b8546b243446aba25f0126b6ace996 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:02:06.280897 21816 sys_catalog.cc:564] T 00000000000000000000000000000000 P 29b8546b243446aba25f0126b6ace996 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:02:06.280911 21827 raft_consensus.cc:686] T 00000000000000000000000000000000 P 29b8546b243446aba25f0126b6ace996 [term 1 LEADER]: Becoming Leader. State: Replica: 29b8546b243446aba25f0126b6ace996, State: Running, Role: LEADER
I20260812 00:02:06.281018 21827 consensus_queue.cc:237] T 00000000000000000000000000000000 P 29b8546b243446aba25f0126b6ace996 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29b8546b243446aba25f0126b6ace996" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 43551 } }
I20260812 00:02:06.281181 12089 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:02:06.282390 21830 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29b8546b243446aba25f0126b6ace996 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 29b8546b243446aba25f0126b6ace996. Latest consensus state: current_term: 1 leader_uuid: "29b8546b243446aba25f0126b6ace996" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29b8546b243446aba25f0126b6ace996" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 43551 } } }
I20260812 00:02:06.282526 21830 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29b8546b243446aba25f0126b6ace996 [sys.catalog]: This master's current role is: LEADER
I20260812 00:02:06.282667 21828 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29b8546b243446aba25f0126b6ace996 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "29b8546b243446aba25f0126b6ace996" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29b8546b243446aba25f0126b6ace996" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 43551 } } }
I20260812 00:02:06.282729 21828 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29b8546b243446aba25f0126b6ace996 [sys.catalog]: This master's current role is: LEADER
W20260812 00:02:06.282729 21847 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 29b8546b243446aba25f0126b6ace996: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 00:02:06.282866 21847 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 00:02:06.282918 21850 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:02:06.283092 21850 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:02:06.284476 21850 catalog_manager.cc:1347] Generated new cluster ID: f4d9190112354116a51dccf97dd883a9
I20260812 00:02:06.284530 21850 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:02:06.293555 21850 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:02:06.294153 21850 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:02:06.297523 21850 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 29b8546b243446aba25f0126b6ace996: Generated new TSK 0
I20260812 00:02:06.297678 21850 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:02:06.371497 21825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:06.306456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37568 (local address 127.11.206.126:43551)
0812 00:02:06.306514 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:06.306516 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:06.306589 (+ 73us) server_negotiation.cc:407] Connection header received
0812 00:02:06.306671 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:06.306672 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:06.306687 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:06.306765 (+ 78us) server_negotiation.cc:226] Negotiated authn=JWT
0812 00:02:06.306878 (+ 113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:06.307641 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:06.308402 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:06.308705 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:06.308782 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:06.308926 (+ 144us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0812 00:02:06.371231 (+ 62305us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0812 00:02:06.371422 (+ 191us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:37568: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":31}
W20260812 00:02:06.371594 21825 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:37568: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260812 00:02:06.371613 21862 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:02:06.306385 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:43551 (local address 127.0.0.1:37568)
0812 00:02:06.306524 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:06.306534 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:06.306591 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:06.306773 (+ 182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:06.306773 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:06.306775 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0812 00:02:06.306828 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:06.306829 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:06.307722 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:06.307723 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:06.308329 (+ 606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:06.308332 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:06.308787 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:06.308788 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:06.308832 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:06.308837 (+ 5us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0812 00:02:06.371392 (+ 62555us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0812 00:02:06.371512 (+ 120us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.11.206.126:43551: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":77,"threads_started":1}
I20260812 00:02:06.371917 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 21699
2026-08-12T00:02:06Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (249 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (89 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (90 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:02:06 dist-test-slave-f0tn krb5kdc[21880](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:02:06 dist-test-slave-f0tn krb5kdc[21880](info): set up 2 sockets
Aug 12 00:02:06 dist-test-slave-f0tn krb5kdc[21880](info): commencing operation
krb5kdc: starting...
W20260812 00:02:07.740860 12089 mini_kdc.cc:121] Time spent starting KDC: real 1.160s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/krb5kdc/test-user.keytab.
Aug 12 00:02:07 dist-test-slave-f0tn krb5kdc[21880](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492927, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:02:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:02:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.206.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab.
Entry for principal kudu/127.11.206.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab.
I20260812 00:02:07.860316 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:44835
--webserver_interface=127.11.206.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab
--principal=kudu/127.11.206.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:42215
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.206.126:44835
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:02:07.941125 21904 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:02:07.941344 21904 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:02:07.941401 21904 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:02:07.942584 21904 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:02:07.942628 21904 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:02:07.942646 21904 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:02:07.942662 21904 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:02:07.942677 21904 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:02:07.944168 21904 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:42215
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.206.126:44835
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab
--principal=kudu/127.11.206.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:44835
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.206.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21904
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:02:07.944410 21904 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:02:07.944612 21904 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:02:07.949301 21910 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:07.949299 21916 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:07.949369 21911 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:07.949504 21904 server_base.cc:1034] running on GCE node
I20260812 00:02:07.949726 21904 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:02:07.950001 21904 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:02:07.951151 21904 hybrid_clock.cc:648] HybridClock initialized: now 1786492927951137 us; error 30 us; skew 500 ppm
Aug 12 00:02:07 dist-test-slave-f0tn krb5kdc[21880](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492927, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:02:07.953658 21904 init.cc:377] Logged in from keytab as kudu/127.11.206.126@KRBTEST.COM (short username kudu)
I20260812 00:02:07.954049 21904 webserver.cc:460] Webserver started at http://127.11.206.126:38075/ using document root <none> and password file <none>
I20260812 00:02:07.954252 21904 fs_manager.cc:359] Metadata directory not provided
I20260812 00:02:07.954299 21904 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:02:07.954423 21904 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:02:07.955472 21904 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/minicluster-data/master-0/data/instance:
uuid: "5e959e43391e43419ac0b12a682b74d2"
format_stamp: "Formatted at 2026-08-12 00:02:07 on dist-test-slave-f0tn"
server_key: "cb202c0946fa51bcd3e6db971a3ca28d"
server_key_iv: "0e282eab2ee29642495730d7a40899aa"
server_key_version: "encryptionkey@0"
I20260812 00:02:07.955807 21904 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/minicluster-data/master-0/wal/instance:
uuid: "5e959e43391e43419ac0b12a682b74d2"
format_stamp: "Formatted at 2026-08-12 00:02:07 on dist-test-slave-f0tn"
server_key: "cb202c0946fa51bcd3e6db971a3ca28d"
server_key_iv: "0e282eab2ee29642495730d7a40899aa"
server_key_version: "encryptionkey@0"
I20260812 00:02:07.956996 21904 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260812 00:02:07.957687 21925 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:07.957824 21904 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:07.957907 21904 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/minicluster-data/master-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/minicluster-data/master-0/wal
uuid: "5e959e43391e43419ac0b12a682b74d2"
format_stamp: "Formatted at 2026-08-12 00:02:07 on dist-test-slave-f0tn"
server_key: "cb202c0946fa51bcd3e6db971a3ca28d"
server_key_iv: "0e282eab2ee29642495730d7a40899aa"
server_key_version: "encryptionkey@0"
I20260812 00:02:07.957967 21904 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:02:07.976732 21904 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:02:07.978930 21904 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:02:07.979075 21904 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:02:07.982854 21904 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.126:44835
I20260812 00:02:07.982898 22012 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.126:44835 every 8 connection(s)
I20260812 00:02:07.983235 21904 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
I20260812 00:02:07.984110 22013 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:02:07.985100 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 21904
I20260812 00:02:07.985193 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/minicluster-data/master-0/wal/instance
I20260812 00:02:07.985369 12089 external_mini_cluster.cc:1428] Setting key e10a06236cd07b96f9ccf1bd301688a7
I20260812 00:02:07.986792 22013 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5e959e43391e43419ac0b12a682b74d2: Bootstrap starting.
I20260812 00:02:07.987394 22013 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5e959e43391e43419ac0b12a682b74d2: Neither blocks nor log segments found. Creating new log.
I20260812 00:02:07.987689 22013 log.cc:824] T 00000000000000000000000000000000 P 5e959e43391e43419ac0b12a682b74d2: Log is configured to *not* fsync() on all Append() calls
I20260812 00:02:07.988435 22013 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5e959e43391e43419ac0b12a682b74d2: No bootstrap required, opened a new log
I20260812 00:02:07.990483 22013 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5e959e43391e43419ac0b12a682b74d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e959e43391e43419ac0b12a682b74d2" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 44835 } }
I20260812 00:02:07.990617 22013 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5e959e43391e43419ac0b12a682b74d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:02:07.990638 22013 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5e959e43391e43419ac0b12a682b74d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e959e43391e43419ac0b12a682b74d2, State: Initialized, Role: FOLLOWER
I20260812 00:02:07.990749 22013 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5e959e43391e43419ac0b12a682b74d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e959e43391e43419ac0b12a682b74d2" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 44835 } }
I20260812 00:02:07.990813 22013 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5e959e43391e43419ac0b12a682b74d2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:02:07.990834 22013 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5e959e43391e43419ac0b12a682b74d2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:02:07.990878 22013 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5e959e43391e43419ac0b12a682b74d2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:02:07.991371 22013 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5e959e43391e43419ac0b12a682b74d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e959e43391e43419ac0b12a682b74d2" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 44835 } }
I20260812 00:02:07.991460 22013 leader_election.cc:302] T 00000000000000000000000000000000 P 5e959e43391e43419ac0b12a682b74d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5e959e43391e43419ac0b12a682b74d2; no voters:
I20260812 00:02:07.991621 22013 leader_election.cc:288] T 00000000000000000000000000000000 P 5e959e43391e43419ac0b12a682b74d2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:02:07.991655 22020 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5e959e43391e43419ac0b12a682b74d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:02:07.991868 22013 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5e959e43391e43419ac0b12a682b74d2 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:02:07.991858 22020 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5e959e43391e43419ac0b12a682b74d2 [term 1 LEADER]: Becoming Leader. State: Replica: 5e959e43391e43419ac0b12a682b74d2, State: Running, Role: LEADER
I20260812 00:02:07.992026 22020 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5e959e43391e43419ac0b12a682b74d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e959e43391e43419ac0b12a682b74d2" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 44835 } }
Aug 12 00:02:07 dist-test-slave-f0tn krb5kdc[21880](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492927, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:02:07.992381 22024 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5e959e43391e43419ac0b12a682b74d2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5e959e43391e43419ac0b12a682b74d2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e959e43391e43419ac0b12a682b74d2" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 44835 } } }
I20260812 00:02:07.992458 22024 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5e959e43391e43419ac0b12a682b74d2 [sys.catalog]: This master's current role is: LEADER
I20260812 00:02:07.992677 22025 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5e959e43391e43419ac0b12a682b74d2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5e959e43391e43419ac0b12a682b74d2. Latest consensus state: current_term: 1 leader_uuid: "5e959e43391e43419ac0b12a682b74d2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e959e43391e43419ac0b12a682b74d2" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 44835 } } }
I20260812 00:02:07.993307 22025 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5e959e43391e43419ac0b12a682b74d2 [sys.catalog]: This master's current role is: LEADER
I20260812 00:02:07.993321 22047 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:02:07.994108 22047 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:02:07.995990 22047 catalog_manager.cc:1347] Generated new cluster ID: d3f76b6b09c44be9891940ef78dc3615
I20260812 00:02:07.996037 22047 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:02:07.996276 22017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:07.985883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40352 (local address 127.11.206.126:44835)
0812 00:02:07.986068 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:07.986078 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:07.986112 (+ 34us) server_negotiation.cc:407] Connection header received
0812 00:02:07.986585 (+ 473us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:07.986594 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:07.986656 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:07.986817 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:07.987404 (+ 587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:07.988662 (+ 1258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:07.989411 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:07.990046 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:07.990160 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:07.992667 (+ 2507us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:07.992672 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:07.992672 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:07.992697 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:07.994606 (+ 1909us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:07.994978 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:07.994981 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:07.994981 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:07.995098 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:07.995304 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:07.995304 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:07.995305 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:07.995625 (+ 320us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:07.995778 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:07.995950 (+ 172us) server_negotiation.cc:299] Negotiation successful
0812 00:02:07.996078 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":78,"threads_started":1}
I20260812 00:02:08.025767 22047 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:02:08.026321 22047 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:02:08.028793 22047 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5e959e43391e43419ac0b12a682b74d2: Generated new TSK 0
I20260812 00:02:08.028967 22047 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.206.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.65.keytab.
Entry for principal kudu/127.11.206.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.65.keytab.
I20260812 00:02:08.062282 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.65:0
--local_ip_for_outbound_sockets=127.11.206.65
--webserver_interface=127.11.206.65
--webserver_port=0
--tserver_master_addrs=127.11.206.126:44835
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.65.keytab
--principal=kudu/127.11.206.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:42215
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:02:08.166329 22069 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:02:08.166558 22069 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:02:08.166582 22069 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:02:08.167747 22069 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:02:08.167789 22069 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:02:08.167816 22069 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.65
I20260812 00:02:08.169317 22069 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:42215
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.65.keytab
--principal=kudu/127.11.206.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.206.65
--webserver_port=0
--tserver_master_addrs=127.11.206.126:44835
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22069
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.65
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:02:08.169565 22069 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:02:08.169792 22069 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 00:02:08.174938 22069 server_base.cc:1034] running on GCE node
W20260812 00:02:08.174922 22076 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:08.174922 22081 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:08.174932 22078 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:08.175367 22069 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:02:08.175621 22069 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:02:08.176780 22069 hybrid_clock.cc:648] HybridClock initialized: now 1786492928176766 us; error 30 us; skew 500 ppm
Aug 12 00:02:08 dist-test-slave-f0tn krb5kdc[21880](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492928, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:02:08.179406 22069 init.cc:377] Logged in from keytab as kudu/127.11.206.65@KRBTEST.COM (short username kudu)
I20260812 00:02:08.179872 22069 webserver.cc:460] Webserver started at http://127.11.206.65:45415/ using document root <none> and password file <none>
I20260812 00:02:08.180099 22069 fs_manager.cc:359] Metadata directory not provided
I20260812 00:02:08.180158 22069 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:02:08.180289 22069 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:02:08.181362 22069 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/minicluster-data/ts-0/data/instance:
uuid: "218e9c85464d4fc4bcb72365325deeeb"
format_stamp: "Formatted at 2026-08-12 00:02:08 on dist-test-slave-f0tn"
server_key: "8d9544863babeeeae7391086a6640d7d"
server_key_iv: "cc017fce0e57b59e51e7798fdd6064cd"
server_key_version: "encryptionkey@0"
I20260812 00:02:08.181766 22069 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/minicluster-data/ts-0/wal/instance:
uuid: "218e9c85464d4fc4bcb72365325deeeb"
format_stamp: "Formatted at 2026-08-12 00:02:08 on dist-test-slave-f0tn"
server_key: "8d9544863babeeeae7391086a6640d7d"
server_key_iv: "cc017fce0e57b59e51e7798fdd6064cd"
server_key_version: "encryptionkey@0"
I20260812 00:02:08.183076 22069 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 00:02:08.183809 22092 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:08.183966 22069 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 00:02:08.184052 22069 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/minicluster-data/ts-0/wal
uuid: "218e9c85464d4fc4bcb72365325deeeb"
format_stamp: "Formatted at 2026-08-12 00:02:08 on dist-test-slave-f0tn"
server_key: "8d9544863babeeeae7391086a6640d7d"
server_key_iv: "cc017fce0e57b59e51e7798fdd6064cd"
server_key_version: "encryptionkey@0"
I20260812 00:02:08.184113 22069 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:02:08.203686 22069 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:02:08.205965 22069 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:02:08.206131 22069 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:02:08.206379 22069 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:02:08.206709 22069 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:02:08.206745 22069 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:08.206775 22069 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:02:08.206794 22069 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:08.212761 22069 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.65:44529
I20260812 00:02:08.212841 22283 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.65:44529 every 8 connection(s)
I20260812 00:02:08.213160 22069 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
I20260812 00:02:08.218497 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 22069
I20260812 00:02:08.218603 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/minicluster-data/ts-0/wal/instance
I20260812 00:02:08.218793 12089 external_mini_cluster.cc:1428] Setting key a7bf6eac1181c4c0cd133aac8c4e2757
Aug 12 00:02:08 dist-test-slave-f0tn krb5kdc[21880](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492928, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.65@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:02:08.222904 22017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:08.213990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.65:38265 (local address 127.11.206.126:44835)
0812 00:02:08.214051 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:08.214053 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:08.214260 (+ 207us) server_negotiation.cc:407] Connection header received
0812 00:02:08.215224 (+ 964us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:08.215226 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:08.215236 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:08.215300 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:08.215938 (+ 638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:08.216451 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:08.217461 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:08.217668 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:08.217723 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:08.220006 (+ 2283us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:08.220008 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:08.220008 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:08.220016 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:08.221495 (+ 1479us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:08.221898 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:08.221899 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:08.221899 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:08.221956 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:08.222219 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:08.222220 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:08.222220 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:08.222350 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:08.222413 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:08.222744 (+ 331us) server_negotiation.cc:299] Negotiation successful
0812 00:02:08.222835 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260812 00:02:08.223114 22286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:08.213945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:44835 (local address 127.11.206.65:38265)
0812 00:02:08.214123 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:08.214170 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:08.215107 (+ 937us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:08.215372 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:08.215376 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:08.215667 (+ 291us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:08.215868 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:08.215872 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:08.216519 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:08.216520 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:08.217367 (+ 847us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:08.217370 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:08.217738 (+ 368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:08.217739 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:08.217851 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:08.218383 (+ 532us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:08.218392 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:08.219914 (+ 1522us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:02:08.221565 (+ 1651us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:08.221573 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:08.221576 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:08.221830 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:08.222010 (+ 180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:08.222011 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:08.222012 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:08.222149 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:08.222415 (+ 266us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:02:08.222422 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:02:08.222590 (+ 168us) client_negotiation.cc:769] Sending connection context
0812 00:02:08.222709 (+ 119us) client_negotiation.cc:240] Negotiation successful
0812 00:02:08.222888 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":89,"threads_started":1}
I20260812 00:02:08.223740 22284 heartbeater.cc:347] Connected to a master server at 127.11.206.126:44835
I20260812 00:02:08.223858 22284 heartbeater.cc:464] Registering TS with master...
I20260812 00:02:08.224067 22284 heartbeater.cc:511] Master 127.11.206.126:44835 requested a full tablet report, sending...
I20260812 00:02:08.224644 21955 ts_manager.cc:194] Registered new tserver with Master: 218e9c85464d4fc4bcb72365325deeeb (127.11.206.65:44529)
I20260812 00:02:08.225258 21955 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.206.65@KRBTEST.COM'} at 127.11.206.65:38265
WARNING: no policy specified for kudu/127.11.206.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.66.keytab.
Entry for principal kudu/127.11.206.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.66.keytab.
I20260812 00:02:08.244506 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.66:0
--local_ip_for_outbound_sockets=127.11.206.66
--webserver_interface=127.11.206.66
--webserver_port=0
--tserver_master_addrs=127.11.206.126:44835
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.66.keytab
--principal=kudu/127.11.206.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:42215
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:02:08.327240 22293 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:02:08.327461 22293 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:02:08.327484 22293 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:02:08.328576 22293 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:02:08.328610 22293 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:02:08.328634 22293 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.66
I20260812 00:02:08.330188 22293 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:42215
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.66.keytab
--principal=kudu/127.11.206.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.206.66
--webserver_port=0
--tserver_master_addrs=127.11.206.126:44835
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22293
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.66
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:02:08.330391 22293 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:02:08.330590 22293 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:02:08.335790 22299 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:08.335870 22300 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:08.335816 22304 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:08.335865 22293 server_base.cc:1034] running on GCE node
I20260812 00:02:08.336236 22293 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:02:08.336479 22293 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:02:08.337633 22293 hybrid_clock.cc:648] HybridClock initialized: now 1786492928337617 us; error 30 us; skew 500 ppm
Aug 12 00:02:08 dist-test-slave-f0tn krb5kdc[21880](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492928, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:02:08.340217 22293 init.cc:377] Logged in from keytab as kudu/127.11.206.66@KRBTEST.COM (short username kudu)
I20260812 00:02:08.340679 22293 webserver.cc:460] Webserver started at http://127.11.206.66:40213/ using document root <none> and password file <none>
I20260812 00:02:08.340891 22293 fs_manager.cc:359] Metadata directory not provided
I20260812 00:02:08.340941 22293 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:02:08.341071 22293 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:02:08.342240 22293 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/minicluster-data/ts-1/data/instance:
uuid: "2bef52be30dc4365b912e297aee42f81"
format_stamp: "Formatted at 2026-08-12 00:02:08 on dist-test-slave-f0tn"
server_key: "d55e9a53a6eec26e49be96d2c41c225e"
server_key_iv: "935e9e8d2e4a220e3458dd7b98287c11"
server_key_version: "encryptionkey@0"
I20260812 00:02:08.342634 22293 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/minicluster-data/ts-1/wal/instance:
uuid: "2bef52be30dc4365b912e297aee42f81"
format_stamp: "Formatted at 2026-08-12 00:02:08 on dist-test-slave-f0tn"
server_key: "d55e9a53a6eec26e49be96d2c41c225e"
server_key_iv: "935e9e8d2e4a220e3458dd7b98287c11"
server_key_version: "encryptionkey@0"
I20260812 00:02:08.343897 22293 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260812 00:02:08.344587 22315 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:08.344739 22293 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 00:02:08.344830 22293 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/minicluster-data/ts-1/wal
uuid: "2bef52be30dc4365b912e297aee42f81"
format_stamp: "Formatted at 2026-08-12 00:02:08 on dist-test-slave-f0tn"
server_key: "d55e9a53a6eec26e49be96d2c41c225e"
server_key_iv: "935e9e8d2e4a220e3458dd7b98287c11"
server_key_version: "encryptionkey@0"
I20260812 00:02:08.344897 22293 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:02:08.355759 22293 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:02:08.357687 22293 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:02:08.357825 22293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:02:08.358047 22293 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:02:08.358366 22293 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:02:08.358402 22293 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:08.358433 22293 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:02:08.358457 22293 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:08.364362 22293 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.66:33235
I20260812 00:02:08.364424 22501 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.66:33235 every 8 connection(s)
I20260812 00:02:08.364737 22293 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
I20260812 00:02:08.369800 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 22293
I20260812 00:02:08.369920 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/minicluster-data/ts-1/wal/instance
I20260812 00:02:08.370108 12089 external_mini_cluster.cc:1428] Setting key ff74b0798cc4e8446394bcf8ee360874
Aug 12 00:02:08 dist-test-slave-f0tn krb5kdc[21880](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492928, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.66@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:02:08.374298 22017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:08.365471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.66:44965 (local address 127.11.206.126:44835)
0812 00:02:08.365517 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:08.365519 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:08.365759 (+ 240us) server_negotiation.cc:407] Connection header received
0812 00:02:08.366725 (+ 966us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:08.366727 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:08.366740 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:08.366795 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:08.367447 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:08.367948 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:08.368945 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:08.369148 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:08.369208 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:08.371665 (+ 2457us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:08.371666 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:08.371666 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:08.371673 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:08.372915 (+ 1242us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:08.373391 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:08.373391 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:08.373392 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:08.373449 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:08.373686 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:08.373687 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:08.373688 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:08.373797 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:08.373853 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:08.374117 (+ 264us) server_negotiation.cc:299] Negotiation successful
0812 00:02:08.374199 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 00:02:08.374450 22506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:08.365468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:44835 (local address 127.11.206.66:44965)
0812 00:02:08.365635 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:08.365672 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:08.366608 (+ 936us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:08.366881 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:08.366886 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:08.367154 (+ 268us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:08.367349 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:08.367353 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:08.368037 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:08.368038 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:08.368856 (+ 818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:08.368858 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:08.369227 (+ 369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:08.369228 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:08.369348 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:08.369867 (+ 519us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:08.369878 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:08.371570 (+ 1692us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:02:08.372997 (+ 1427us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:08.373004 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:08.373006 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:08.373303 (+ 297us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:08.373512 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:08.373513 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:08.373514 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:08.373625 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:08.373858 (+ 233us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:02:08.373865 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:02:08.373996 (+ 131us) client_negotiation.cc:769] Sending connection context
0812 00:02:08.374085 (+ 89us) client_negotiation.cc:240] Negotiation successful
0812 00:02:08.374237 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":83,"threads_started":1}
I20260812 00:02:08.374971 22502 heartbeater.cc:347] Connected to a master server at 127.11.206.126:44835
I20260812 00:02:08.375069 22502 heartbeater.cc:464] Registering TS with master...
I20260812 00:02:08.375242 22502 heartbeater.cc:511] Master 127.11.206.126:44835 requested a full tablet report, sending...
I20260812 00:02:08.375633 21955 ts_manager.cc:194] Registered new tserver with Master: 2bef52be30dc4365b912e297aee42f81 (127.11.206.66:33235)
I20260812 00:02:08.376153 21955 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.206.66@KRBTEST.COM'} at 127.11.206.66:44965
WARNING: no policy specified for kudu/127.11.206.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.67.keytab.
Entry for principal kudu/127.11.206.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.67.keytab.
I20260812 00:02:08.395933 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.67:0
--local_ip_for_outbound_sockets=127.11.206.67
--webserver_interface=127.11.206.67
--webserver_port=0
--tserver_master_addrs=127.11.206.126:44835
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.67.keytab
--principal=kudu/127.11.206.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:42215
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:02:08.477675 22509 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:02:08.477972 22509 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:02:08.478021 22509 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:02:08.479662 22509 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:02:08.479712 22509 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:02:08.479754 22509 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.67
I20260812 00:02:08.481541 22509 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:42215
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.67.keytab
--principal=kudu/127.11.206.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.206.67
--webserver_port=0
--tserver_master_addrs=127.11.206.126:44835
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22509
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.67
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:02:08.482785 22509 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:02:08.483028 22509 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:02:08.489439 22523 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:08.489460 22509 server_base.cc:1034] running on GCE node
W20260812 00:02:08.489602 22522 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:08.489737 22526 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:08.490089 22509 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:02:08.490368 22509 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:02:08.491519 22509 hybrid_clock.cc:648] HybridClock initialized: now 1786492928491501 us; error 36 us; skew 500 ppm
Aug 12 00:02:08 dist-test-slave-f0tn krb5kdc[21880](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492928, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:02:08.494539 22509 init.cc:377] Logged in from keytab as kudu/127.11.206.67@KRBTEST.COM (short username kudu)
I20260812 00:02:08.494987 22509 webserver.cc:460] Webserver started at http://127.11.206.67:34185/ using document root <none> and password file <none>
I20260812 00:02:08.495163 22509 fs_manager.cc:359] Metadata directory not provided
I20260812 00:02:08.495203 22509 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:02:08.495311 22509 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:02:08.496528 22509 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/minicluster-data/ts-2/data/instance:
uuid: "2840074e63c64135bc3de0ff3639e81a"
format_stamp: "Formatted at 2026-08-12 00:02:08 on dist-test-slave-f0tn"
server_key: "08f7f32ccc045a6187c94b96d06080e2"
server_key_iv: "64be82c7ac6ec6e0b101d89bb5f6eb7c"
server_key_version: "encryptionkey@0"
I20260812 00:02:08.496933 22509 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/minicluster-data/ts-2/wal/instance:
uuid: "2840074e63c64135bc3de0ff3639e81a"
format_stamp: "Formatted at 2026-08-12 00:02:08 on dist-test-slave-f0tn"
server_key: "08f7f32ccc045a6187c94b96d06080e2"
server_key_iv: "64be82c7ac6ec6e0b101d89bb5f6eb7c"
server_key_version: "encryptionkey@0"
I20260812 00:02:08.498390 22509 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 00:02:08.499193 22542 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:08.499396 22509 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 00:02:08.499475 22509 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/minicluster-data/ts-2/wal
uuid: "2840074e63c64135bc3de0ff3639e81a"
format_stamp: "Formatted at 2026-08-12 00:02:08 on dist-test-slave-f0tn"
server_key: "08f7f32ccc045a6187c94b96d06080e2"
server_key_iv: "64be82c7ac6ec6e0b101d89bb5f6eb7c"
server_key_version: "encryptionkey@0"
I20260812 00:02:08.499527 22509 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:02:08.525533 22509 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:02:08.527683 22509 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:02:08.527828 22509 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:02:08.528052 22509 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:02:08.528359 22509 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:02:08.528393 22509 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:08.528422 22509 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:02:08.528448 22509 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:08.534252 22509 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.67:43465
I20260812 00:02:08.534330 22739 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.67:43465 every 8 connection(s)
I20260812 00:02:08.534611 22509 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
Aug 12 00:02:08 dist-test-slave-f0tn krb5kdc[21880](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492928, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.67@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:02:08.543520 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 22509
I20260812 00:02:08.543606 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/minicluster-data/ts-2/wal/instance
I20260812 00:02:08.543777 12089 external_mini_cluster.cc:1428] Setting key 22ddd906e62e704bade361bcfa4aaac8
I20260812 00:02:08.544899 22017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:08.535332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.67:51163 (local address 127.11.206.126:44835)
0812 00:02:08.535417 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:08.535419 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:08.535637 (+ 218us) server_negotiation.cc:407] Connection header received
0812 00:02:08.536623 (+ 986us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:08.536625 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:08.536638 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:08.536690 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:08.537397 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:08.537917 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:08.538933 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:08.539131 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:08.539186 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:08.541470 (+ 2284us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:08.541472 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:08.541472 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:08.541480 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:08.543139 (+ 1659us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:08.543669 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:08.543671 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:08.543671 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:08.543743 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:08.544119 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:08.544120 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:08.544121 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:08.544268 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:08.544333 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:08.544703 (+ 370us) server_negotiation.cc:299] Negotiation successful
0812 00:02:08.544802 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 00:02:08.545034 22747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:08.535299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:44835 (local address 127.11.206.67:51163)
0812 00:02:08.535506 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:08.535547 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:08.536505 (+ 958us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:08.536794 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:08.536798 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:08.537066 (+ 268us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:08.537277 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:08.537282 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:08.538011 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:08.538012 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:08.538840 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:08.538842 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:08.539208 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:08.539209 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:08.539344 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:08.539873 (+ 529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:08.539881 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:08.541361 (+ 1480us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:02:08.543232 (+ 1871us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:08.543237 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:08.543239 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:08.543532 (+ 293us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:08.543872 (+ 340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:08.543873 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:08.543873 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:08.544021 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:08.544365 (+ 344us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:02:08.544372 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:02:08.544543 (+ 171us) client_negotiation.cc:769] Sending connection context
0812 00:02:08.544654 (+ 111us) client_negotiation.cc:240] Negotiation successful
0812 00:02:08.544834 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":84,"threads_started":1}
I20260812 00:02:08.545519 22740 heartbeater.cc:347] Connected to a master server at 127.11.206.126:44835
I20260812 00:02:08.545609 22740 heartbeater.cc:464] Registering TS with master...
I20260812 00:02:08.545766 22740 heartbeater.cc:511] Master 127.11.206.126:44835 requested a full tablet report, sending...
I20260812 00:02:08.546159 21955 ts_manager.cc:194] Registered new tserver with Master: 2840074e63c64135bc3de0ff3639e81a (127.11.206.67:43465)
I20260812 00:02:08.546676 21955 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.206.67@KRBTEST.COM'} at 127.11.206.67:51163
I20260812 00:02:08.555699 12089 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/krb5kdc/test-admin.keytab.
Aug 12 00:02:08 dist-test-slave-f0tn krb5kdc[21880](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492928, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:02:08.574280 12089 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260812 00:02:08.575904 22758 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:02:08.575155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60142 (local address 127.11.206.65:44529)
0812 00:02:08.575325 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:08.575332 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:08.575343 (+ 11us) server_negotiation.cc:407] Connection header received
0812 00:02:08.575370 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:08.575372 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:08.575387 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:08.575460 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:08.575818 (+ 358us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60142: BlockingRecv error: recv got EOF from 127.0.0.1:60142 (error 108)
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":78,"threads_started":1}
W20260812 00:02:08.576026 12089 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/krb5kdc/krb5cc' of type FILE
Aug 12 00:02:08 dist-test-slave-f0tn krb5kdc[21880](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492928, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:02:08.576933 12089 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 12 00:02:08 dist-test-slave-f0tn krb5kdc[21880](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492928, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:02:08.577901 12089 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 12 00:02:08 dist-test-slave-f0tn krb5kdc[21880](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492928, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.206.65@KRBTEST.COM
I20260812 00:02:08.585537 22758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:08.578453 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60144 (local address 127.11.206.65:44529)
0812 00:02:08.578563 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:08.578565 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:08.578592 (+ 27us) server_negotiation.cc:407] Connection header received
0812 00:02:08.578616 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:08.578617 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:08.578629 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:08.578672 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:08.579116 (+ 444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:08.579866 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:08.580608 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:08.580946 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:08.581007 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:08.583194 (+ 2187us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:08.583203 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:08.583204 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:08.583211 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:08.584519 (+ 1308us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:08.584815 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:08.584818 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:08.584818 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:08.584871 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:08.585004 (+ 133us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:08.585004 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:08.585004 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:08.585131 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:08.585262 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:08.585321 (+ 59us) server_negotiation.cc:299] Negotiation successful
0812 00:02:08.585412 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
W20260812 00:02:08.587445 22758 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:02:08.586874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60148 (local address 127.11.206.65:44529)
0812 00:02:08.586915 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:08.586916 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:08.586949 (+ 33us) server_negotiation.cc:407] Connection header received
0812 00:02:08.586998 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:08.586999 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:08.587007 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:08.587048 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:08.587409 (+ 361us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60148: BlockingRecv error: recv got EOF from 127.0.0.1:60148 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260812 00:02:08.587550 12089 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/krb5kdc/krb5cc' of type FILE
Aug 12 00:02:08 dist-test-slave-f0tn krb5kdc[21880](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492928, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:02:08.588503 12089 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 12 00:02:08 dist-test-slave-f0tn krb5kdc[21880](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492928, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:02:08.589349 12089 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 12 00:02:08 dist-test-slave-f0tn krb5kdc[21880](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492928, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.206.65@KRBTEST.COM
I20260812 00:02:08.595795 22758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:08.589894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60158 (local address 127.11.206.65:44529)
0812 00:02:08.589946 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:08.589947 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:08.589956 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:02:08.589977 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:08.589977 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:08.589987 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:08.590027 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:08.590355 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:08.590824 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:08.591501 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:08.591705 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:08.591770 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:08.593786 (+ 2016us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:08.593787 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:08.593788 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:08.593794 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:08.595014 (+ 1220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:08.595267 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:08.595268 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:08.595268 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:08.595312 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:08.595436 (+ 124us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:08.595436 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:08.595437 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:08.595513 (+ 76us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:08.595574 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:08.595645 (+ 71us) server_negotiation.cc:299] Negotiation successful
0812 00:02:08.595700 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
W20260812 00:02:08.597215 22758 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:02:08.596723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60170 (local address 127.11.206.65:44529)
0812 00:02:08.596785 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:08.596787 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:08.596797 (+ 10us) server_negotiation.cc:407] Connection header received
0812 00:02:08.596864 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:08.596865 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:08.596874 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:08.596918 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:08.597162 (+ 244us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60170: BlockingRecv error: recv got EOF from 127.0.0.1:60170 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
W20260812 00:02:08.597263 12089 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786492899949492-12089-0/krb5kdc/krb5cc' of type FILE
Aug 12 00:02:08 dist-test-slave-f0tn krb5kdc[21880](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492928, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:02:08.598194 12089 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 12 00:02:08 dist-test-slave-f0tn krb5kdc[21880](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492928, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:02:08.598977 12089 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 12 00:02:08 dist-test-slave-f0tn krb5kdc[21880](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492928, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.206.65@KRBTEST.COM
I20260812 00:02:08.605719 22758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:08.599442 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60184 (local address 127.11.206.65:44529)
0812 00:02:08.599493 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:08.599494 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:08.599554 (+ 60us) server_negotiation.cc:407] Connection header received
0812 00:02:08.599592 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:08.599592 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:08.599600 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:08.599640 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:08.599966 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:08.600412 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:08.601019 (+ 607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:08.601190 (+ 171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:08.601237 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:08.603413 (+ 2176us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:08.603414 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:08.603415 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:08.603421 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:08.604742 (+ 1321us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:08.605046 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:08.605047 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:08.605048 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:08.605097 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:08.605261 (+ 164us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:08.605262 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:08.605263 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:08.605364 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:08.605481 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:08.605595 (+ 114us) server_negotiation.cc:299] Negotiation successful
0812 00:02:08.605654 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260812 00:02:08.606457 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 22069
I20260812 00:02:08.619586 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 22293
I20260812 00:02:08.655812 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 22509
I20260812 00:02:08.678334 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 21904
2026-08-12T00:02:08Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (2122 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:02:08 dist-test-slave-f0tn krb5kdc[22784](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:02:08 dist-test-slave-f0tn krb5kdc[22784](info): set up 2 sockets
Aug 12 00:02:08 dist-test-slave-f0tn krb5kdc[22784](info): commencing operation
krb5kdc: starting...
W20260812 00:02:09.860075 12089 mini_kdc.cc:121] Time spent starting KDC: real 1.156s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/krb5kdc/test-user.keytab.
Aug 12 00:02:09 dist-test-slave-f0tn krb5kdc[22784](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492929, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:02:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:02:09Z Disabled control of system clock
WARNING: no policy specified for oryx/127.11.206.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.206.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.206.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/krb5kdc/oryx_127.11.206.126.keytab.
Entry for principal oryx/127.11.206.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/krb5kdc/oryx_127.11.206.126.keytab.
I20260812 00:02:09.979561 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:40221
--webserver_interface=127.11.206.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/krb5kdc/oryx_127.11.206.126.keytab
--principal=oryx/127.11.206.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:37943
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.206.126:40221
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:02:10.061030 22808 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:02:10.061257 22808 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:02:10.061286 22808 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:02:10.062512 22808 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:02:10.062562 22808 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:02:10.062582 22808 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:02:10.062597 22808 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:02:10.062611 22808 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:02:10.064095 22808 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:37943
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.206.126:40221
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/krb5kdc/oryx_127.11.206.126.keytab
--principal=oryx/127.11.206.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:40221
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.206.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22808
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:02:10.064345 22808 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:02:10.064558 22808 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:02:10.069485 22821 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:10.069485 22818 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:10.069460 22817 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:10.069937 22808 server_base.cc:1034] running on GCE node
I20260812 00:02:10.070189 22808 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:02:10.070446 22808 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:02:10.071588 22808 hybrid_clock.cc:648] HybridClock initialized: now 1786492930071576 us; error 28 us; skew 500 ppm
Aug 12 00:02:10 dist-test-slave-f0tn krb5kdc[22784](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492930, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.206.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:02:10.076869 22808 init.cc:377] Logged in from keytab as oryx/127.11.206.126@KRBTEST.COM (short username oryx)
I20260812 00:02:10.077337 22808 webserver.cc:460] Webserver started at http://127.11.206.126:38889/ using document root <none> and password file <none>
I20260812 00:02:10.077567 22808 fs_manager.cc:359] Metadata directory not provided
I20260812 00:02:10.077618 22808 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:02:10.077750 22808 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:02:10.078823 22808 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/master-0/data/instance:
uuid: "f8d9bea32edd4f1fbd437cddb7c4a5d0"
format_stamp: "Formatted at 2026-08-12 00:02:10 on dist-test-slave-f0tn"
server_key: "f6f4c6efad7101e22b0c141876ee526b"
server_key_iv: "47058b1471c20bf4588642c4972330c7"
server_key_version: "encryptionkey@0"
I20260812 00:02:10.079164 22808 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/master-0/wal/instance:
uuid: "f8d9bea32edd4f1fbd437cddb7c4a5d0"
format_stamp: "Formatted at 2026-08-12 00:02:10 on dist-test-slave-f0tn"
server_key: "f6f4c6efad7101e22b0c141876ee526b"
server_key_iv: "47058b1471c20bf4588642c4972330c7"
server_key_version: "encryptionkey@0"
I20260812 00:02:10.080401 22808 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:02:10.081058 22835 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:10.081219 22808 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:02:10.081310 22808 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/master-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/master-0/wal
uuid: "f8d9bea32edd4f1fbd437cddb7c4a5d0"
format_stamp: "Formatted at 2026-08-12 00:02:10 on dist-test-slave-f0tn"
server_key: "f6f4c6efad7101e22b0c141876ee526b"
server_key_iv: "47058b1471c20bf4588642c4972330c7"
server_key_version: "encryptionkey@0"
I20260812 00:02:10.081372 22808 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:02:10.090952 22808 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:02:10.092638 22808 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:02:10.092785 22808 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:02:10.096606 22808 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.126:40221
I20260812 00:02:10.096637 22918 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.126:40221 every 8 connection(s)
I20260812 00:02:10.096976 22808 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
I20260812 00:02:10.097940 22919 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:02:10.100178 22919 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f8d9bea32edd4f1fbd437cddb7c4a5d0: Bootstrap starting.
I20260812 00:02:10.100708 22919 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f8d9bea32edd4f1fbd437cddb7c4a5d0: Neither blocks nor log segments found. Creating new log.
I20260812 00:02:10.100942 22919 log.cc:824] T 00000000000000000000000000000000 P f8d9bea32edd4f1fbd437cddb7c4a5d0: Log is configured to *not* fsync() on all Append() calls
I20260812 00:02:10.101675 22919 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f8d9bea32edd4f1fbd437cddb7c4a5d0: No bootstrap required, opened a new log
I20260812 00:02:10.103185 22919 raft_consensus.cc:348] T 00000000000000000000000000000000 P f8d9bea32edd4f1fbd437cddb7c4a5d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8d9bea32edd4f1fbd437cddb7c4a5d0" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 40221 } }
I20260812 00:02:10.103323 22919 raft_consensus.cc:374] T 00000000000000000000000000000000 P f8d9bea32edd4f1fbd437cddb7c4a5d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:02:10.103344 22919 raft_consensus.cc:729] T 00000000000000000000000000000000 P f8d9bea32edd4f1fbd437cddb7c4a5d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8d9bea32edd4f1fbd437cddb7c4a5d0, State: Initialized, Role: FOLLOWER
I20260812 00:02:10.103459 22919 consensus_queue.cc:260] T 00000000000000000000000000000000 P f8d9bea32edd4f1fbd437cddb7c4a5d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8d9bea32edd4f1fbd437cddb7c4a5d0" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 40221 } }
I20260812 00:02:10.103534 22919 raft_consensus.cc:388] T 00000000000000000000000000000000 P f8d9bea32edd4f1fbd437cddb7c4a5d0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:02:10.103570 22919 raft_consensus.cc:482] T 00000000000000000000000000000000 P f8d9bea32edd4f1fbd437cddb7c4a5d0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:02:10.103605 22919 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f8d9bea32edd4f1fbd437cddb7c4a5d0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:02:10.104306 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 22808
I20260812 00:02:10.104408 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/master-0/wal/instance
I20260812 00:02:10.104434 22919 raft_consensus.cc:504] T 00000000000000000000000000000000 P f8d9bea32edd4f1fbd437cddb7c4a5d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8d9bea32edd4f1fbd437cddb7c4a5d0" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 40221 } }
I20260812 00:02:10.104540 22919 leader_election.cc:302] T 00000000000000000000000000000000 P f8d9bea32edd4f1fbd437cddb7c4a5d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f8d9bea32edd4f1fbd437cddb7c4a5d0; no voters:
I20260812 00:02:10.104611 12089 external_mini_cluster.cc:1428] Setting key dcdeecc5875b2bc801263e325cc47841
I20260812 00:02:10.104699 22919 leader_election.cc:288] T 00000000000000000000000000000000 P f8d9bea32edd4f1fbd437cddb7c4a5d0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:02:10.104736 22926 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f8d9bea32edd4f1fbd437cddb7c4a5d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:02:10.104902 22926 raft_consensus.cc:686] T 00000000000000000000000000000000 P f8d9bea32edd4f1fbd437cddb7c4a5d0 [term 1 LEADER]: Becoming Leader. State: Replica: f8d9bea32edd4f1fbd437cddb7c4a5d0, State: Running, Role: LEADER
I20260812 00:02:10.104972 22919 sys_catalog.cc:564] T 00000000000000000000000000000000 P f8d9bea32edd4f1fbd437cddb7c4a5d0 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:02:10.105036 22926 consensus_queue.cc:237] T 00000000000000000000000000000000 P f8d9bea32edd4f1fbd437cddb7c4a5d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8d9bea32edd4f1fbd437cddb7c4a5d0" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 40221 } }
I20260812 00:02:10.105449 22926 sys_catalog.cc:455] T 00000000000000000000000000000000 P f8d9bea32edd4f1fbd437cddb7c4a5d0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f8d9bea32edd4f1fbd437cddb7c4a5d0. Latest consensus state: current_term: 1 leader_uuid: "f8d9bea32edd4f1fbd437cddb7c4a5d0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8d9bea32edd4f1fbd437cddb7c4a5d0" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 40221 } } }
I20260812 00:02:10.105458 22929 sys_catalog.cc:455] T 00000000000000000000000000000000 P f8d9bea32edd4f1fbd437cddb7c4a5d0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f8d9bea32edd4f1fbd437cddb7c4a5d0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8d9bea32edd4f1fbd437cddb7c4a5d0" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 40221 } } }
I20260812 00:02:10.105610 22926 sys_catalog.cc:458] T 00000000000000000000000000000000 P f8d9bea32edd4f1fbd437cddb7c4a5d0 [sys.catalog]: This master's current role is: LEADER
I20260812 00:02:10.105618 22929 sys_catalog.cc:458] T 00000000000000000000000000000000 P f8d9bea32edd4f1fbd437cddb7c4a5d0 [sys.catalog]: This master's current role is: LEADER
I20260812 00:02:10.106635 22962 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:02:10.107318 22962 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:02:10.108916 22962 catalog_manager.cc:1347] Generated new cluster ID: 8e5c799ca7af493c8cb9aab24be43514
I20260812 00:02:10.108960 22962 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 00:02:10 dist-test-slave-f0tn krb5kdc[22784](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492929, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM
I20260812 00:02:10.115717 22934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:10.105090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32930 (local address 127.11.206.126:40221)
0812 00:02:10.105406 (+ 316us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:10.105417 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:10.105450 (+ 33us) server_negotiation.cc:407] Connection header received
0812 00:02:10.105578 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:10.105588 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:10.105650 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:10.106391 (+ 741us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:10.106565 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:10.107921 (+ 1356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:10.108715 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:10.109317 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:10.109478 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:10.112238 (+ 2760us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:10.112242 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:10.112243 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:10.112254 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:10.114157 (+ 1903us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:10.114543 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:10.114546 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:10.114546 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:10.114652 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:10.114862 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:10.114863 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:10.114863 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:10.115134 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:10.115258 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:10.115381 (+ 123us) server_negotiation.cc:299] Negotiation successful
0812 00:02:10.115509 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":240,"thread_start_us":83,"threads_started":1}
I20260812 00:02:10.119208 22962 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:02:10.119904 22962 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:02:10.127851 22962 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f8d9bea32edd4f1fbd437cddb7c4a5d0: Generated new TSK 0
I20260812 00:02:10.128037 22962 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.11.206.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.206.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.206.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/krb5kdc/oryx_127.11.206.65.keytab.
Entry for principal oryx/127.11.206.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/krb5kdc/oryx_127.11.206.65.keytab.
I20260812 00:02:10.153776 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.65:0
--local_ip_for_outbound_sockets=127.11.206.65
--webserver_interface=127.11.206.65
--webserver_port=0
--tserver_master_addrs=127.11.206.126:40221
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/krb5kdc/oryx_127.11.206.65.keytab
--principal=oryx/127.11.206.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:37943
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:02:10.234274 22971 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:02:10.234480 22971 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:02:10.234503 22971 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:02:10.235623 22971 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:02:10.235664 22971 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:02:10.235692 22971 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.65
I20260812 00:02:10.237154 22971 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:37943
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/krb5kdc/oryx_127.11.206.65.keytab
--principal=oryx/127.11.206.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.206.65
--webserver_port=0
--tserver_master_addrs=127.11.206.126:40221
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22971
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.65
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:02:10.237421 22971 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:02:10.237639 22971 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:02:10.242530 22981 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:10.242565 22988 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:10.242601 22971 server_base.cc:1034] running on GCE node
W20260812 00:02:10.242565 22982 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:10.242944 22971 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:02:10.243177 22971 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:02:10.244331 22971 hybrid_clock.cc:648] HybridClock initialized: now 1786492930244282 us; error 67 us; skew 500 ppm
Aug 12 00:02:10 dist-test-slave-f0tn krb5kdc[22784](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492930, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.206.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:02:10.246809 22971 init.cc:377] Logged in from keytab as oryx/127.11.206.65@KRBTEST.COM (short username oryx)
I20260812 00:02:10.247242 22971 webserver.cc:460] Webserver started at http://127.11.206.65:35221/ using document root <none> and password file <none>
I20260812 00:02:10.247452 22971 fs_manager.cc:359] Metadata directory not provided
I20260812 00:02:10.247499 22971 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:02:10.247622 22971 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:02:10.248621 22971 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-0/data/instance:
uuid: "d91daca07bd94d6fb77661eb0190366e"
format_stamp: "Formatted at 2026-08-12 00:02:10 on dist-test-slave-f0tn"
server_key: "b391413660727fad257448d5876da484"
server_key_iv: "cecc22b19ce7034aa1c0110a0b21f23b"
server_key_version: "encryptionkey@0"
I20260812 00:02:10.248940 22971 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-0/wal/instance:
uuid: "d91daca07bd94d6fb77661eb0190366e"
format_stamp: "Formatted at 2026-08-12 00:02:10 on dist-test-slave-f0tn"
server_key: "b391413660727fad257448d5876da484"
server_key_iv: "cecc22b19ce7034aa1c0110a0b21f23b"
server_key_version: "encryptionkey@0"
I20260812 00:02:10.250185 22971 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:02:10.250834 23006 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:10.250981 22971 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:02:10.251060 22971 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-0/wal
uuid: "d91daca07bd94d6fb77661eb0190366e"
format_stamp: "Formatted at 2026-08-12 00:02:10 on dist-test-slave-f0tn"
server_key: "b391413660727fad257448d5876da484"
server_key_iv: "cecc22b19ce7034aa1c0110a0b21f23b"
server_key_version: "encryptionkey@0"
I20260812 00:02:10.251120 22971 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:02:10.260699 22971 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:02:10.262496 22971 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:02:10.262627 22971 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:02:10.262822 22971 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:02:10.263104 22971 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:02:10.263136 22971 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:10.263163 22971 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:02:10.263181 22971 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:10.268586 22971 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.65:45231
I20260812 00:02:10.268644 23197 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.65:45231 every 8 connection(s)
I20260812 00:02:10.268920 22971 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
Aug 12 00:02:10 dist-test-slave-f0tn krb5kdc[22784](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492930, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.206.65@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM
I20260812 00:02:10.277371 22934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:10.269596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.65:46289 (local address 127.11.206.126:40221)
0812 00:02:10.269648 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:10.269650 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:10.269851 (+ 201us) server_negotiation.cc:407] Connection header received
0812 00:02:10.270349 (+ 498us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:10.270350 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:10.270366 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:10.270419 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:10.271318 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:10.271831 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:10.272807 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:10.273018 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:10.273074 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:10.275044 (+ 1970us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:10.275046 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:10.275046 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:10.275053 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:10.276110 (+ 1057us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:10.276479 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:10.276481 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:10.276481 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:10.276534 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:10.276758 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:10.276759 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:10.276759 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:10.276868 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:10.276924 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:10.277193 (+ 269us) server_negotiation.cc:299] Negotiation successful
0812 00:02:10.277281 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260812 00:02:10.277565 23201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:10.269564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:40221 (local address 127.11.206.65:46289)
0812 00:02:10.269739 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:10.269773 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:10.270252 (+ 479us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:10.270488 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:10.270492 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:10.271033 (+ 541us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:10.271214 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:10.271219 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:10.271919 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:10.271920 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:10.272723 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:10.272725 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:10.273091 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:10.273093 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:10.273216 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:10.273672 (+ 456us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:10.273680 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:10.274958 (+ 1278us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:02:10.276185 (+ 1227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:10.276192 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:10.276194 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:10.276411 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:10.276593 (+ 182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:10.276593 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:10.276594 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:10.276689 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:10.276928 (+ 239us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:02:10.276935 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:02:10.277064 (+ 129us) client_negotiation.cc:769] Sending connection context
0812 00:02:10.277151 (+ 87us) client_negotiation.cc:240] Negotiation successful
0812 00:02:10.277312 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":84,"threads_started":1}
I20260812 00:02:10.278039 23198 heartbeater.cc:347] Connected to a master server at 127.11.206.126:40221
I20260812 00:02:10.278129 23198 heartbeater.cc:464] Registering TS with master...
I20260812 00:02:10.278324 23198 heartbeater.cc:511] Master 127.11.206.126:40221 requested a full tablet report, sending...
I20260812 00:02:10.278383 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 22971
I20260812 00:02:10.278484 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-0/wal/instance
I20260812 00:02:10.278682 12089 external_mini_cluster.cc:1428] Setting key 99bb6b1c4a5855870f5e62ffad478eae
I20260812 00:02:10.278888 22864 ts_manager.cc:194] Registered new tserver with Master: d91daca07bd94d6fb77661eb0190366e (127.11.206.65:45231)
I20260812 00:02:10.279654 22864 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.206.65@KRBTEST.COM'} at 127.11.206.65:46289
WARNING: no policy specified for oryx/127.11.206.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.206.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.206.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/krb5kdc/oryx_127.11.206.66.keytab.
Entry for principal oryx/127.11.206.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/krb5kdc/oryx_127.11.206.66.keytab.
I20260812 00:02:10.302147 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.66:0
--local_ip_for_outbound_sockets=127.11.206.66
--webserver_interface=127.11.206.66
--webserver_port=0
--tserver_master_addrs=127.11.206.126:40221
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/krb5kdc/oryx_127.11.206.66.keytab
--principal=oryx/127.11.206.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:37943
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:02:10.384174 23206 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:02:10.384418 23206 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:02:10.384441 23206 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:02:10.385591 23206 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:02:10.385627 23206 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:02:10.385653 23206 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.66
I20260812 00:02:10.387127 23206 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:37943
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/krb5kdc/oryx_127.11.206.66.keytab
--principal=oryx/127.11.206.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.206.66
--webserver_port=0
--tserver_master_addrs=127.11.206.126:40221
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23206
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.66
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:02:10.387337 23206 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:02:10.387518 23206 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 00:02:10.392498 23206 server_base.cc:1034] running on GCE node
W20260812 00:02:10.392474 23219 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:10.392454 23216 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:10.392448 23217 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:10.392925 23206 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:02:10.393195 23206 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:02:10.394340 23206 hybrid_clock.cc:648] HybridClock initialized: now 1786492930394314 us; error 40 us; skew 500 ppm
Aug 12 00:02:10 dist-test-slave-f0tn krb5kdc[22784](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492930, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.206.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:02:10.396740 23206 init.cc:377] Logged in from keytab as oryx/127.11.206.66@KRBTEST.COM (short username oryx)
I20260812 00:02:10.397183 23206 webserver.cc:460] Webserver started at http://127.11.206.66:46585/ using document root <none> and password file <none>
I20260812 00:02:10.397424 23206 fs_manager.cc:359] Metadata directory not provided
I20260812 00:02:10.397480 23206 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:02:10.397606 23206 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:02:10.398644 23206 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-1/data/instance:
uuid: "b4bdd64c3f904386ad369366b7824e03"
format_stamp: "Formatted at 2026-08-12 00:02:10 on dist-test-slave-f0tn"
server_key: "e3db45cea8b83ea34b00be6af9b751b6"
server_key_iv: "ccc4e1500a5223ab83a39b56b3dd1b8f"
server_key_version: "encryptionkey@0"
I20260812 00:02:10.399006 23206 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-1/wal/instance:
uuid: "b4bdd64c3f904386ad369366b7824e03"
format_stamp: "Formatted at 2026-08-12 00:02:10 on dist-test-slave-f0tn"
server_key: "e3db45cea8b83ea34b00be6af9b751b6"
server_key_iv: "ccc4e1500a5223ab83a39b56b3dd1b8f"
server_key_version: "encryptionkey@0"
I20260812 00:02:10.400207 23206 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 00:02:10.400848 23233 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:10.401021 23206 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 00:02:10.401104 23206 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-1/wal
uuid: "b4bdd64c3f904386ad369366b7824e03"
format_stamp: "Formatted at 2026-08-12 00:02:10 on dist-test-slave-f0tn"
server_key: "e3db45cea8b83ea34b00be6af9b751b6"
server_key_iv: "ccc4e1500a5223ab83a39b56b3dd1b8f"
server_key_version: "encryptionkey@0"
I20260812 00:02:10.401172 23206 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:02:10.411332 23206 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:02:10.412947 23206 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:02:10.413074 23206 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:02:10.413267 23206 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:02:10.413633 23206 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:02:10.413669 23206 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:10.413698 23206 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:02:10.413714 23206 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:10.419106 23206 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.66:32883
I20260812 00:02:10.419142 23457 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.66:32883 every 8 connection(s)
I20260812 00:02:10.419428 23206 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
Aug 12 00:02:10 dist-test-slave-f0tn krb5kdc[22784](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492930, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.206.66@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM
I20260812 00:02:10.427004 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 23206
I20260812 00:02:10.427109 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-1/wal/instance
I20260812 00:02:10.427317 12089 external_mini_cluster.cc:1428] Setting key c9f16fe482921489612a9440d39d7b9c
I20260812 00:02:10.428741 22934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:10.420117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.66:48365 (local address 127.11.206.126:40221)
0812 00:02:10.420171 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:10.420173 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:10.420337 (+ 164us) server_negotiation.cc:407] Connection header received
0812 00:02:10.420809 (+ 472us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:10.420810 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:10.420818 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:10.420869 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:10.421740 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:10.422240 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:10.423148 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:10.423325 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:10.423368 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:10.425680 (+ 2312us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:10.425682 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:10.425682 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:10.425691 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:10.427349 (+ 1658us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:10.427807 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:10.427808 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:10.427809 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:10.427871 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:10.428110 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:10.428111 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:10.428111 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:10.428237 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:10.428291 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:10.428571 (+ 280us) server_negotiation.cc:299] Negotiation successful
0812 00:02:10.428653 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260812 00:02:10.428921 23460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:10.420071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:40221 (local address 127.11.206.66:48365)
0812 00:02:10.420216 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:10.420256 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:10.420719 (+ 463us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:10.420922 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:10.420925 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:10.421487 (+ 562us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:10.421671 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:10.421675 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:10.422303 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:10.422304 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:10.423086 (+ 782us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:10.423088 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:10.423379 (+ 291us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:10.423380 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:10.423476 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:10.423870 (+ 394us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:10.423877 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:10.425513 (+ 1636us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:02:10.427441 (+ 1928us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:10.427448 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:10.427450 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:10.427734 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:10.427931 (+ 197us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:10.427932 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:10.427932 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:10.428048 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:10.428317 (+ 269us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:02:10.428322 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:02:10.428449 (+ 127us) client_negotiation.cc:769] Sending connection context
0812 00:02:10.428537 (+ 88us) client_negotiation.cc:240] Negotiation successful
0812 00:02:10.428688 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":78,"threads_started":1}
I20260812 00:02:10.429502 23458 heartbeater.cc:347] Connected to a master server at 127.11.206.126:40221
I20260812 00:02:10.429595 23458 heartbeater.cc:464] Registering TS with master...
I20260812 00:02:10.429773 23458 heartbeater.cc:511] Master 127.11.206.126:40221 requested a full tablet report, sending...
I20260812 00:02:10.430138 22864 ts_manager.cc:194] Registered new tserver with Master: b4bdd64c3f904386ad369366b7824e03 (127.11.206.66:32883)
I20260812 00:02:10.430500 22864 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.206.66@KRBTEST.COM'} at 127.11.206.66:48365
WARNING: no policy specified for oryx/127.11.206.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.206.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.206.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/krb5kdc/oryx_127.11.206.67.keytab.
Entry for principal oryx/127.11.206.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/krb5kdc/oryx_127.11.206.67.keytab.
I20260812 00:02:10.449697 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.67:0
--local_ip_for_outbound_sockets=127.11.206.67
--webserver_interface=127.11.206.67
--webserver_port=0
--tserver_master_addrs=127.11.206.126:40221
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/krb5kdc/oryx_127.11.206.67.keytab
--principal=oryx/127.11.206.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:37943
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:02:10.530966 23463 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:02:10.531178 23463 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:02:10.531208 23463 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:02:10.532333 23463 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:02:10.532374 23463 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:02:10.532407 23463 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.67
I20260812 00:02:10.533860 23463 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:37943
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/krb5kdc/oryx_127.11.206.67.keytab
--principal=oryx/127.11.206.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.206.67
--webserver_port=0
--tserver_master_addrs=127.11.206.126:40221
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23463
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.67
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:02:10.534086 23463 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:02:10.534299 23463 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:02:10.539235 23477 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:10.539235 23472 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:10.539281 23473 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:10.539273 23463 server_base.cc:1034] running on GCE node
I20260812 00:02:10.539600 23463 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:02:10.539836 23463 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:02:10.540977 23463 hybrid_clock.cc:648] HybridClock initialized: now 1786492930540963 us; error 28 us; skew 500 ppm
Aug 12 00:02:10 dist-test-slave-f0tn krb5kdc[22784](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492930, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.206.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:02:10.543370 23463 init.cc:377] Logged in from keytab as oryx/127.11.206.67@KRBTEST.COM (short username oryx)
I20260812 00:02:10.543780 23463 webserver.cc:460] Webserver started at http://127.11.206.67:41349/ using document root <none> and password file <none>
I20260812 00:02:10.543977 23463 fs_manager.cc:359] Metadata directory not provided
I20260812 00:02:10.544023 23463 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:02:10.544149 23463 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:02:10.545166 23463 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-2/data/instance:
uuid: "39630eacbe4b41bbb157bb7b8d99c4f4"
format_stamp: "Formatted at 2026-08-12 00:02:10 on dist-test-slave-f0tn"
server_key: "58fc0567fd6bb3b614508c15219e1b0f"
server_key_iv: "7390af7937daafa71df22b89ce890052"
server_key_version: "encryptionkey@0"
I20260812 00:02:10.545534 23463 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-2/wal/instance:
uuid: "39630eacbe4b41bbb157bb7b8d99c4f4"
format_stamp: "Formatted at 2026-08-12 00:02:10 on dist-test-slave-f0tn"
server_key: "58fc0567fd6bb3b614508c15219e1b0f"
server_key_iv: "7390af7937daafa71df22b89ce890052"
server_key_version: "encryptionkey@0"
I20260812 00:02:10.546795 23463 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 00:02:10.547464 23486 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:10.547617 23463 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 00:02:10.547701 23463 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-2/wal
uuid: "39630eacbe4b41bbb157bb7b8d99c4f4"
format_stamp: "Formatted at 2026-08-12 00:02:10 on dist-test-slave-f0tn"
server_key: "58fc0567fd6bb3b614508c15219e1b0f"
server_key_iv: "7390af7937daafa71df22b89ce890052"
server_key_version: "encryptionkey@0"
I20260812 00:02:10.547773 23463 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:02:10.573662 23463 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:02:10.575621 23463 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:02:10.575736 23463 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:02:10.575918 23463 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:02:10.576202 23463 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:02:10.576232 23463 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:10.576262 23463 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:02:10.576274 23463 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:10.581787 23463 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.67:43193
I20260812 00:02:10.581847 23689 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.67:43193 every 8 connection(s)
I20260812 00:02:10.582167 23463 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
I20260812 00:02:10.583946 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 23463
I20260812 00:02:10.584038 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-2/wal/instance
I20260812 00:02:10.584199 12089 external_mini_cluster.cc:1428] Setting key 72d62f4dd741999c3e7aa63f0bb43125
Aug 12 00:02:10 dist-test-slave-f0tn krb5kdc[22784](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492930, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.206.67@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM
I20260812 00:02:10.591037 22934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:10.582926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.67:37215 (local address 127.11.206.126:40221)
0812 00:02:10.582993 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:10.582995 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:10.583149 (+ 154us) server_negotiation.cc:407] Connection header received
0812 00:02:10.583662 (+ 513us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:10.583664 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:10.583676 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:10.583736 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:10.584841 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:10.585493 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:10.586472 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:10.586662 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:10.586712 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:10.588645 (+ 1933us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:10.588646 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:10.588646 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:10.588652 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:10.589967 (+ 1315us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:10.590325 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:10.590326 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:10.590326 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:10.590375 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:10.590559 (+ 184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:10.590559 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:10.590560 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:10.590663 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:10.590708 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:10.590915 (+ 207us) server_negotiation.cc:299] Negotiation successful
0812 00:02:10.590970 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260812 00:02:10.591215 23693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:10.582850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:40221 (local address 127.11.206.67:37215)
0812 00:02:10.583024 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:10.583070 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:10.583566 (+ 496us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:10.583801 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:10.583805 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:10.584488 (+ 683us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:10.584741 (+ 253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:10.584749 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:10.585565 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:10.585565 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:10.586384 (+ 819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:10.586386 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:10.586721 (+ 335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:10.586721 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:10.586820 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:10.587262 (+ 442us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:10.587270 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:10.588561 (+ 1291us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:02:10.590036 (+ 1475us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:10.590041 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:10.590043 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:10.590266 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:10.590423 (+ 157us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:10.590424 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:10.590424 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:10.590514 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:10.590706 (+ 192us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:02:10.590709 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:02:10.590820 (+ 111us) client_negotiation.cc:769] Sending connection context
0812 00:02:10.590893 (+ 73us) client_negotiation.cc:240] Negotiation successful
0812 00:02:10.591009 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":95,"threads_started":1}
I20260812 00:02:10.591677 23691 heartbeater.cc:347] Connected to a master server at 127.11.206.126:40221
I20260812 00:02:10.591763 23691 heartbeater.cc:464] Registering TS with master...
I20260812 00:02:10.591935 23691 heartbeater.cc:511] Master 127.11.206.126:40221 requested a full tablet report, sending...
I20260812 00:02:10.592319 22864 ts_manager.cc:194] Registered new tserver with Master: 39630eacbe4b41bbb157bb7b8d99c4f4 (127.11.206.67:43193)
I20260812 00:02:10.592665 22864 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.206.67@KRBTEST.COM'} at 127.11.206.67:37215
I20260812 00:02:10.595901 12089 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.11.206.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.206.125@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.206.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/krb5kdc/oryx_127.11.206.125.keytab.
Entry for principal oryx/127.11.206.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/krb5kdc/oryx_127.11.206.125.keytab.
I20260812 00:02:10.621737 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.125:46169
--webserver_interface=127.11.206.125
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/krb5kdc/oryx_127.11.206.125.keytab
--principal=oryx/127.11.206.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:37943
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.206.126:40221,127.11.206.125:46169
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:02:10.705364 23697 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:02:10.705603 23697 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:02:10.705636 23697 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:02:10.706802 23697 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:02:10.706844 23697 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:02:10.706863 23697 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:02:10.706880 23697 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:02:10.706897 23697 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:02:10.708371 23697 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:37943
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.11.206.126:40221,127.11.206.125:46169
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/krb5kdc/oryx_127.11.206.125.keytab
--principal=oryx/127.11.206.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.125:46169
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.11.206.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23697
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
W20260812 00:02:10.708495 23697 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.11.206.126:40221,127.11.206.125:46169'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260812 00:02:10.708652 23697 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:02:10.708856 23697 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:02:10.713629 23709 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:10.713647 23717 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:10.713629 23708 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:10.713694 23697 server_base.cc:1034] running on GCE node
I20260812 00:02:10.714059 23697 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:02:10.714366 23697 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:02:10.715503 23697 hybrid_clock.cc:648] HybridClock initialized: now 1786492930715495 us; error 29 us; skew 500 ppm
Aug 12 00:02:10 dist-test-slave-f0tn krb5kdc[22784](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492930, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.206.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:02:10.718055 23697 init.cc:377] Logged in from keytab as oryx/127.11.206.125@KRBTEST.COM (short username oryx)
I20260812 00:02:10.718444 23697 webserver.cc:460] Webserver started at http://127.11.206.125:38833/ using document root <none> and password file <none>
I20260812 00:02:10.718690 23697 fs_manager.cc:359] Metadata directory not provided
I20260812 00:02:10.718735 23697 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:02:10.718861 23697 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:02:10.719907 23697 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/master-1/data/instance:
uuid: "1917b175bf5f470494dba47305c7c669"
format_stamp: "Formatted at 2026-08-12 00:02:10 on dist-test-slave-f0tn"
server_key: "e44069b14fece6d8e47d4c32973ef787"
server_key_iv: "fddf5a20618f3d16376e588e9373e7f1"
server_key_version: "encryptionkey@0"
I20260812 00:02:10.720228 23697 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/master-1/wal/instance:
uuid: "1917b175bf5f470494dba47305c7c669"
format_stamp: "Formatted at 2026-08-12 00:02:10 on dist-test-slave-f0tn"
server_key: "e44069b14fece6d8e47d4c32973ef787"
server_key_iv: "fddf5a20618f3d16376e588e9373e7f1"
server_key_version: "encryptionkey@0"
I20260812 00:02:10.721486 23697 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 00:02:10.722209 23726 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:10.722378 23697 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:10.722460 23697 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/master-1/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/master-1/wal
uuid: "1917b175bf5f470494dba47305c7c669"
format_stamp: "Formatted at 2026-08-12 00:02:10 on dist-test-slave-f0tn"
server_key: "e44069b14fece6d8e47d4c32973ef787"
server_key_iv: "fddf5a20618f3d16376e588e9373e7f1"
server_key_version: "encryptionkey@0"
I20260812 00:02:10.722530 23697 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:02:10.734722 23697 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:02:10.736616 23697 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:02:10.736742 23697 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:02:10.740404 23697 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.125:46169
I20260812 00:02:10.740463 23813 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.125:46169 every 8 connection(s)
I20260812 00:02:10.740788 23697 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/master-1/data/info.pb
I20260812 00:02:10.741844 23814 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:02:10.743381 23814 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.206.126" port: 40221 } has no permanent_uuid. Determining permanent_uuid...
I20260812 00:02:10.746558 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 23697
Aug 12 00:02:10 dist-test-slave-f0tn krb5kdc[22784](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492930, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.206.125@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM
Aug 12 00:02:10 dist-test-slave-f0tn krb5kdc[22784](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492929, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.11.206.125@KRBTEST.COM
I20260812 00:02:10.752948 22934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:10.744088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32934 (local address 127.11.206.126:40221)
0812 00:02:10.744147 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:10.744149 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:10.744348 (+ 199us) server_negotiation.cc:407] Connection header received
0812 00:02:10.744796 (+ 448us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:10.744797 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:10.744807 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:10.744863 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:10.745469 (+ 606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:10.745958 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:10.747165 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:10.747452 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:10.747516 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:10.750145 (+ 2629us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:10.750146 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:10.750147 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:10.750154 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:10.751575 (+ 1421us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:10.752019 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:10.752019 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:10.752020 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:10.752067 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:10.752315 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:10.752315 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:10.752316 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:10.752446 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:10.752495 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:10.752818 (+ 323us) server_negotiation.cc:299] Negotiation successful
0812 00:02:10.752876 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260812 00:02:10.753188 23817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:10.744053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:40221 (local address 127.0.0.1:32934)
0812 00:02:10.744228 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:10.744272 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:10.744711 (+ 439us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:10.744919 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:10.744922 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:10.745166 (+ 244us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:10.745360 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:10.745364 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:10.746025 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:10.746026 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:10.747076 (+ 1050us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:10.747079 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:10.747531 (+ 452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:10.747531 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:10.747652 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:10.748193 (+ 541us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:10.748203 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:10.750060 (+ 1857us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:02:10.751648 (+ 1588us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:10.751655 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:10.751658 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:10.751947 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:10.752122 (+ 175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:10.752122 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:10.752122 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:10.752258 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:10.752513 (+ 255us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:02:10.752520 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:02:10.752678 (+ 158us) client_negotiation.cc:769] Sending connection context
0812 00:02:10.752805 (+ 127us) client_negotiation.cc:240] Negotiation successful
0812 00:02:10.752959 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":88,"threads_started":1}
I20260812 00:02:10.753847 23814 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.206.125" port: 46169 } has no permanent_uuid. Determining permanent_uuid...
I20260812 00:02:10.756126 23821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:10.747157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47022 (local address 127.11.206.125:46169)
0812 00:02:10.747299 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:10.747305 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:10.747366 (+ 61us) server_negotiation.cc:407] Connection header received
0812 00:02:10.747406 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:10.747408 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:10.747425 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:10.747486 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:10.748143 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:10.749083 (+ 940us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:10.750168 (+ 1085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:10.750734 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:10.750796 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:10.753418 (+ 2622us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:10.753425 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:10.753426 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:10.753432 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:10.755129 (+ 1697us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:10.755441 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:10.755444 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:10.755445 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:10.755501 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:10.755665 (+ 164us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:10.755666 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:10.755666 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:10.755792 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:10.755924 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:10.756004 (+ 80us) server_negotiation.cc:299] Negotiation successful
0812 00:02:10.756060 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":89,"threads_started":1}
Aug 12 00:02:10 dist-test-slave-f0tn krb5kdc[22784](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492930, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.206.125@KRBTEST.COM for oryx/127.11.206.125@KRBTEST.COM
I20260812 00:02:10.760721 23817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:10.754124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.125:46169 (local address 127.0.0.1:47034)
0812 00:02:10.754429 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:10.754440 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:10.754490 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:10.754652 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:10.754653 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:10.754804 (+ 151us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:10.754862 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:10.754864 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:10.755620 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:10.755621 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:10.756286 (+ 665us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:10.756288 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:10.756718 (+ 430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:10.756719 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:10.756787 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:10.757116 (+ 329us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:10.757120 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:10.758211 (+ 1091us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:02:10.759970 (+ 1759us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:10.759971 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:10.759971 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:10.760116 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:10.760309 (+ 193us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:10.760310 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:10.760310 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:10.760353 (+ 43us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:10.760522 (+ 169us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:02:10.760523 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:02:10.760553 (+ 30us) client_negotiation.cc:769] Sending connection context
0812 00:02:10.760593 (+ 40us) client_negotiation.cc:240] Negotiation successful
0812 00:02:10.760661 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":289}
I20260812 00:02:10.760809 23826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:10.754164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47034 (local address 127.11.206.125:46169)
0812 00:02:10.754390 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:10.754392 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:10.754476 (+ 84us) server_negotiation.cc:407] Connection header received
0812 00:02:10.754570 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:10.754571 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:10.754582 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:10.754646 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:10.754934 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:10.755543 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:10.756340 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:10.756650 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:10.756702 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:10.758369 (+ 1667us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:10.758370 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:10.758371 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:10.758376 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:10.759908 (+ 1532us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:10.760195 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:10.760196 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:10.760196 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:10.760254 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:10.760388 (+ 134us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:10.760388 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:10.760388 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:10.760483 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:10.760525 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:10.760615 (+ 90us) server_negotiation.cc:299] Negotiation successful
0812 00:02:10.760708 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":32,"server-negotiator.queue_time_us":145,"thread_start_us":79,"threads_started":1}
I20260812 00:02:10.762156 23814 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1917b175bf5f470494dba47305c7c669: Bootstrap starting.
I20260812 00:02:10.762763 23814 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1917b175bf5f470494dba47305c7c669: Neither blocks nor log segments found. Creating new log.
I20260812 00:02:10.763010 23814 log.cc:824] T 00000000000000000000000000000000 P 1917b175bf5f470494dba47305c7c669: Log is configured to *not* fsync() on all Append() calls
I20260812 00:02:10.763688 23814 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1917b175bf5f470494dba47305c7c669: No bootstrap required, opened a new log
I20260812 00:02:10.765022 23814 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1917b175bf5f470494dba47305c7c669 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d9bea32edd4f1fbd437cddb7c4a5d0" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 40221 } } peers { permanent_uuid: "1917b175bf5f470494dba47305c7c669" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 46169 } }
I20260812 00:02:10.765143 23814 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1917b175bf5f470494dba47305c7c669 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:02:10.765184 23814 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1917b175bf5f470494dba47305c7c669 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1917b175bf5f470494dba47305c7c669, State: Initialized, Role: FOLLOWER
I20260812 00:02:10.765302 23814 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1917b175bf5f470494dba47305c7c669 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d9bea32edd4f1fbd437cddb7c4a5d0" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 40221 } } peers { permanent_uuid: "1917b175bf5f470494dba47305c7c669" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 46169 } }
I20260812 00:02:10.765558 23831 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1917b175bf5f470494dba47305c7c669 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d9bea32edd4f1fbd437cddb7c4a5d0" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 40221 } } peers { permanent_uuid: "1917b175bf5f470494dba47305c7c669" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 46169 } } }
I20260812 00:02:10.765614 23814 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1917b175bf5f470494dba47305c7c669 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:02:10.765638 23831 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1917b175bf5f470494dba47305c7c669 [sys.catalog]: This master's current role is: FOLLOWER
W20260812 00:02:10.767045 23850 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1917b175bf5f470494dba47305c7c669: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 00:02:10.767100 23850 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 00:02:10.768839 23697 master_runner.cc:428] Detected that this master 1917b175bf5f470494dba47305c7c669 is joining an existing cluster
I20260812 00:02:10.768925 23697 master_runner.cc:432] Initiating AddMaster RPC to add 127.11.206.125:46169
I20260812 00:02:10.776240 23865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:10.769940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.125:46169 (local address 127.0.0.1:47046)
0812 00:02:10.770117 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:10.770127 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:10.770189 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:10.770328 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:10.770329 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:10.770510 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:10.770587 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:10.770589 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:10.771486 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:10.771487 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:10.772223 (+ 736us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:10.772225 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:10.772568 (+ 343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:10.772569 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:10.772629 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:10.773022 (+ 393us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:10.773027 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:10.773545 (+ 518us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:02:10.775328 (+ 1783us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:10.775329 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:10.775329 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:10.775479 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:10.775641 (+ 162us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:10.775642 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:10.775642 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:10.775694 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:10.775929 (+ 235us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:02:10.775930 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:02:10.775964 (+ 34us) client_negotiation.cc:769] Sending connection context
0812 00:02:10.776038 (+ 74us) client_negotiation.cc:240] Negotiation successful
0812 00:02:10.776138 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":97,"threads_started":1}
I20260812 00:02:10.776330 23826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:10.770076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47046 (local address 127.11.206.125:46169)
0812 00:02:10.770140 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:10.770141 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:10.770177 (+ 36us) server_negotiation.cc:407] Connection header received
0812 00:02:10.770238 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:10.770239 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:10.770249 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:10.770321 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:10.770667 (+ 346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:10.771405 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:10.772289 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:10.772494 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:10.772544 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:10.773627 (+ 1083us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:10.773628 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:10.773629 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:10.773635 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:10.775264 (+ 1629us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:10.775539 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:10.775540 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:10.775540 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:10.775587 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:10.775750 (+ 163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:10.775751 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:10.775752 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:10.775852 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:10.775908 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:10.776059 (+ 151us) server_negotiation.cc:299] Negotiation successful
0812 00:02:10.776203 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":69,"server-negotiator.queue_time_us":51}
I20260812 00:02:10.776887 23862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:10.769953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:40221 (local address 127.0.0.1:32938)
0812 00:02:10.770117 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:10.770127 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:10.770189 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:10.770438 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:10.770439 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:10.770627 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:10.770674 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:10.770675 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:10.771283 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:10.771283 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:10.772084 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:10.772086 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:10.772769 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:10.772770 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:10.772823 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:10.773141 (+ 318us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:10.773145 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:10.773453 (+ 308us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:02:10.775132 (+ 1679us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:10.775133 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:10.775133 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:10.775802 (+ 669us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:10.776002 (+ 200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:10.776003 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:10.776004 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:10.776068 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:10.776574 (+ 506us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:02:10.776575 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:02:10.776616 (+ 41us) client_negotiation.cc:769] Sending connection context
0812 00:02:10.776697 (+ 81us) client_negotiation.cc:240] Negotiation successful
0812 00:02:10.776788 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":86,"threads_started":1}
I20260812 00:02:10.776903 22934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:10.770036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32938 (local address 127.11.206.126:40221)
0812 00:02:10.770114 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:10.770116 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:10.770191 (+ 75us) server_negotiation.cc:407] Connection header received
0812 00:02:10.770362 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:10.770363 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:10.770373 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:10.770422 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:10.770750 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:10.771204 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:10.772175 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:10.772483 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:10.772555 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:10.773534 (+ 979us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:10.773535 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:10.773536 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:10.773542 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:10.775042 (+ 1500us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:10.775881 (+ 839us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:10.775882 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:10.775882 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:10.775935 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:10.776123 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:10.776124 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:10.776124 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:10.776253 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:10.776312 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:10.776739 (+ 427us) server_negotiation.cc:299] Negotiation successful
0812 00:02:10.776820 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
Aug 12 00:02:10 dist-test-slave-f0tn krb5kdc[22784](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492930, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.206.126@KRBTEST.COM for oryx/127.11.206.125@KRBTEST.COM
I20260812 00:02:10.786094 23826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:10.779007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47058 (local address 127.11.206.125:46169)
0812 00:02:10.779042 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:10.779044 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:10.779175 (+ 131us) server_negotiation.cc:407] Connection header received
0812 00:02:10.779259 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:10.779260 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:10.779267 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:10.779298 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:10.779758 (+ 460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:10.780179 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:10.781241 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:10.781449 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:10.781496 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:10.783625 (+ 2129us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:10.783627 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:10.783627 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:10.783633 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:10.784901 (+ 1268us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:10.785328 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:10.785328 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:10.785329 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:10.785371 (+ 42us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:10.785567 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:10.785567 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:10.785567 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:10.785670 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:10.785765 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:10.785957 (+ 192us) server_negotiation.cc:299] Negotiation successful
0812 00:02:10.786035 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 00:02:10.786152 23867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:10.778931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.125:46169 (local address 127.0.0.1:47058)
0812 00:02:10.779071 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:10.779113 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:10.779189 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:10.779316 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:10.779318 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:10.779642 (+ 324us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:10.779697 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:10.779699 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:10.780246 (+ 547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:10.780247 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:10.781171 (+ 924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:10.781174 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:10.781519 (+ 345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:10.781520 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:10.781605 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:10.781997 (+ 392us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:10.782002 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:10.783495 (+ 1493us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:02:10.784982 (+ 1487us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:10.784990 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:10.784993 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:10.785262 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:10.785439 (+ 177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:10.785440 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:10.785440 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:10.785511 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:10.785760 (+ 249us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:02:10.785768 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:02:10.785824 (+ 56us) client_negotiation.cc:769] Sending connection context
0812 00:02:10.785914 (+ 90us) client_negotiation.cc:240] Negotiation successful
0812 00:02:10.786036 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":75,"thread_start_us":49,"threads_started":1}
I20260812 00:02:10.786875 22864 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.11.206.125:46169: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "1917b175bf5f470494dba47305c7c669"
member_type: NON_VOTER
last_known_addr {
host: "127.11.206.125"
port: 46169
}
attrs {
promote: true
}
}
dest_uuid: "f8d9bea32edd4f1fbd437cddb7c4a5d0"
cas_config_opid_index: -1
I20260812 00:02:10.787205 22864 consensus_queue.cc:237] T 00000000000000000000000000000000 P f8d9bea32edd4f1fbd437cddb7c4a5d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "f8d9bea32edd4f1fbd437cddb7c4a5d0" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 40221 } } peers { permanent_uuid: "1917b175bf5f470494dba47305c7c669" member_type: NON_VOTER last_known_addr { host: "127.11.206.125" port: 46169 } attrs { promote: true } }
I20260812 00:02:10.787691 23871 raft_consensus.cc:2932] T 00000000000000000000000000000000 P f8d9bea32edd4f1fbd437cddb7c4a5d0 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 1917b175bf5f470494dba47305c7c669 (127.11.206.125) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "f8d9bea32edd4f1fbd437cddb7c4a5d0" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 40221 } } peers { permanent_uuid: "1917b175bf5f470494dba47305c7c669" member_type: NON_VOTER last_known_addr { host: "127.11.206.125" port: 46169 } attrs { promote: true } } }
I20260812 00:02:10.788009 23775 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1917b175bf5f470494dba47305c7c669 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:02:10.788715 23871 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.11.206.125:46169
I20260812 00:02:10.788722 23775 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 1917b175bf5f470494dba47305c7c669 [term 1 FOLLOWER]: Refusing update from remote peer f8d9bea32edd4f1fbd437cddb7c4a5d0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260812 00:02:10.788806 23871 sys_catalog.cc:455] T 00000000000000000000000000000000 P f8d9bea32edd4f1fbd437cddb7c4a5d0 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "f8d9bea32edd4f1fbd437cddb7c4a5d0" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "f8d9bea32edd4f1fbd437cddb7c4a5d0" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 40221 } } peers { permanent_uuid: "1917b175bf5f470494dba47305c7c669" member_type: NON_VOTER last_known_addr { host: "127.11.206.125" port: 46169 } attrs { promote: true } } }
I20260812 00:02:10.788870 23871 sys_catalog.cc:458] T 00000000000000000000000000000000 P f8d9bea32edd4f1fbd437cddb7c4a5d0 [sys.catalog]: This master's current role is: LEADER
I20260812 00:02:10.788970 23697 master.cc:537] Master@127.11.206.125:46169 shutting down...
I20260812 00:02:10.789013 23871 consensus_queue.cc:1035] T 00000000000000000000000000000000 P f8d9bea32edd4f1fbd437cddb7c4a5d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1917b175bf5f470494dba47305c7c669" member_type: NON_VOTER last_known_addr { host: "127.11.206.125" port: 46169 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 00:02:10.789755 22838 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260812 00:02:10.790180 22838 consensus_peers.cc:487] T 00000000000000000000000000000000 P f8d9bea32edd4f1fbd437cddb7c4a5d0 -> Peer 1917b175bf5f470494dba47305c7c669 (127.11.206.125:46169): Couldn't send request to peer 1917b175bf5f470494dba47305c7c669. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260812 00:02:10.791882 23697 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 1917b175bf5f470494dba47305c7c669 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:02:10.791963 23697 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 1917b175bf5f470494dba47305c7c669 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:02:10.792011 23697 tablet_replica.cc:330] T 00000000000000000000000000000000 P 1917b175bf5f470494dba47305c7c669: stopping tablet replica
I20260812 00:02:10.804744 23697 master.cc:552] Master@127.11.206.125:46169 shutdown complete.
I20260812 00:02:10.804800 23697 master_runner.cc:305] Clearing existing system tablet
I20260812 00:02:10.804931 23697 fs_manager.cc:359] Metadata directory not provided
I20260812 00:02:10.804977 23697 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:02:10.805812 23697 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 00:02:10.806645 23878 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:10.806787 23697 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:02:10.806849 23697 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260812 00:02:10.806874 23697 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/master-1/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/master-1/wal
uuid: "1917b175bf5f470494dba47305c7c669"
format_stamp: "Formatted at 2026-08-12 00:02:10 on dist-test-slave-f0tn"
server_key: "e44069b14fece6d8e47d4c32973ef787"
server_key_iv: "fddf5a20618f3d16376e588e9373e7f1"
server_key_version: "encryptionkey@0"
I20260812 00:02:10.807737 23697 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 1917b175bf5f470494dba47305c7c669: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:02:10.809263 23697 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 1917b175bf5f470494dba47305c7c669: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260812 00:02:10.809336 23697 log.cc:1196] T 00000000000000000000000000000000 P 1917b175bf5f470494dba47305c7c669: Deleting WAL directory at /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260812 00:02:10.809571 23697 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 1917b175bf5f470494dba47305c7c669: Deleting consensus metadata
I20260812 00:02:10.809687 23697 master_runner.cc:315] Copying system tablet from 127.11.206.126:40221
I20260812 00:02:10.810298 23697 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 1917b175bf5f470494dba47305c7c669: tablet copy: Beginning tablet copy session from remote peer at address 127.11.206.126:40221
I20260812 00:02:10.816146 22934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:10.810635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32944 (local address 127.11.206.126:40221)
0812 00:02:10.810684 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:10.810686 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:10.810717 (+ 31us) server_negotiation.cc:407] Connection header received
0812 00:02:10.810793 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:10.810794 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:10.810803 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:10.810848 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:10.811181 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:10.811660 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:10.812703 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:10.812879 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:10.812920 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:10.813932 (+ 1012us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:10.813933 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:10.813933 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:10.813939 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:10.815153 (+ 1214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:10.815537 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:10.815537 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:10.815538 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:10.815582 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:10.815753 (+ 171us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:10.815753 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:10.815753 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:10.815844 (+ 91us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:10.815886 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:10.816030 (+ 144us) server_negotiation.cc:299] Negotiation successful
0812 00:02:10.816083 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 00:02:10.816228 23894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:10.810545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:40221 (local address 127.0.0.1:32944)
0812 00:02:10.810652 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:10.810663 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:10.810733 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:10.810856 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:10.810857 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:10.811052 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:10.811121 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:10.811123 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:10.811730 (+ 607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:10.811731 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:10.812631 (+ 900us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:10.812634 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:10.812943 (+ 309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:10.812944 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:10.813014 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:10.813456 (+ 442us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:10.813461 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:10.813855 (+ 394us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:02:10.815233 (+ 1378us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:10.815234 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:10.815235 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:10.815467 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:10.815636 (+ 169us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:10.815637 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:10.815637 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:10.815700 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:10.815897 (+ 197us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:02:10.815898 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:02:10.815945 (+ 47us) client_negotiation.cc:769] Sending connection context
0812 00:02:10.816013 (+ 68us) client_negotiation.cc:240] Negotiation successful
0812 00:02:10.816117 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":84,"thread_start_us":65,"threads_started":1}
I20260812 00:02:10.816604 22893 tablet_copy_service.cc:140] P f8d9bea32edd4f1fbd437cddb7c4a5d0: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 1917b175bf5f470494dba47305c7c669 ({username='oryx', principal='oryx/127.11.206.125@KRBTEST.COM'} at 127.0.0.1:32944)
I20260812 00:02:10.816692 22893 tablet_copy_service.cc:161] P f8d9bea32edd4f1fbd437cddb7c4a5d0: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 1917b175bf5f470494dba47305c7c669 at {username='oryx', principal='oryx/127.11.206.125@KRBTEST.COM'} at 127.0.0.1:32944: session id = 1917b175bf5f470494dba47305c7c669-00000000000000000000000000000000
I20260812 00:02:10.817296 22893 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P f8d9bea32edd4f1fbd437cddb7c4a5d0: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 00:02:10.817931 23697 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260812 00:02:10.819147 23697 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 1917b175bf5f470494dba47305c7c669: tablet copy: Starting download of 0 data blocks...
I20260812 00:02:10.819308 23697 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 1917b175bf5f470494dba47305c7c669: tablet copy: Starting download of 1 WAL segments...
I20260812 00:02:10.820231 23697 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 1917b175bf5f470494dba47305c7c669: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 00:02:10.820987 22893 tablet_copy_service.cc:342] P f8d9bea32edd4f1fbd437cddb7c4a5d0: Request end of tablet copy session 1917b175bf5f470494dba47305c7c669-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.11.206.125@KRBTEST.COM'} at 127.0.0.1:32944
I20260812 00:02:10.821033 22893 tablet_copy_service.cc:433] P f8d9bea32edd4f1fbd437cddb7c4a5d0: ending tablet copy session 1917b175bf5f470494dba47305c7c669-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 1917b175bf5f470494dba47305c7c669
I20260812 00:02:10.823607 23697 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:02:10.824674 23898 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:10.824760 23896 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:10.824788 23895 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:10.824940 23697 server_base.cc:1034] running on GCE node
I20260812 00:02:10.825026 23697 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:02:10.825150 23697 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:02:10.826258 23697 hybrid_clock.cc:648] HybridClock initialized: now 1786492930826251 us; error 24 us; skew 500 ppm
Aug 12 00:02:10 dist-test-slave-f0tn krb5kdc[22784](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492930, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.206.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:02:10.827443 23697 init.cc:377] Logged in from keytab as oryx/127.11.206.125@KRBTEST.COM (short username oryx)
I20260812 00:02:10.827672 23697 webserver.cc:460] Webserver started at http://127.11.206.125:43443/ using document root <none> and password file <none>
I20260812 00:02:10.827792 23697 fs_manager.cc:359] Metadata directory not provided
I20260812 00:02:10.827821 23697 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:02:10.828378 23697 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:10.828852 23905 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:10.828982 23697 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:10.829025 23697 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/master-1/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/master-1/wal
uuid: "1917b175bf5f470494dba47305c7c669"
format_stamp: "Formatted at 2026-08-12 00:02:10 on dist-test-slave-f0tn"
server_key: "e44069b14fece6d8e47d4c32973ef787"
server_key_iv: "fddf5a20618f3d16376e588e9373e7f1"
server_key_version: "encryptionkey@0"
I20260812 00:02:10.829082 23697 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:02:10.847010 23697 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:02:10.848471 23697 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:02:10.851410 23697 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.125:46169
I20260812 00:02:10.851428 23999 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.125:46169 every 8 connection(s)
I20260812 00:02:10.851768 23697 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/master-1/data/info.pb
I20260812 00:02:10.852783 24001 sys_catalog.cc:263] Verifying existing consensus state
I20260812 00:02:10.853400 24001 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1917b175bf5f470494dba47305c7c669: Bootstrap starting.
I20260812 00:02:10.856536 24001 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1917b175bf5f470494dba47305c7c669: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 00:02:10.856755 24001 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1917b175bf5f470494dba47305c7c669: Bootstrap complete.
I20260812 00:02:10.856946 24001 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1917b175bf5f470494dba47305c7c669 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "f8d9bea32edd4f1fbd437cddb7c4a5d0" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 40221 } } peers { permanent_uuid: "1917b175bf5f470494dba47305c7c669" member_type: NON_VOTER last_known_addr { host: "127.11.206.125" port: 46169 } attrs { promote: true } }
I20260812 00:02:10.857038 24001 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1917b175bf5f470494dba47305c7c669 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1917b175bf5f470494dba47305c7c669, State: Initialized, Role: LEARNER
I20260812 00:02:10.857084 24001 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1917b175bf5f470494dba47305c7c669 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "f8d9bea32edd4f1fbd437cddb7c4a5d0" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 40221 } } peers { permanent_uuid: "1917b175bf5f470494dba47305c7c669" member_type: NON_VOTER last_known_addr { host: "127.11.206.125" port: 46169 } attrs { promote: true } }
I20260812 00:02:10.857265 24001 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1917b175bf5f470494dba47305c7c669 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:02:10.857249 24008 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1917b175bf5f470494dba47305c7c669 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "f8d9bea32edd4f1fbd437cddb7c4a5d0" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 40221 } } peers { permanent_uuid: "1917b175bf5f470494dba47305c7c669" member_type: NON_VOTER last_known_addr { host: "127.11.206.125" port: 46169 } attrs { promote: true } } }
I20260812 00:02:10.857353 24008 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1917b175bf5f470494dba47305c7c669 [sys.catalog]: This master's current role is: LEARNER
I20260812 00:02:10.858844 24033 catalog_manager.cc:1259] Loaded cluster ID: 8e5c799ca7af493c8cb9aab24be43514
I20260812 00:02:10.859391 24033 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 1917b175bf5f470494dba47305c7c669: loading cluster ID for follower catalog manager: success
I20260812 00:02:10.860481 24033 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 1917b175bf5f470494dba47305c7c669: acquiring CA information for follower catalog manager: success
I20260812 00:02:10.860780 24033 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 1917b175bf5f470494dba47305c7c669: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 00:02:10.865286 24016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:10.857733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47072 (local address 127.11.206.125:46169)
0812 00:02:10.858659 (+ 926us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:10.858661 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:10.858672 (+ 11us) server_negotiation.cc:407] Connection header received
0812 00:02:10.858698 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:10.858699 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:10.858710 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:10.858792 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:10.859343 (+ 551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:10.860577 (+ 1234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:10.861352 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:10.861596 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:10.861651 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:10.862823 (+ 1172us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:10.862824 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:10.862825 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:10.862832 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:10.864279 (+ 1447us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:10.864587 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:10.864588 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:10.864589 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:10.864639 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:10.864815 (+ 176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:10.864816 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:10.864816 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:10.864915 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:10.865003 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:10.865104 (+ 101us) server_negotiation.cc:299] Negotiation successful
0812 00:02:10.865193 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":129,"server-negotiator.queue_time_us":900,"thread_start_us":78,"threads_started":1}
WARNING: no policy specified for oryx/127.11.206.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.206.124@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.206.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/krb5kdc/oryx_127.11.206.124.keytab.
Entry for principal oryx/127.11.206.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/krb5kdc/oryx_127.11.206.124.keytab.
I20260812 00:02:10.890583 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.124:36719
--webserver_interface=127.11.206.124
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/krb5kdc/oryx_127.11.206.124.keytab
--principal=oryx/127.11.206.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:37943
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.206.126:40221,127.11.206.125:46169,127.11.206.124:36719
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:02:10.992115 24039 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:02:10.992338 24039 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:02:10.992373 24039 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:02:10.993602 24039 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:02:10.993645 24039 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:02:10.993664 24039 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:02:10.993681 24039 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:02:10.993695 24039 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:02:10.995499 24039 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:37943
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.11.206.126:40221,127.11.206.125:46169,127.11.206.124:36719
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/krb5kdc/oryx_127.11.206.124.keytab
--principal=oryx/127.11.206.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.124:36719
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.11.206.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24039
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:02:10.995761 24039 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:02:10.995980 24039 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:02:11.000972 24061 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:11.000990 24055 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:11.000975 24052 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:11.001199 24039 server_base.cc:1034] running on GCE node
I20260812 00:02:11.001507 24039 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:02:11.001804 24039 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:02:11.002950 24039 hybrid_clock.cc:648] HybridClock initialized: now 1786492931002926 us; error 37 us; skew 500 ppm
Aug 12 00:02:11 dist-test-slave-f0tn krb5kdc[22784](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492931, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.206.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:02:11.006306 24039 init.cc:377] Logged in from keytab as oryx/127.11.206.124@KRBTEST.COM (short username oryx)
I20260812 00:02:11.006747 24039 webserver.cc:460] Webserver started at http://127.11.206.124:42061/ using document root <none> and password file <none>
I20260812 00:02:11.006934 24039 fs_manager.cc:359] Metadata directory not provided
I20260812 00:02:11.006975 24039 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:02:11.007076 24039 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:02:11.008391 24039 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/master-2/data/instance:
uuid: "fc02528e6aee4f539756717eea57931c"
format_stamp: "Formatted at 2026-08-12 00:02:11 on dist-test-slave-f0tn"
server_key: "19b9f80c776d6c005d97156c6014c960"
server_key_iv: "877f814e027b420173e7f4738a2700b8"
server_key_version: "encryptionkey@0"
I20260812 00:02:11.008769 24039 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/master-2/wal/instance:
uuid: "fc02528e6aee4f539756717eea57931c"
format_stamp: "Formatted at 2026-08-12 00:02:11 on dist-test-slave-f0tn"
server_key: "19b9f80c776d6c005d97156c6014c960"
server_key_iv: "877f814e027b420173e7f4738a2700b8"
server_key_version: "encryptionkey@0"
I20260812 00:02:11.010497 24039 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260812 00:02:11.011370 24075 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:11.011552 24039 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:02:11.011660 24039 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/master-2/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/master-2/wal
uuid: "fc02528e6aee4f539756717eea57931c"
format_stamp: "Formatted at 2026-08-12 00:02:11 on dist-test-slave-f0tn"
server_key: "19b9f80c776d6c005d97156c6014c960"
server_key_iv: "877f814e027b420173e7f4738a2700b8"
server_key_version: "encryptionkey@0"
I20260812 00:02:11.011725 24039 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:02:11.027197 24039 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:02:11.029294 24039 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:02:11.029511 24039 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:02:11.039033 24039 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.124:36719
I20260812 00:02:11.039201 24173 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.124:36719 every 8 connection(s)
I20260812 00:02:11.039499 24039 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/master-2/data/info.pb
I20260812 00:02:11.040700 24174 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:02:11.042760 24174 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.206.126" port: 40221 } has no permanent_uuid. Determining permanent_uuid...
I20260812 00:02:11.045969 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 24039
Aug 12 00:02:11 dist-test-slave-f0tn krb5kdc[22784](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492931, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.206.124@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM
Aug 12 00:02:11 dist-test-slave-f0tn krb5kdc[22784](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492929, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.11.206.124@KRBTEST.COM
I20260812 00:02:11.053440 22934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:11.043617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32946 (local address 127.11.206.126:40221)
0812 00:02:11.043678 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:11.043680 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:11.043863 (+ 183us) server_negotiation.cc:407] Connection header received
0812 00:02:11.044446 (+ 583us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:11.044447 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:11.044456 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:11.044515 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:11.045249 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.045921 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.047446 (+ 1525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.047718 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.047806 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:11.050687 (+ 2881us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:11.050689 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:11.050689 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:11.050696 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:11.052018 (+ 1322us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:11.052423 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:11.052423 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:11.052424 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:11.052476 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:11.052724 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:11.052725 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:11.052725 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:11.052853 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:11.052905 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:11.053255 (+ 350us) server_negotiation.cc:299] Negotiation successful
0812 00:02:11.053332 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260812 00:02:11.053663 24176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:11.043469 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:40221 (local address 127.0.0.1:32946)
0812 00:02:11.043736 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:11.043780 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:11.044361 (+ 581us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:11.044592 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:11.044595 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:11.044884 (+ 289us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:11.045175 (+ 291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:11.045180 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.046020 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.046021 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:11.047344 (+ 1323us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:11.047347 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.047901 (+ 554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.047903 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:11.048107 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:11.048645 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:11.048657 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:11.050604 (+ 1947us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:02:11.052104 (+ 1500us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:11.052110 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:11.052112 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:11.052349 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:11.052536 (+ 187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:11.052537 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:11.052537 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:11.052657 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:11.052918 (+ 261us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:02:11.052925 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:02:11.053109 (+ 184us) client_negotiation.cc:769] Sending connection context
0812 00:02:11.053215 (+ 106us) client_negotiation.cc:240] Negotiation successful
0812 00:02:11.053414 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":156,"threads_started":1}
I20260812 00:02:11.054363 24174 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.206.125" port: 46169 } has no permanent_uuid. Determining permanent_uuid...
I20260812 00:02:11.055289 24177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:11.046568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37410 (local address 127.11.206.124:36719)
0812 00:02:11.046764 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:11.046768 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:11.046784 (+ 16us) server_negotiation.cc:407] Connection header received
0812 00:02:11.046802 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:11.046804 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:11.046827 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:11.046891 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:11.047549 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.048549 (+ 1000us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.049509 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.049941 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.050069 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:11.052355 (+ 2286us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:11.052361 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:11.052362 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:11.052368 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:11.053991 (+ 1623us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:11.054375 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:11.054377 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:11.054377 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:11.054425 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:11.054602 (+ 177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:11.054603 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:11.054603 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:11.054779 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:11.054904 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:11.055010 (+ 106us) server_negotiation.cc:299] Negotiation successful
0812 00:02:11.055089 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":87,"threads_started":1}
Aug 12 00:02:11 dist-test-slave-f0tn krb5kdc[22784](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492931, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.206.124@KRBTEST.COM for oryx/127.11.206.125@KRBTEST.COM
I20260812 00:02:11.060428 24176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:11.054628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.125:46169 (local address 127.0.0.1:47074)
0812 00:02:11.054663 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:11.054672 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:11.054703 (+ 31us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:11.054903 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:11.054904 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:11.055047 (+ 143us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:11.055076 (+ 29us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:11.055078 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.055840 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.055841 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:11.056373 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:11.056374 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.056730 (+ 356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.056731 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:11.056787 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:11.057081 (+ 294us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:11.057085 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:11.058410 (+ 1325us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:02:11.059696 (+ 1286us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:11.059697 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:11.059697 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:11.059851 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:11.059994 (+ 143us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:11.059994 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:11.059995 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:11.060038 (+ 43us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:11.060196 (+ 158us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:02:11.060196 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:02:11.060230 (+ 34us) client_negotiation.cc:769] Sending connection context
0812 00:02:11.060298 (+ 68us) client_negotiation.cc:240] Negotiation successful
0812 00:02:11.060365 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17}
I20260812 00:02:11.060454 24016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:11.054704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47074 (local address 127.11.206.125:46169)
0812 00:02:11.054785 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:11.054787 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:11.054794 (+ 7us) server_negotiation.cc:407] Connection header received
0812 00:02:11.054818 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:11.054819 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:11.054829 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:11.054882 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:11.055156 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.055764 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.056452 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.056670 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.056724 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:11.058474 (+ 1750us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:11.058475 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:11.058476 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:11.058483 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:11.059631 (+ 1148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:11.059905 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:11.059905 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:11.059906 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:11.059951 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:11.060070 (+ 119us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:11.060071 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:11.060071 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:11.060158 (+ 87us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:11.060199 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:11.060316 (+ 117us) server_negotiation.cc:299] Negotiation successful
0812 00:02:11.060390 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260812 00:02:11.060791 24174 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.206.124" port: 36719 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 00:02:11 dist-test-slave-f0tn krb5kdc[22784](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492931, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.206.124@KRBTEST.COM for oryx/127.11.206.124@KRBTEST.COM
I20260812 00:02:11.066372 24176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:11.061035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.124:36719 (local address 127.0.0.1:37418)
0812 00:02:11.061115 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:11.061124 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:11.061163 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:11.061268 (+ 105us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:11.061269 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:11.061369 (+ 100us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:11.061436 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:11.061437 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.062078 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.062079 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:11.062540 (+ 461us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:11.062542 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.062905 (+ 363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.062905 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:11.062939 (+ 34us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:11.063238 (+ 299us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:11.063242 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:11.064265 (+ 1023us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:02:11.065626 (+ 1361us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:11.065626 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:11.065627 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:11.065772 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:11.065912 (+ 140us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:11.065913 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:11.065913 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:11.065956 (+ 43us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:11.066120 (+ 164us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:02:11.066121 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:02:11.066155 (+ 34us) client_negotiation.cc:769] Sending connection context
0812 00:02:11.066201 (+ 46us) client_negotiation.cc:240] Negotiation successful
0812 00:02:11.066283 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":68}
I20260812 00:02:11.066421 24177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:11.061083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37418 (local address 127.11.206.124:36719)
0812 00:02:11.061116 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:11.061118 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:11.061152 (+ 34us) server_negotiation.cc:407] Connection header received
0812 00:02:11.061196 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:11.061196 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:11.061204 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:11.061257 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:11.061479 (+ 222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.061988 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.062594 (+ 606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.062855 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.062901 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:11.064332 (+ 1431us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:11.064333 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:11.064334 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:11.064340 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:11.065563 (+ 1223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:11.065826 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:11.065826 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:11.065827 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:11.065869 (+ 42us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:11.065991 (+ 122us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:11.065992 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:11.065992 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:11.066080 (+ 88us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:11.066119 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:11.066215 (+ 96us) server_negotiation.cc:299] Negotiation successful
0812 00:02:11.066325 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":41,"server-negotiator.queue_time_us":15}
I20260812 00:02:11.067991 24174 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc02528e6aee4f539756717eea57931c: Bootstrap starting.
I20260812 00:02:11.069200 24174 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fc02528e6aee4f539756717eea57931c: Neither blocks nor log segments found. Creating new log.
I20260812 00:02:11.069725 24174 log.cc:824] T 00000000000000000000000000000000 P fc02528e6aee4f539756717eea57931c: Log is configured to *not* fsync() on all Append() calls
I20260812 00:02:11.070628 24174 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc02528e6aee4f539756717eea57931c: No bootstrap required, opened a new log
I20260812 00:02:11.073065 24174 raft_consensus.cc:348] T 00000000000000000000000000000000 P fc02528e6aee4f539756717eea57931c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d9bea32edd4f1fbd437cddb7c4a5d0" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 40221 } } peers { permanent_uuid: "1917b175bf5f470494dba47305c7c669" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 46169 } } peers { permanent_uuid: "fc02528e6aee4f539756717eea57931c" member_type: VOTER last_known_addr { host: "127.11.206.124" port: 36719 } }
I20260812 00:02:11.073202 24174 raft_consensus.cc:374] T 00000000000000000000000000000000 P fc02528e6aee4f539756717eea57931c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:02:11.073231 24174 raft_consensus.cc:729] T 00000000000000000000000000000000 P fc02528e6aee4f539756717eea57931c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc02528e6aee4f539756717eea57931c, State: Initialized, Role: FOLLOWER
I20260812 00:02:11.073339 24174 consensus_queue.cc:260] T 00000000000000000000000000000000 P fc02528e6aee4f539756717eea57931c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d9bea32edd4f1fbd437cddb7c4a5d0" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 40221 } } peers { permanent_uuid: "1917b175bf5f470494dba47305c7c669" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 46169 } } peers { permanent_uuid: "fc02528e6aee4f539756717eea57931c" member_type: VOTER last_known_addr { host: "127.11.206.124" port: 36719 } }
I20260812 00:02:11.073807 24174 sys_catalog.cc:564] T 00000000000000000000000000000000 P fc02528e6aee4f539756717eea57931c [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:02:11.073835 24179 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc02528e6aee4f539756717eea57931c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d9bea32edd4f1fbd437cddb7c4a5d0" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 40221 } } peers { permanent_uuid: "1917b175bf5f470494dba47305c7c669" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 46169 } } peers { permanent_uuid: "fc02528e6aee4f539756717eea57931c" member_type: VOTER last_known_addr { host: "127.11.206.124" port: 36719 } } }
I20260812 00:02:11.073982 24179 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc02528e6aee4f539756717eea57931c [sys.catalog]: This master's current role is: FOLLOWER
W20260812 00:02:11.076429 24197 catalog_manager.cc:1558] T 00000000000000000000000000000000 P fc02528e6aee4f539756717eea57931c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 00:02:11.076499 24197 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 00:02:11.078826 24039 master_runner.cc:428] Detected that this master fc02528e6aee4f539756717eea57931c is joining an existing cluster
I20260812 00:02:11.078872 24039 master_runner.cc:432] Initiating AddMaster RPC to add 127.11.206.124:36719
I20260812 00:02:11.106738 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 22971
I20260812 00:02:11.122677 24016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:11.080250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47080 (local address 127.11.206.125:46169)
0812 00:02:11.080302 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:11.080304 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:11.080626 (+ 322us) server_negotiation.cc:407] Connection header received
0812 00:02:11.080749 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:11.080750 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:11.080762 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:11.080816 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:11.081895 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.082618 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.083865 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.084190 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.084224 (+ 34us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:11.106499 (+ 22275us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:11.106502 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:11.106502 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:11.106512 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:11.108427 (+ 1915us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:11.120989 (+ 12562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:11.120991 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:11.120991 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:11.121099 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:11.121994 (+ 895us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:11.121995 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:11.121995 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:11.122185 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:11.122246 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:11.122470 (+ 224us) server_negotiation.cc:299] Negotiation successful
0812 00:02:11.122571 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260812 00:02:11.123593 24209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:11.080285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.125:46169 (local address 127.0.0.1:47080)
0812 00:02:11.080548 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:11.080560 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:11.080667 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:11.081001 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:11.081002 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:11.081427 (+ 425us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:11.081809 (+ 382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:11.081811 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.082699 (+ 888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.082700 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:11.083764 (+ 1064us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:11.083768 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.084319 (+ 551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.084319 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:11.084513 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:11.084862 (+ 349us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:11.084866 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:11.106353 (+ 21487us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:02:11.108538 (+ 2185us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:11.108539 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:11.108540 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:11.120542 (+ 12002us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:11.121424 (+ 882us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:11.121425 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:11.121425 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:11.121704 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:11.122282 (+ 578us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:02:11.122282 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:02:11.122357 (+ 75us) client_negotiation.cc:769] Sending connection context
0812 00:02:11.123361 (+ 1004us) client_negotiation.cc:240] Negotiation successful
0812 00:02:11.123474 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":226,"mutex_wait_us":37,"thread_start_us":159,"threads_started":1}
I20260812 00:02:11.124725 24177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:11.080660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37424 (local address 127.11.206.124:36719)
0812 00:02:11.080695 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:11.080696 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:11.080981 (+ 285us) server_negotiation.cc:407] Connection header received
0812 00:02:11.081058 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:11.081059 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:11.081066 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:11.081092 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:11.081826 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.082521 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.083579 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.083861 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.083903 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:11.120913 (+ 37010us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:11.120915 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:11.120915 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:11.120924 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:11.123089 (+ 2165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:11.123968 (+ 879us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:11.123970 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:11.123970 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:11.124026 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:11.124211 (+ 185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:11.124212 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:11.124212 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:11.124347 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:11.124388 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:11.124552 (+ 164us) server_negotiation.cc:299] Negotiation successful
0812 00:02:11.124633 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260812 00:02:11.125113 22934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:11.080289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32954 (local address 127.11.206.126:40221)
0812 00:02:11.080339 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:11.080341 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:11.080934 (+ 593us) server_negotiation.cc:407] Connection header received
0812 00:02:11.080997 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:11.080998 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:11.081009 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:11.081053 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:11.081752 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.082562 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.083875 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.084175 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.084214 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:11.120360 (+ 36146us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:11.120363 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:11.120363 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:11.120375 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:11.122424 (+ 2049us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:11.124271 (+ 1847us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:11.124273 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:11.124273 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:11.124351 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:11.124575 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:11.124576 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:11.124576 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:11.124707 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:11.124747 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:11.124945 (+ 198us) server_negotiation.cc:299] Negotiation successful
0812 00:02:11.125030 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 00:02:11.125474 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.65:45231
--local_ip_for_outbound_sockets=127.11.206.65
--tserver_master_addrs=127.11.206.126:40221
--webserver_port=35221
--webserver_interface=127.11.206.65
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/krb5kdc/oryx_127.11.206.65.keytab
--principal=oryx/127.11.206.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:37943
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.11.206.126:40221,127.11.206.125:46169
--tserver_master_addrs=127.11.206.126:40221,127.11.206.125:46169,127.11.206.124:36719 with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:02:11.125560 24213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:11.080323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:40221 (local address 127.0.0.1:32954)
0812 00:02:11.080875 (+ 552us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:11.080884 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:11.080940 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:11.081100 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:11.081101 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:11.081556 (+ 455us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:11.081644 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:11.081647 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.082654 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.082655 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:11.083791 (+ 1136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:11.083792 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.084307 (+ 515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.084308 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:11.084419 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:11.106093 (+ 21674us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:11.106099 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:11.120204 (+ 14105us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:02:11.123117 (+ 2913us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:11.123118 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:11.123118 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:11.123452 (+ 334us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:11.124438 (+ 986us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:11.124439 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:11.124439 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:11.124506 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:11.124795 (+ 289us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:02:11.124795 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:02:11.124840 (+ 45us) client_negotiation.cc:769] Sending connection context
0812 00:02:11.125204 (+ 364us) client_negotiation.cc:240] Negotiation successful
0812 00:02:11.125445 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":509,"mutex_wait_us":108,"thread_start_us":118,"threads_started":1}
I20260812 00:02:11.125929 24214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:11.080602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.124:36719 (local address 127.0.0.1:37424)
0812 00:02:11.080922 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:11.080934 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:11.081002 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:11.081146 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:11.081146 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:11.081594 (+ 448us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:11.081722 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:11.081732 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.082608 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.082608 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:11.083487 (+ 879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:11.083490 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.083983 (+ 493us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.083984 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:11.084038 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:11.084556 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:11.084560 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:11.106542 (+ 21982us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:02:11.123230 (+ 16688us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:11.123231 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:11.123231 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:11.123886 (+ 655us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:11.124098 (+ 212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:11.124099 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:11.124099 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:11.124151 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:11.124427 (+ 276us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:02:11.124428 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:02:11.124462 (+ 34us) client_negotiation.cc:769] Sending connection context
0812 00:02:11.125049 (+ 587us) client_negotiation.cc:240] Negotiation successful
0812 00:02:11.125348 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":301,"thread_start_us":272,"threads_started":1}
Aug 12 00:02:11 dist-test-slave-f0tn krb5kdc[22784](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492930, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.206.126@KRBTEST.COM for oryx/127.11.206.124@KRBTEST.COM
I20260812 00:02:11.135438 24177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:11.127875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37430 (local address 127.11.206.124:36719)
0812 00:02:11.127924 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:11.127926 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:11.127932 (+ 6us) server_negotiation.cc:407] Connection header received
0812 00:02:11.127964 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:11.127965 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:11.127973 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:11.128015 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:11.128307 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.128950 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.130024 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.130358 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.130432 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:11.132634 (+ 2202us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:11.132635 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:11.132636 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:11.132644 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:11.134181 (+ 1537us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:11.134594 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:11.134595 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:11.134595 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:11.134658 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:11.134867 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:11.134867 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:11.134868 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:11.135004 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:11.135077 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:11.135248 (+ 171us) server_negotiation.cc:299] Negotiation successful
0812 00:02:11.135333 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260812 00:02:11.135452 23867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:11.127713 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.124:36719 (local address 127.0.0.1:37430)
0812 00:02:11.127773 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:11.127782 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:11.127822 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:11.128034 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:11.128035 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:11.128188 (+ 153us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:11.128231 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:11.128233 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.129052 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.129054 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:11.129935 (+ 881us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:11.129939 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.130439 (+ 500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.130440 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:11.130512 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:11.130951 (+ 439us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:11.130956 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:11.132538 (+ 1582us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:02:11.134283 (+ 1745us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:11.134284 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:11.134284 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:11.134511 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:11.134727 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:11.134728 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:11.134729 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:11.134800 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:11.135081 (+ 281us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:02:11.135082 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:02:11.135139 (+ 57us) client_negotiation.cc:769] Sending connection context
0812 00:02:11.135212 (+ 73us) client_negotiation.cc:240] Negotiation successful
0812 00:02:11.135347 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260812 00:02:11.136530 22864 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.11.206.124:36719: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "fc02528e6aee4f539756717eea57931c"
member_type: NON_VOTER
last_known_addr {
host: "127.11.206.124"
port: 36719
}
attrs {
promote: true
}
}
dest_uuid: "f8d9bea32edd4f1fbd437cddb7c4a5d0"
cas_config_opid_index: 5
I20260812 00:02:11.136838 22864 consensus_queue.cc:237] T 00000000000000000000000000000000 P f8d9bea32edd4f1fbd437cddb7c4a5d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "f8d9bea32edd4f1fbd437cddb7c4a5d0" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 40221 } } peers { permanent_uuid: "1917b175bf5f470494dba47305c7c669" member_type: NON_VOTER last_known_addr { host: "127.11.206.125" port: 46169 } attrs { promote: true } } peers { permanent_uuid: "fc02528e6aee4f539756717eea57931c" member_type: NON_VOTER last_known_addr { host: "127.11.206.124" port: 36719 } attrs { promote: true } }
I20260812 00:02:11.137295 23871 raft_consensus.cc:2932] T 00000000000000000000000000000000 P f8d9bea32edd4f1fbd437cddb7c4a5d0 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER fc02528e6aee4f539756717eea57931c (127.11.206.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "f8d9bea32edd4f1fbd437cddb7c4a5d0" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 40221 } } peers { permanent_uuid: "1917b175bf5f470494dba47305c7c669" member_type: NON_VOTER last_known_addr { host: "127.11.206.125" port: 46169 } attrs { promote: true } } peers { permanent_uuid: "fc02528e6aee4f539756717eea57931c" member_type: NON_VOTER last_known_addr { host: "127.11.206.124" port: 36719 } attrs { promote: true } } }
I20260812 00:02:11.138275 23871 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.11.206.124:36719
I20260812 00:02:11.138353 23871 sys_catalog.cc:455] T 00000000000000000000000000000000 P f8d9bea32edd4f1fbd437cddb7c4a5d0 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "f8d9bea32edd4f1fbd437cddb7c4a5d0" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "f8d9bea32edd4f1fbd437cddb7c4a5d0" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 40221 } } peers { permanent_uuid: "1917b175bf5f470494dba47305c7c669" member_type: NON_VOTER last_known_addr { host: "127.11.206.125" port: 46169 } attrs { promote: true } } peers { permanent_uuid: "fc02528e6aee4f539756717eea57931c" member_type: NON_VOTER last_known_addr { host: "127.11.206.124" port: 36719 } attrs { promote: true } } }
I20260812 00:02:11.138419 23871 sys_catalog.cc:458] T 00000000000000000000000000000000 P f8d9bea32edd4f1fbd437cddb7c4a5d0 [sys.catalog]: This master's current role is: LEADER
I20260812 00:02:11.138751 24039 master.cc:537] Master@127.11.206.124:36719 shutting down...
I20260812 00:02:11.138929 24123 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fc02528e6aee4f539756717eea57931c [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:02:11.139891 24123 raft_consensus.cc:1261] T 00000000000000000000000000000000 P fc02528e6aee4f539756717eea57931c [term 1 FOLLOWER]: Refusing update from remote peer f8d9bea32edd4f1fbd437cddb7c4a5d0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260812 00:02:11.140385 23868 consensus_queue.cc:1035] T 00000000000000000000000000000000 P f8d9bea32edd4f1fbd437cddb7c4a5d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc02528e6aee4f539756717eea57931c" member_type: NON_VOTER last_known_addr { host: "127.11.206.124" port: 36719 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 00:02:11.141250 22838 consensus_peers.cc:487] T 00000000000000000000000000000000 P f8d9bea32edd4f1fbd437cddb7c4a5d0 -> Peer fc02528e6aee4f539756717eea57931c (127.11.206.124:36719): Couldn't send request to peer fc02528e6aee4f539756717eea57931c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260812 00:02:11.143148 24016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:11.137463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47084 (local address 127.11.206.125:46169)
0812 00:02:11.137504 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:11.137506 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:11.138972 (+ 1466us) server_negotiation.cc:407] Connection header received
0812 00:02:11.139075 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:11.139076 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:11.139101 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:11.139142 (+ 41us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:02:11.139352 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.140140 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.141868 (+ 1728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.142472 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.142523 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:11.142601 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:11.143018 (+ 417us) server_negotiation.cc:299] Negotiation successful
0812 00:02:11.143072 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 00:02:11.143378 24039 raft_consensus.cc:2229] T 00000000000000000000000000000000 P fc02528e6aee4f539756717eea57931c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:02:11.143476 24039 raft_consensus.cc:2258] T 00000000000000000000000000000000 P fc02528e6aee4f539756717eea57931c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:02:11.143527 24039 tablet_replica.cc:330] T 00000000000000000000000000000000 P fc02528e6aee4f539756717eea57931c: stopping tablet replica
I20260812 00:02:11.143800 23867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:11.137368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.125:46169 (local address 127.0.0.1:47084)
0812 00:02:11.138911 (+ 1543us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:11.138925 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:11.139002 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:11.139226 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:11.139227 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:11.139228 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:02:11.139283 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:11.139285 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.140315 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.140316 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:11.141743 (+ 1427us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:11.141747 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.142661 (+ 914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.142662 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:11.142726 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:11.142756 (+ 30us) client_negotiation.cc:769] Sending connection context
0812 00:02:11.143678 (+ 922us) client_negotiation.cc:240] Negotiation successful
0812 00:02:11.143733 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1523}
I20260812 00:02:11.144057 23958 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 1917b175bf5f470494dba47305c7c669 [term 1 LEARNER]: Refusing update from remote peer f8d9bea32edd4f1fbd437cddb7c4a5d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260812 00:02:11.144245 23868 consensus_queue.cc:1035] T 00000000000000000000000000000000 P f8d9bea32edd4f1fbd437cddb7c4a5d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1917b175bf5f470494dba47305c7c669" member_type: NON_VOTER last_known_addr { host: "127.11.206.125" port: 46169 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260812 00:02:11.144837 23958 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 1917b175bf5f470494dba47305c7c669 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER fc02528e6aee4f539756717eea57931c (127.11.206.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "f8d9bea32edd4f1fbd437cddb7c4a5d0" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 40221 } } peers { permanent_uuid: "1917b175bf5f470494dba47305c7c669" member_type: NON_VOTER last_known_addr { host: "127.11.206.125" port: 46169 } attrs { promote: true } } peers { permanent_uuid: "fc02528e6aee4f539756717eea57931c" member_type: NON_VOTER last_known_addr { host: "127.11.206.124" port: 36719 } attrs { promote: true } } }
I20260812 00:02:11.146234 24008 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1917b175bf5f470494dba47305c7c669 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f8d9bea32edd4f1fbd437cddb7c4a5d0. Latest consensus state: current_term: 1 leader_uuid: "f8d9bea32edd4f1fbd437cddb7c4a5d0" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "f8d9bea32edd4f1fbd437cddb7c4a5d0" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 40221 } } peers { permanent_uuid: "1917b175bf5f470494dba47305c7c669" member_type: NON_VOTER last_known_addr { host: "127.11.206.125" port: 46169 } attrs { promote: true } } peers { permanent_uuid: "fc02528e6aee4f539756717eea57931c" member_type: NON_VOTER last_known_addr { host: "127.11.206.124" port: 36719 } attrs { promote: true } } }
I20260812 00:02:11.146337 24008 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1917b175bf5f470494dba47305c7c669 [sys.catalog]: This master's current role is: LEARNER
I20260812 00:02:11.146370 24008 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1917b175bf5f470494dba47305c7c669 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f8d9bea32edd4f1fbd437cddb7c4a5d0" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "f8d9bea32edd4f1fbd437cddb7c4a5d0" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 40221 } } peers { permanent_uuid: "1917b175bf5f470494dba47305c7c669" member_type: NON_VOTER last_known_addr { host: "127.11.206.125" port: 46169 } attrs { promote: true } } peers { permanent_uuid: "fc02528e6aee4f539756717eea57931c" member_type: NON_VOTER last_known_addr { host: "127.11.206.124" port: 36719 } attrs { promote: true } } }
I20260812 00:02:11.146416 24008 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1917b175bf5f470494dba47305c7c669 [sys.catalog]: This master's current role is: LEARNER
I20260812 00:02:11.146656 23868 raft_consensus.cc:1050] T 00000000000000000000000000000000 P f8d9bea32edd4f1fbd437cddb7c4a5d0: attempting to promote NON_VOTER 1917b175bf5f470494dba47305c7c669 to VOTER
I20260812 00:02:11.146863 23868 consensus_queue.cc:237] T 00000000000000000000000000000000 P f8d9bea32edd4f1fbd437cddb7c4a5d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "f8d9bea32edd4f1fbd437cddb7c4a5d0" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 40221 } } peers { permanent_uuid: "1917b175bf5f470494dba47305c7c669" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 46169 } attrs { promote: false } } peers { permanent_uuid: "fc02528e6aee4f539756717eea57931c" member_type: NON_VOTER last_known_addr { host: "127.11.206.124" port: 36719 } attrs { promote: true } }
I20260812 00:02:11.147511 23958 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 1917b175bf5f470494dba47305c7c669 [term 1 LEARNER]: Refusing update from remote peer f8d9bea32edd4f1fbd437cddb7c4a5d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260812 00:02:11.147610 23867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:11.147491 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.124:36719 (local address 127.0.0.1:37442)
0812 00:02:11.147537 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:11.147582 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.124:36719: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260812 00:02:11.147666 22838 consensus_peers.cc:487] T 00000000000000000000000000000000 P f8d9bea32edd4f1fbd437cddb7c4a5d0 -> Peer fc02528e6aee4f539756717eea57931c (127.11.206.124:36719): Couldn't send request to peer fc02528e6aee4f539756717eea57931c. Status: Network error: Client connection negotiation failed: client connection to 127.11.206.124:36719: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 00:02:11.147742 23871 consensus_queue.cc:1035] T 00000000000000000000000000000000 P f8d9bea32edd4f1fbd437cddb7c4a5d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1917b175bf5f470494dba47305c7c669" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 46169 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260812 00:02:11.148391 23871 raft_consensus.cc:2932] T 00000000000000000000000000000000 P f8d9bea32edd4f1fbd437cddb7c4a5d0 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 1917b175bf5f470494dba47305c7c669 (127.11.206.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "f8d9bea32edd4f1fbd437cddb7c4a5d0" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 40221 } } peers { permanent_uuid: "1917b175bf5f470494dba47305c7c669" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 46169 } attrs { promote: false } } peers { permanent_uuid: "fc02528e6aee4f539756717eea57931c" member_type: NON_VOTER last_known_addr { host: "127.11.206.124" port: 36719 } attrs { promote: true } } }
I20260812 00:02:11.149276 23871 sys_catalog.cc:455] T 00000000000000000000000000000000 P f8d9bea32edd4f1fbd437cddb7c4a5d0 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "f8d9bea32edd4f1fbd437cddb7c4a5d0" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "f8d9bea32edd4f1fbd437cddb7c4a5d0" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 40221 } } peers { permanent_uuid: "1917b175bf5f470494dba47305c7c669" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 46169 } attrs { promote: false } } peers { permanent_uuid: "fc02528e6aee4f539756717eea57931c" member_type: NON_VOTER last_known_addr { host: "127.11.206.124" port: 36719 } attrs { promote: true } } }
I20260812 00:02:11.149344 23871 sys_catalog.cc:458] T 00000000000000000000000000000000 P f8d9bea32edd4f1fbd437cddb7c4a5d0 [sys.catalog]: This master's current role is: LEADER
I20260812 00:02:11.149415 23871 sys_catalog.cc:455] T 00000000000000000000000000000000 P f8d9bea32edd4f1fbd437cddb7c4a5d0 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f8d9bea32edd4f1fbd437cddb7c4a5d0" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "f8d9bea32edd4f1fbd437cddb7c4a5d0" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 40221 } } peers { permanent_uuid: "1917b175bf5f470494dba47305c7c669" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 46169 } attrs { promote: false } } peers { permanent_uuid: "fc02528e6aee4f539756717eea57931c" member_type: NON_VOTER last_known_addr { host: "127.11.206.124" port: 36719 } attrs { promote: true } } }
I20260812 00:02:11.149456 23871 sys_catalog.cc:458] T 00000000000000000000000000000000 P f8d9bea32edd4f1fbd437cddb7c4a5d0 [sys.catalog]: This master's current role is: LEADER
I20260812 00:02:11.149745 23958 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 1917b175bf5f470494dba47305c7c669 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 1917b175bf5f470494dba47305c7c669 (127.11.206.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "f8d9bea32edd4f1fbd437cddb7c4a5d0" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 40221 } } peers { permanent_uuid: "1917b175bf5f470494dba47305c7c669" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 46169 } attrs { promote: false } } peers { permanent_uuid: "fc02528e6aee4f539756717eea57931c" member_type: NON_VOTER last_known_addr { host: "127.11.206.124" port: 36719 } attrs { promote: true } } }
I20260812 00:02:11.150832 24008 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1917b175bf5f470494dba47305c7c669 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f8d9bea32edd4f1fbd437cddb7c4a5d0" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "f8d9bea32edd4f1fbd437cddb7c4a5d0" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 40221 } } peers { permanent_uuid: "1917b175bf5f470494dba47305c7c669" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 46169 } attrs { promote: false } } peers { permanent_uuid: "fc02528e6aee4f539756717eea57931c" member_type: NON_VOTER last_known_addr { host: "127.11.206.124" port: 36719 } attrs { promote: true } } }
I20260812 00:02:11.150918 24008 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1917b175bf5f470494dba47305c7c669 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:02:11.159755 24039 master.cc:552] Master@127.11.206.124:36719 shutdown complete.
I20260812 00:02:11.159823 24039 master_runner.cc:305] Clearing existing system tablet
I20260812 00:02:11.159951 24039 fs_manager.cc:359] Metadata directory not provided
I20260812 00:02:11.159998 24039 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:02:11.160763 24039 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:02:11.161293 24223 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:11.161513 24039 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:02:11.161584 24039 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260812 00:02:11.161612 24039 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/master-2/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/master-2/wal
uuid: "fc02528e6aee4f539756717eea57931c"
format_stamp: "Formatted at 2026-08-12 00:02:11 on dist-test-slave-f0tn"
server_key: "19b9f80c776d6c005d97156c6014c960"
server_key_iv: "877f814e027b420173e7f4738a2700b8"
server_key_version: "encryptionkey@0"
I20260812 00:02:11.162436 24039 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P fc02528e6aee4f539756717eea57931c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:02:11.163926 24039 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P fc02528e6aee4f539756717eea57931c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260812 00:02:11.164005 24039 log.cc:1196] T 00000000000000000000000000000000 P fc02528e6aee4f539756717eea57931c: Deleting WAL directory at /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260812 00:02:11.164222 24039 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P fc02528e6aee4f539756717eea57931c: Deleting consensus metadata
I20260812 00:02:11.164352 24039 master_runner.cc:315] Copying system tablet from 127.11.206.126:40221
I20260812 00:02:11.164996 24039 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P fc02528e6aee4f539756717eea57931c: tablet copy: Beginning tablet copy session from remote peer at address 127.11.206.126:40221
I20260812 00:02:11.176817 22934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:11.165440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32956 (local address 127.11.206.126:40221)
0812 00:02:11.165492 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:11.165494 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:11.169648 (+ 4154us) server_negotiation.cc:407] Connection header received
0812 00:02:11.169717 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:11.169719 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:11.169733 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:11.169805 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:11.170241 (+ 436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.170993 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.172068 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.172378 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.172450 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:11.173694 (+ 1244us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:11.173696 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:11.173697 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:11.173706 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:11.175526 (+ 1820us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:11.175943 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:11.175944 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:11.175945 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:11.176010 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:11.176247 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:11.176248 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:11.176248 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:11.176391 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:11.176455 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:11.176637 (+ 182us) server_negotiation.cc:299] Negotiation successful
0812 00:02:11.176718 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260812 00:02:11.176832 24235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:11.165339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:40221 (local address 127.0.0.1:32956)
0812 00:02:11.169535 (+ 4196us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:11.169550 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:11.169645 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:11.169824 (+ 179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:11.169825 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:11.170057 (+ 232us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:11.170125 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:11.170128 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.171115 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.171116 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:11.171970 (+ 854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:11.171973 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.172476 (+ 503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.172477 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:11.172547 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:11.173101 (+ 554us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:11.173106 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:11.173594 (+ 488us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:02:11.175624 (+ 2030us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:11.175625 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:11.175626 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:11.175859 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:11.176082 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:11.176083 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:11.176083 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:11.176181 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:11.176468 (+ 287us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:02:11.176469 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:02:11.176525 (+ 56us) client_negotiation.cc:769] Sending connection context
0812 00:02:11.176602 (+ 77us) client_negotiation.cc:240] Negotiation successful
0812 00:02:11.176724 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4166,"thread_start_us":87,"threads_started":1}
I20260812 00:02:11.177620 22893 tablet_copy_service.cc:140] P f8d9bea32edd4f1fbd437cddb7c4a5d0: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer fc02528e6aee4f539756717eea57931c ({username='oryx', principal='oryx/127.11.206.124@KRBTEST.COM'} at 127.0.0.1:32956)
I20260812 00:02:11.177690 22893 tablet_copy_service.cc:161] P f8d9bea32edd4f1fbd437cddb7c4a5d0: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer fc02528e6aee4f539756717eea57931c at {username='oryx', principal='oryx/127.11.206.124@KRBTEST.COM'} at 127.0.0.1:32956: session id = fc02528e6aee4f539756717eea57931c-00000000000000000000000000000000
I20260812 00:02:11.178263 22893 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P f8d9bea32edd4f1fbd437cddb7c4a5d0: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 00:02:11.178834 24039 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260812 00:02:11.180354 24039 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P fc02528e6aee4f539756717eea57931c: tablet copy: Starting download of 0 data blocks...
I20260812 00:02:11.180542 24039 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P fc02528e6aee4f539756717eea57931c: tablet copy: Starting download of 1 WAL segments...
I20260812 00:02:11.181264 24039 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P fc02528e6aee4f539756717eea57931c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 00:02:11.182308 22893 tablet_copy_service.cc:342] P f8d9bea32edd4f1fbd437cddb7c4a5d0: Request end of tablet copy session fc02528e6aee4f539756717eea57931c-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.11.206.124@KRBTEST.COM'} at 127.0.0.1:32956
I20260812 00:02:11.182363 22893 tablet_copy_service.cc:433] P f8d9bea32edd4f1fbd437cddb7c4a5d0: ending tablet copy session fc02528e6aee4f539756717eea57931c-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer fc02528e6aee4f539756717eea57931c
I20260812 00:02:11.185348 24039 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:02:11.186697 24236 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:11.187011 24241 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:11.189540 24237 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:11.190330 24039 server_base.cc:1034] running on GCE node
I20260812 00:02:11.190467 24039 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:02:11.190621 24039 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:02:11.191768 24039 hybrid_clock.cc:648] HybridClock initialized: now 1786492931191750 us; error 30 us; skew 500 ppm
Aug 12 00:02:11 dist-test-slave-f0tn krb5kdc[22784](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492931, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.206.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:02:11.193267 24039 init.cc:377] Logged in from keytab as oryx/127.11.206.124@KRBTEST.COM (short username oryx)
I20260812 00:02:11.193562 24039 webserver.cc:460] Webserver started at http://127.11.206.124:39997/ using document root <none> and password file <none>
I20260812 00:02:11.193688 24039 fs_manager.cc:359] Metadata directory not provided
I20260812 00:02:11.193722 24039 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:02:11.194437 24039 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.001s
I20260812 00:02:11.195019 24252 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:11.195185 24039 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 00:02:11.195238 24039 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/master-2/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/master-2/wal
uuid: "fc02528e6aee4f539756717eea57931c"
format_stamp: "Formatted at 2026-08-12 00:02:11 on dist-test-slave-f0tn"
server_key: "19b9f80c776d6c005d97156c6014c960"
server_key_iv: "877f814e027b420173e7f4738a2700b8"
server_key_version: "encryptionkey@0"
I20260812 00:02:11.195298 24039 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:02:11.206718 24039 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:02:11.208545 24039 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:02:11.211812 24039 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.124:36719
I20260812 00:02:11.212167 24039 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/master-2/data/info.pb
I20260812 00:02:11.212445 24354 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.124:36719 every 8 connection(s)
I20260812 00:02:11.214216 24356 sys_catalog.cc:263] Verifying existing consensus state
I20260812 00:02:11.214737 24356 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc02528e6aee4f539756717eea57931c: Bootstrap starting.
I20260812 00:02:11.217898 24356 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc02528e6aee4f539756717eea57931c: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 00:02:11.218120 24356 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc02528e6aee4f539756717eea57931c: Bootstrap complete.
I20260812 00:02:11.218348 24356 raft_consensus.cc:348] T 00000000000000000000000000000000 P fc02528e6aee4f539756717eea57931c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "f8d9bea32edd4f1fbd437cddb7c4a5d0" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 40221 } } peers { permanent_uuid: "1917b175bf5f470494dba47305c7c669" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 46169 } attrs { promote: false } } peers { permanent_uuid: "fc02528e6aee4f539756717eea57931c" member_type: NON_VOTER last_known_addr { host: "127.11.206.124" port: 36719 } attrs { promote: true } }
I20260812 00:02:11.218448 24356 raft_consensus.cc:729] T 00000000000000000000000000000000 P fc02528e6aee4f539756717eea57931c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: fc02528e6aee4f539756717eea57931c, State: Initialized, Role: LEARNER
I20260812 00:02:11.218488 24356 consensus_queue.cc:260] T 00000000000000000000000000000000 P fc02528e6aee4f539756717eea57931c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "f8d9bea32edd4f1fbd437cddb7c4a5d0" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 40221 } } peers { permanent_uuid: "1917b175bf5f470494dba47305c7c669" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 46169 } attrs { promote: false } } peers { permanent_uuid: "fc02528e6aee4f539756717eea57931c" member_type: NON_VOTER last_known_addr { host: "127.11.206.124" port: 36719 } attrs { promote: true } }
I20260812 00:02:11.218688 24356 sys_catalog.cc:564] T 00000000000000000000000000000000 P fc02528e6aee4f539756717eea57931c [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:02:11.218712 24361 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc02528e6aee4f539756717eea57931c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "f8d9bea32edd4f1fbd437cddb7c4a5d0" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 40221 } } peers { permanent_uuid: "1917b175bf5f470494dba47305c7c669" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 46169 } attrs { promote: false } } peers { permanent_uuid: "fc02528e6aee4f539756717eea57931c" member_type: NON_VOTER last_known_addr { host: "127.11.206.124" port: 36719 } attrs { promote: true } } }
I20260812 00:02:11.218935 24361 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc02528e6aee4f539756717eea57931c [sys.catalog]: This master's current role is: LEARNER
I20260812 00:02:11.220336 24380 catalog_manager.cc:1259] Loaded cluster ID: 8e5c799ca7af493c8cb9aab24be43514
I20260812 00:02:11.220553 24380 catalog_manager.cc:1552] T 00000000000000000000000000000000 P fc02528e6aee4f539756717eea57931c: loading cluster ID for follower catalog manager: success
I20260812 00:02:11.221966 24380 catalog_manager.cc:1574] T 00000000000000000000000000000000 P fc02528e6aee4f539756717eea57931c: acquiring CA information for follower catalog manager: success
I20260812 00:02:11.222285 24380 catalog_manager.cc:1602] T 00000000000000000000000000000000 P fc02528e6aee4f539756717eea57931c: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260812 00:02:11.231388 24215 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:02:11.231616 24215 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:02:11.231652 24215 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:02:11.232928 24215 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:02:11.232975 24215 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:02:11.233011 24215 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.65
I20260812 00:02:11.234687 24215 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:37943
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/krb5kdc/oryx_127.11.206.65.keytab
--principal=oryx/127.11.206.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.65:45231
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.206.65
--webserver_port=35221
--tserver_master_addrs=127.11.206.126:40221,127.11.206.125:46169,127.11.206.124:36719
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24215
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.65
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:02:11.234936 24215 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:02:11.235167 24215 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:02:11.241652 24399 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:11.241679 24392 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:11.241748 24393 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:11.241928 24215 server_base.cc:1034] running on GCE node
I20260812 00:02:11.242238 24215 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:02:11.242494 24215 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:02:11.243639 24215 hybrid_clock.cc:648] HybridClock initialized: now 1786492931243629 us; error 28 us; skew 500 ppm
Aug 12 00:02:11 dist-test-slave-f0tn krb5kdc[22784](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492931, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.206.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:02:11.246196 24215 init.cc:377] Logged in from keytab as oryx/127.11.206.65@KRBTEST.COM (short username oryx)
I20260812 00:02:11.246632 24215 webserver.cc:460] Webserver started at http://127.11.206.65:35221/ using document root <none> and password file <none>
I20260812 00:02:11.246843 24215 fs_manager.cc:359] Metadata directory not provided
I20260812 00:02:11.246910 24215 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:02:11.248370 24215 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 00:02:11.248998 24411 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:11.249161 24215 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 00:02:11.249244 24215 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-0/wal
uuid: "d91daca07bd94d6fb77661eb0190366e"
format_stamp: "Formatted at 2026-08-12 00:02:10 on dist-test-slave-f0tn"
server_key: "b391413660727fad257448d5876da484"
server_key_iv: "cecc22b19ce7034aa1c0110a0b21f23b"
server_key_version: "encryptionkey@0"
I20260812 00:02:11.249711 24215 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:02:11.261605 24215 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:02:11.263533 24215 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:02:11.263686 24215 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:02:11.263931 24215 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:02:11.264240 24215 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:02:11.264273 24215 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:11.264302 24215 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:02:11.264320 24215 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:11.274508 24215 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.65:45231
I20260812 00:02:11.274663 24632 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.65:45231 every 8 connection(s)
I20260812 00:02:11.274972 24215 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
I20260812 00:02:11.282964 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 24215
I20260812 00:02:11.283135 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 23206
Aug 12 00:02:11 dist-test-slave-f0tn krb5kdc[22784](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492931, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.206.65@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM
Aug 12 00:02:11 dist-test-slave-f0tn krb5kdc[22784](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492931, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.206.65@KRBTEST.COM for oryx/127.11.206.125@KRBTEST.COM
Aug 12 00:02:11 dist-test-slave-f0tn krb5kdc[22784](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492931, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.206.65@KRBTEST.COM for oryx/127.11.206.124@KRBTEST.COM
I20260812 00:02:11.288444 22934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:11.275813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.65:40541 (local address 127.11.206.126:40221)
0812 00:02:11.275867 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:11.275869 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:11.276128 (+ 259us) server_negotiation.cc:407] Connection header received
0812 00:02:11.277547 (+ 1419us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:11.277549 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:11.277562 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:11.277594 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:11.279473 (+ 1879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.280033 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.280932 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.281215 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.281283 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:11.285282 (+ 3999us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:11.285284 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:11.285284 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:11.285292 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:11.287105 (+ 1813us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:11.287488 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:11.287489 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:11.287490 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:11.287549 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:11.287795 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:11.287796 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:11.287796 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:11.287915 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:11.287971 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:11.288265 (+ 294us) server_negotiation.cc:299] Negotiation successful
0812 00:02:11.288354 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 00:02:11.288663 24643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:11.275764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:40221 (local address 127.11.206.65:40541)
0812 00:02:11.275989 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:11.276037 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:11.277422 (+ 1385us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:11.277685 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:11.277688 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:11.278113 (+ 425us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:11.278468 (+ 355us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:11.278474 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.280115 (+ 1641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.280116 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:11.280841 (+ 725us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:11.280843 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.281289 (+ 446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.281290 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:11.281462 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:11.282050 (+ 588us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:11.282060 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:11.284692 (+ 2632us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:02:11.287187 (+ 2495us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:11.287194 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:11.287197 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:11.287416 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:11.287608 (+ 192us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:11.287608 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:11.287609 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:11.287735 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:11.287972 (+ 237us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:02:11.287979 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:02:11.288121 (+ 142us) client_negotiation.cc:769] Sending connection context
0812 00:02:11.288213 (+ 92us) client_negotiation.cc:240] Negotiation successful
0812 00:02:11.288383 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181,"mutex_wait_us":36,"thread_start_us":90,"threads_started":1}
I20260812 00:02:11.289237 24634 heartbeater.cc:347] Connected to a master server at 127.11.206.126:40221
I20260812 00:02:11.289328 24634 heartbeater.cc:464] Registering TS with master...
I20260812 00:02:11.289532 24634 heartbeater.cc:511] Master 127.11.206.126:40221 requested a full tablet report, sending...
I20260812 00:02:11.289952 22864 ts_manager.cc:194] Re-registered known tserver with Master: d91daca07bd94d6fb77661eb0190366e (127.11.206.65:45231)
I20260812 00:02:11.290288 22864 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.206.65@KRBTEST.COM'} at 127.11.206.65:40541
I20260812 00:02:11.301221 24016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:11.276323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.65:42851 (local address 127.11.206.125:46169)
0812 00:02:11.276370 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:11.276372 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:11.276449 (+ 77us) server_negotiation.cc:407] Connection header received
0812 00:02:11.277560 (+ 1111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:11.277561 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:11.277572 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:11.277601 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:11.278589 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.279371 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.280985 (+ 1614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.281286 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.281347 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:11.298303 (+ 16956us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:11.298306 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:11.298306 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:11.298316 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:11.299957 (+ 1641us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:11.300396 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:11.300397 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:11.300398 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:11.300465 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:11.300670 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:11.300671 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:11.300671 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:11.300824 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:11.300887 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:11.301045 (+ 158us) server_negotiation.cc:299] Negotiation successful
0812 00:02:11.301133 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 00:02:11.301312 24649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:11.276174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.125:46169 (local address 127.11.206.65:42851)
0812 00:02:11.276373 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:11.276383 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:11.277426 (+ 1043us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:11.277696 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:11.277697 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:11.278116 (+ 419us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:11.278468 (+ 352us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:11.278474 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.279517 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.279518 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:11.280845 (+ 1327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:11.280848 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.281359 (+ 511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.281360 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:11.281462 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:11.282066 (+ 604us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:11.282070 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:11.284981 (+ 2911us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:02:11.300072 (+ 15091us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:11.300074 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:11.300075 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:11.300303 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:11.300540 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:11.300541 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:11.300541 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:11.300606 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:11.300891 (+ 285us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:02:11.300892 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:02:11.300946 (+ 54us) client_negotiation.cc:769] Sending connection context
0812 00:02:11.301016 (+ 70us) client_negotiation.cc:240] Negotiation successful
0812 00:02:11.301133 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"mutex_wait_us":9,"thread_start_us":124,"threads_started":1}
I20260812 00:02:11.301599 24648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:11.275764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.124:36719 (local address 127.11.206.65:53117)
0812 00:02:11.276047 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:11.276059 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:11.277420 (+ 1361us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:11.277684 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:11.277688 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:11.278112 (+ 424us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:11.278467 (+ 355us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:11.278472 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.279721 (+ 1249us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.279722 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:11.280845 (+ 1123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:11.280848 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.282050 (+ 1202us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.282051 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:11.282142 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:11.282503 (+ 361us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:11.282507 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:11.285186 (+ 2679us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:02:11.300417 (+ 15231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:11.300418 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:11.300418 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:11.300704 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:11.300921 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:11.300922 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:11.300923 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:11.300979 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:11.301246 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:02:11.301247 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:02:11.301288 (+ 41us) client_negotiation.cc:769] Sending connection context
0812 00:02:11.301355 (+ 67us) client_negotiation.cc:240] Negotiation successful
0812 00:02:11.301498 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":249,"mutex_wait_us":111,"thread_start_us":137,"threads_started":1}
I20260812 00:02:11.301898 24647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:11.275837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.65:53117 (local address 127.11.206.124:36719)
0812 00:02:11.275959 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:11.275961 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:11.276137 (+ 176us) server_negotiation.cc:407] Connection header received
0812 00:02:11.277522 (+ 1385us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:11.277523 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:11.277538 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:11.277592 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:11.278605 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.279631 (+ 1026us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.281415 (+ 1784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.281625 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.281684 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:11.298679 (+ 16995us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:11.298681 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:11.298681 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:11.298691 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:11.300332 (+ 1641us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:11.300792 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:11.300793 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:11.300794 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:11.300855 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:11.301042 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:11.301043 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:11.301043 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:11.301165 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:11.301221 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:11.301708 (+ 487us) server_negotiation.cc:299] Negotiation successful
0812 00:02:11.301833 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99,"thread_start_us":65,"threads_started":1}
I20260812 00:02:11.302304 24633 heartbeater.cc:347] Connected to a master server at 127.11.206.124:36719
I20260812 00:02:11.302368 24633 heartbeater.cc:464] Registering TS with master...
I20260812 00:02:11.302474 24633 heartbeater.cc:511] Master 127.11.206.124:36719 requested a full tablet report, sending...
I20260812 00:02:11.302497 24637 heartbeater.cc:347] Connected to a master server at 127.11.206.125:46169
I20260812 00:02:11.302529 24637 heartbeater.cc:464] Registering TS with master...
I20260812 00:02:11.302574 24637 heartbeater.cc:511] Master 127.11.206.125:46169 requested a full tablet report, sending...
I20260812 00:02:11.302783 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.66:32883
--local_ip_for_outbound_sockets=127.11.206.66
--tserver_master_addrs=127.11.206.126:40221
--webserver_port=46585
--webserver_interface=127.11.206.66
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/krb5kdc/oryx_127.11.206.66.keytab
--principal=oryx/127.11.206.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:37943
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.11.206.126:40221,127.11.206.125:46169
--tserver_master_addrs=127.11.206.126:40221,127.11.206.125:46169,127.11.206.124:36719 with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:02:11.302894 24298 ts_manager.cc:194] Registered new tserver with Master: d91daca07bd94d6fb77661eb0190366e (127.11.206.65:45231)
I20260812 00:02:11.302994 23937 ts_manager.cc:194] Registered new tserver with Master: d91daca07bd94d6fb77661eb0190366e (127.11.206.65:45231)
W20260812 00:02:11.385285 24650 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:02:11.385529 24650 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:02:11.385563 24650 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:02:11.386673 24650 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:02:11.386713 24650 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:02:11.386749 24650 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.66
I20260812 00:02:11.388204 24650 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:37943
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/krb5kdc/oryx_127.11.206.66.keytab
--principal=oryx/127.11.206.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.66:32883
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.206.66
--webserver_port=46585
--tserver_master_addrs=127.11.206.126:40221,127.11.206.125:46169,127.11.206.124:36719
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24650
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.66
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:02:11.388449 24650 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:02:11.388666 24650 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:02:11.394017 24660 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:11.394039 24674 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:11.394057 24664 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:11.394088 24650 server_base.cc:1034] running on GCE node
I20260812 00:02:11.394423 24650 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:02:11.394651 24650 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:02:11.395802 24650 hybrid_clock.cc:648] HybridClock initialized: now 1786492931395785 us; error 28 us; skew 500 ppm
Aug 12 00:02:11 dist-test-slave-f0tn krb5kdc[22784](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492931, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.206.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:02:11.398324 24650 init.cc:377] Logged in from keytab as oryx/127.11.206.66@KRBTEST.COM (short username oryx)
I20260812 00:02:11.398761 24650 webserver.cc:460] Webserver started at http://127.11.206.66:46585/ using document root <none> and password file <none>
I20260812 00:02:11.398970 24650 fs_manager.cc:359] Metadata directory not provided
I20260812 00:02:11.399034 24650 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:02:11.400313 24650 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 00:02:11.400864 24684 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:11.401021 24650 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 00:02:11.401103 24650 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-1/wal
uuid: "b4bdd64c3f904386ad369366b7824e03"
format_stamp: "Formatted at 2026-08-12 00:02:10 on dist-test-slave-f0tn"
server_key: "e3db45cea8b83ea34b00be6af9b751b6"
server_key_iv: "ccc4e1500a5223ab83a39b56b3dd1b8f"
server_key_version: "encryptionkey@0"
I20260812 00:02:11.401464 24650 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:02:11.419649 24650 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:02:11.421525 24650 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:02:11.421644 24650 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:02:11.421867 24650 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:02:11.422159 24650 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:02:11.422196 24650 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:11.422235 24650 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:02:11.422258 24650 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:11.427645 24650 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.66:32883
I20260812 00:02:11.428012 24882 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.66:32883 every 8 connection(s)
I20260812 00:02:11.428154 24650 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
Aug 12 00:02:11 dist-test-slave-f0tn krb5kdc[22784](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492931, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.206.66@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM
Aug 12 00:02:11 dist-test-slave-f0tn krb5kdc[22784](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492931, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.206.66@KRBTEST.COM for oryx/127.11.206.124@KRBTEST.COM
Aug 12 00:02:11 dist-test-slave-f0tn krb5kdc[22784](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492931, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.206.66@KRBTEST.COM for oryx/127.11.206.125@KRBTEST.COM
I20260812 00:02:11.437994 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 24650
I20260812 00:02:11.438149 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 23463
I20260812 00:02:11.444305 22934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:11.429332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.66:56947 (local address 127.11.206.126:40221)
0812 00:02:11.429373 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:11.429395 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:11.429614 (+ 219us) server_negotiation.cc:407] Connection header received
0812 00:02:11.430159 (+ 545us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:11.430160 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:11.430173 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:11.430203 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:11.431418 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.431942 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.433406 (+ 1464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.433674 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.433733 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:11.436988 (+ 3255us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:11.436990 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:11.436990 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:11.436997 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:11.438547 (+ 1550us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:11.443464 (+ 4917us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:11.443465 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:11.443465 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:11.443526 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:11.443750 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:11.443751 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:11.443751 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:11.443859 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:11.443892 (+ 33us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:11.444157 (+ 265us) server_negotiation.cc:299] Negotiation successful
0812 00:02:11.444226 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 00:02:11.444790 24892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:11.429028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:40221 (local address 127.11.206.66:56947)
0812 00:02:11.429487 (+ 459us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:11.429496 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:11.430050 (+ 554us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:11.430646 (+ 596us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:11.430647 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:11.431003 (+ 356us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:11.431304 (+ 301us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:11.431311 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.432142 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.432143 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:11.433298 (+ 1155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:11.433301 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.433783 (+ 482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.433784 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:11.433837 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:11.434421 (+ 584us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:11.434431 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:11.436887 (+ 2456us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:02:11.443076 (+ 6189us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:11.443085 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:11.443088 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:11.443378 (+ 290us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:11.443582 (+ 204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:11.443583 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:11.443583 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:11.443691 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:11.443925 (+ 234us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:02:11.443930 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:02:11.444051 (+ 121us) client_negotiation.cc:769] Sending connection context
0812 00:02:11.444419 (+ 368us) client_negotiation.cc:240] Negotiation successful
0812 00:02:11.444583 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":286,"mutex_wait_us":56,"thread_start_us":88,"threads_started":1}
I20260812 00:02:11.446884 24647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:11.429527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.66:52075 (local address 127.11.206.124:36719)
0812 00:02:11.430801 (+ 1274us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:11.430804 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:11.430814 (+ 10us) server_negotiation.cc:407] Connection header received
0812 00:02:11.430838 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:11.430839 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:11.430854 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:11.430913 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:11.431500 (+ 587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.432232 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.433240 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.433543 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.433602 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:11.436556 (+ 2954us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:11.436558 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:11.436558 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:11.436567 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:11.438320 (+ 1753us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:11.445959 (+ 7639us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:11.445961 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:11.445961 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:11.446018 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:11.446191 (+ 173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:11.446192 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:11.446193 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:11.446311 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:11.446369 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:11.446683 (+ 314us) server_negotiation.cc:299] Negotiation successful
0812 00:02:11.446778 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1245}
I20260812 00:02:11.446880 24894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:11.429343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.124:36719 (local address 127.11.206.66:52075)
0812 00:02:11.429464 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:11.429486 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:11.430036 (+ 550us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:11.431200 (+ 1164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:11.431200 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:11.431353 (+ 153us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:11.431408 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:11.431410 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.432292 (+ 882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.432293 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:11.433151 (+ 858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:11.433153 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.433669 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.433670 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:11.433836 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:11.434601 (+ 765us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:11.434606 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:11.436455 (+ 1849us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:02:11.445715 (+ 9260us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:11.445716 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:11.445716 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:11.445875 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:11.446081 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:11.446081 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:11.446082 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:11.446137 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:11.446373 (+ 236us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:02:11.446374 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:02:11.446417 (+ 43us) client_negotiation.cc:769] Sending connection context
0812 00:02:11.446637 (+ 220us) client_negotiation.cc:240] Negotiation successful
0812 00:02:11.446741 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105,"mutex_wait_us":27,"thread_start_us":81,"threads_started":1}
I20260812 00:02:11.451136 24883 heartbeater.cc:347] Connected to a master server at 127.11.206.124:36719
I20260812 00:02:11.451265 24883 heartbeater.cc:464] Registering TS with master...
I20260812 00:02:11.451538 24883 heartbeater.cc:511] Master 127.11.206.124:36719 requested a full tablet report, sending...
I20260812 00:02:11.452023 24298 ts_manager.cc:194] Registered new tserver with Master: b4bdd64c3f904386ad369366b7824e03 (127.11.206.66:32883)
I20260812 00:02:11.453239 24888 heartbeater.cc:347] Connected to a master server at 127.11.206.126:40221
I20260812 00:02:11.453293 24888 heartbeater.cc:464] Registering TS with master...
I20260812 00:02:11.453356 24888 heartbeater.cc:511] Master 127.11.206.126:40221 requested a full tablet report, sending...
I20260812 00:02:11.453933 22864 ts_manager.cc:194] Re-registered known tserver with Master: b4bdd64c3f904386ad369366b7824e03 (127.11.206.66:32883)
I20260812 00:02:11.454398 22864 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.206.66@KRBTEST.COM'} at 127.11.206.66:56947
I20260812 00:02:11.455299 24016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:11.429155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.66:60287 (local address 127.11.206.125:46169)
0812 00:02:11.429228 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:11.429230 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:11.429708 (+ 478us) server_negotiation.cc:407] Connection header received
0812 00:02:11.430230 (+ 522us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:11.430233 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:11.430247 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:11.430300 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:11.431390 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.432165 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.433465 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.433656 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.433707 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:11.436989 (+ 3282us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:11.436990 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:11.436990 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:11.436998 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:11.453688 (+ 16690us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:11.454156 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:11.454158 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:11.454158 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:11.454220 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:11.454419 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:11.454420 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:11.454420 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:11.454551 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:11.454598 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:11.455151 (+ 553us) server_negotiation.cc:299] Negotiation successful
0812 00:02:11.455223 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 00:02:11.455602 24893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:11.429028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.125:46169 (local address 127.11.206.66:60287)
0812 00:02:11.429424 (+ 396us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:11.429635 (+ 211us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:11.430049 (+ 414us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:11.430431 (+ 382us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:11.430437 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:11.431018 (+ 581us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:11.431302 (+ 284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:11.431308 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.432261 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.432262 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:11.433366 (+ 1104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:11.433368 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.433720 (+ 352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.433721 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:11.433832 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:11.434420 (+ 588us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:11.434430 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:11.436890 (+ 2460us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:02:11.453768 (+ 16878us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:11.453769 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:11.453769 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:11.454068 (+ 299us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:11.454299 (+ 231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:11.454299 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:11.454300 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:11.454356 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:11.454647 (+ 291us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:02:11.454648 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:02:11.454692 (+ 44us) client_negotiation.cc:769] Sending connection context
0812 00:02:11.455372 (+ 680us) client_negotiation.cc:240] Negotiation successful
0812 00:02:11.455493 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":367,"mutex_wait_us":150,"thread_start_us":67,"threads_started":1}
I20260812 00:02:11.456125 24889 heartbeater.cc:347] Connected to a master server at 127.11.206.125:46169
I20260812 00:02:11.456167 24889 heartbeater.cc:464] Registering TS with master...
I20260812 00:02:11.456224 24889 heartbeater.cc:511] Master 127.11.206.125:46169 requested a full tablet report, sending...
I20260812 00:02:11.456555 23937 ts_manager.cc:194] Registered new tserver with Master: b4bdd64c3f904386ad369366b7824e03 (127.11.206.66:32883)
I20260812 00:02:11.457340 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.67:43193
--local_ip_for_outbound_sockets=127.11.206.67
--tserver_master_addrs=127.11.206.126:40221
--webserver_port=41349
--webserver_interface=127.11.206.67
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/krb5kdc/oryx_127.11.206.67.keytab
--principal=oryx/127.11.206.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:37943
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.11.206.126:40221,127.11.206.125:46169
--tserver_master_addrs=127.11.206.126:40221,127.11.206.125:46169,127.11.206.124:36719 with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:02:11.541360 24895 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:02:11.541599 24895 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:02:11.541630 24895 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:02:11.542806 24895 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:02:11.542850 24895 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:02:11.542884 24895 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.67
I20260812 00:02:11.544354 24895 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:37943
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/krb5kdc/oryx_127.11.206.67.keytab
--principal=oryx/127.11.206.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.67:43193
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.206.67
--webserver_port=41349
--tserver_master_addrs=127.11.206.126:40221,127.11.206.125:46169,127.11.206.124:36719
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24895
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.67
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:02:11.544587 24895 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:02:11.544812 24895 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:02:11.549922 24910 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:11.549949 24906 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:11.549990 24905 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:11.550026 24895 server_base.cc:1034] running on GCE node
I20260812 00:02:11.550304 24895 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:02:11.550501 24895 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:02:11.551658 24895 hybrid_clock.cc:648] HybridClock initialized: now 1786492931551644 us; error 29 us; skew 500 ppm
Aug 12 00:02:11 dist-test-slave-f0tn krb5kdc[22784](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492931, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.206.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:02:11.554235 24895 init.cc:377] Logged in from keytab as oryx/127.11.206.67@KRBTEST.COM (short username oryx)
I20260812 00:02:11.554625 24895 webserver.cc:460] Webserver started at http://127.11.206.67:41349/ using document root <none> and password file <none>
I20260812 00:02:11.554843 24895 fs_manager.cc:359] Metadata directory not provided
I20260812 00:02:11.554903 24895 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:02:11.556177 24895 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:02:11.556690 24931 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:11.556845 24895 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:02:11.556918 24895 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-2/wal
uuid: "39630eacbe4b41bbb157bb7b8d99c4f4"
format_stamp: "Formatted at 2026-08-12 00:02:10 on dist-test-slave-f0tn"
server_key: "58fc0567fd6bb3b614508c15219e1b0f"
server_key_iv: "7390af7937daafa71df22b89ce890052"
server_key_version: "encryptionkey@0"
I20260812 00:02:11.557245 24895 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:02:11.585788 24895 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:02:11.587589 24895 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:02:11.587721 24895 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:02:11.587954 24895 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:02:11.588284 24895 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:02:11.588320 24895 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:11.588348 24895 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:02:11.588366 24895 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:11.593879 24895 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.67:43193
I20260812 00:02:11.593945 25126 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.67:43193 every 8 connection(s)
I20260812 00:02:11.594281 24895 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
Aug 12 00:02:11 dist-test-slave-f0tn krb5kdc[22784](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492931, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.206.67@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM
Aug 12 00:02:11 dist-test-slave-f0tn krb5kdc[22784](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492931, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.206.67@KRBTEST.COM for oryx/127.11.206.125@KRBTEST.COM
Aug 12 00:02:11 dist-test-slave-f0tn krb5kdc[22784](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492931, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.206.67@KRBTEST.COM for oryx/127.11.206.124@KRBTEST.COM
I20260812 00:02:11.602635 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 24895
I20260812 00:02:11.605942 24016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:11.595025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.67:43933 (local address 127.11.206.125:46169)
0812 00:02:11.595466 (+ 441us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:11.595468 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:11.595539 (+ 71us) server_negotiation.cc:407] Connection header received
0812 00:02:11.595950 (+ 411us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:11.595952 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:11.595963 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:11.596011 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:11.596770 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.597559 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.599654 (+ 2095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.599954 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.600014 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:11.602334 (+ 2320us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:11.602336 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:11.602336 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:11.602345 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:11.604087 (+ 1742us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:11.604637 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:11.604639 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:11.604639 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:11.604697 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:11.605003 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:11.605004 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:11.605004 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:11.605138 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:11.605178 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:11.605746 (+ 568us) server_negotiation.cc:299] Negotiation successful
0812 00:02:11.605832 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":410}
I20260812 00:02:11.606236 25133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:11.595343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.124:36719 (local address 127.11.206.67:42369)
0812 00:02:11.595643 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:11.595651 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:11.595961 (+ 310us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:11.596103 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:11.596110 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:11.596478 (+ 368us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:11.596674 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:11.596682 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.597634 (+ 952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.597635 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:11.598722 (+ 1087us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:11.598725 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.599267 (+ 542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.599268 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:11.599370 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:11.599864 (+ 494us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:11.599873 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:11.602739 (+ 2866us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:02:11.604896 (+ 2157us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:11.604897 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:11.604898 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:11.605098 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:11.605323 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:11.605323 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:11.605324 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:11.605409 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:11.605702 (+ 293us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:02:11.605702 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:02:11.605737 (+ 35us) client_negotiation.cc:769] Sending connection context
0812 00:02:11.605803 (+ 66us) client_negotiation.cc:240] Negotiation successful
0812 00:02:11.605976 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":287,"mutex_wait_us":30,"thread_start_us":59,"threads_started":1}
I20260812 00:02:11.606564 24647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:11.595427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.67:42369 (local address 127.11.206.124:36719)
0812 00:02:11.595477 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:11.595479 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:11.595723 (+ 244us) server_negotiation.cc:407] Connection header received
0812 00:02:11.596031 (+ 308us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:11.596032 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:11.596044 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:11.596095 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:11.596797 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.597558 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.598819 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.599148 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.599206 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:11.602832 (+ 3626us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:11.602833 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:11.602834 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:11.602841 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:11.604807 (+ 1966us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:11.605192 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:11.605193 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:11.605194 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:11.605258 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:11.605487 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:11.605488 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:11.605488 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:11.605615 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:11.605677 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:11.606386 (+ 709us) server_negotiation.cc:299] Negotiation successful
0812 00:02:11.606467 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260812 00:02:11.606681 25135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:11.595030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.125:46169 (local address 127.11.206.67:43933)
0812 00:02:11.595482 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:11.595491 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:11.595852 (+ 361us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:11.596101 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:11.596105 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:11.596441 (+ 336us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:11.596673 (+ 232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:11.596678 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.598825 (+ 2147us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.598826 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:11.599575 (+ 749us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:11.599578 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.600068 (+ 490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.600069 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:11.600116 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:11.600447 (+ 331us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:11.600451 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:11.602255 (+ 1804us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:02:11.604204 (+ 1949us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:11.604212 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:11.604215 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:11.604548 (+ 333us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:11.604782 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:11.604782 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:11.604783 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:11.604916 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:11.605282 (+ 366us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:02:11.605289 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:02:11.605532 (+ 243us) client_negotiation.cc:769] Sending connection context
0812 00:02:11.606502 (+ 970us) client_negotiation.cc:240] Negotiation successful
0812 00:02:11.606600 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":425,"mutex_wait_us":35,"thread_start_us":97,"threads_started":1}
I20260812 00:02:11.607066 25128 heartbeater.cc:347] Connected to a master server at 127.11.206.124:36719
I20260812 00:02:11.607195 25128 heartbeater.cc:464] Registering TS with master...
I20260812 00:02:11.607381 25128 heartbeater.cc:511] Master 127.11.206.124:36719 requested a full tablet report, sending...
I20260812 00:02:11.607818 24298 ts_manager.cc:194] Registered new tserver with Master: 39630eacbe4b41bbb157bb7b8d99c4f4 (127.11.206.67:43193)
I20260812 00:02:11.608273 25130 heartbeater.cc:347] Connected to a master server at 127.11.206.125:46169
I20260812 00:02:11.608295 25132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:11.595030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:40221 (local address 127.11.206.67:56051)
0812 00:02:11.595201 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:11.595253 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:11.595843 (+ 590us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:11.596168 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:11.596169 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:11.596465 (+ 296us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:11.596674 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:11.596682 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.597417 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.597418 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:11.598722 (+ 1304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:11.598725 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.599212 (+ 487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.599213 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:11.599364 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:11.600045 (+ 681us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:11.600050 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:11.601789 (+ 1739us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:02:11.606671 (+ 4882us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:11.606671 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:11.606672 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:11.606850 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:11.607079 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:11.607080 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:11.607080 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:11.607600 (+ 520us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:11.607956 (+ 356us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:02:11.607957 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:02:11.607997 (+ 40us) client_negotiation.cc:769] Sending connection context
0812 00:02:11.608048 (+ 51us) client_negotiation.cc:240] Negotiation successful
0812 00:02:11.608142 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"mutex_wait_us":9,"thread_start_us":97,"threads_started":1}
I20260812 00:02:11.608318 25130 heartbeater.cc:464] Registering TS with master...
I20260812 00:02:11.608384 25130 heartbeater.cc:511] Master 127.11.206.125:46169 requested a full tablet report, sending...
I20260812 00:02:11.608589 22934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:11.595023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.67:56051 (local address 127.11.206.126:40221)
0812 00:02:11.595073 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:11.595075 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:11.595333 (+ 258us) server_negotiation.cc:407] Connection header received
0812 00:02:11.596067 (+ 734us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:11.596068 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:11.596080 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:11.596127 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:11.596779 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.597286 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.598819 (+ 1533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.599121 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.599198 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:11.601879 (+ 2681us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:11.601880 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:11.601880 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:11.601887 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:11.604117 (+ 2230us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:11.606933 (+ 2816us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:11.606934 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:11.606935 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:11.607000 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:11.607681 (+ 681us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:11.607682 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:11.607682 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:11.607819 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:11.607876 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:11.608425 (+ 549us) server_negotiation.cc:299] Negotiation successful
0812 00:02:11.608502 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 00:02:11.608748 23937 ts_manager.cc:194] Registered new tserver with Master: 39630eacbe4b41bbb157bb7b8d99c4f4 (127.11.206.67:43193)
I20260812 00:02:11.608841 25129 heartbeater.cc:347] Connected to a master server at 127.11.206.126:40221
I20260812 00:02:11.608879 25129 heartbeater.cc:464] Registering TS with master...
I20260812 00:02:11.608933 25129 heartbeater.cc:511] Master 127.11.206.126:40221 requested a full tablet report, sending...
I20260812 00:02:11.609122 22864 ts_manager.cc:194] Re-registered known tserver with Master: 39630eacbe4b41bbb157bb7b8d99c4f4 (127.11.206.67:43193)
I20260812 00:02:11.609579 22864 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.206.67@KRBTEST.COM'} at 127.11.206.67:56051
I20260812 00:02:11.612599 25152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:11.603846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32966 (local address 127.11.206.126:40221)
0812 00:02:11.604470 (+ 624us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:11.604472 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:11.604701 (+ 229us) server_negotiation.cc:407] Connection header received
0812 00:02:11.604724 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:11.604725 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:11.604734 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:11.604797 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:11.606810 (+ 2013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.607528 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.608530 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.608883 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.608941 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:11.610156 (+ 1215us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:11.610157 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:11.610158 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:11.610164 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:11.611474 (+ 1310us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:11.611889 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:11.611890 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:11.611891 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:11.611944 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:11.612122 (+ 178us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:11.612123 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:11.612123 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:11.612224 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:11.612310 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:11.612427 (+ 117us) server_negotiation.cc:299] Negotiation successful
0812 00:02:11.612494 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":551,"thread_start_us":348,"threads_started":1}
I20260812 00:02:11.615314 25145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:11.603847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47090 (local address 127.11.206.125:46169)
0812 00:02:11.604869 (+ 1022us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:11.604872 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:11.604878 (+ 6us) server_negotiation.cc:407] Connection header received
0812 00:02:11.604897 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:11.604897 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:11.604907 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:11.604962 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:11.606058 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.607771 (+ 1713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.610400 (+ 2629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.610704 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.610758 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:11.612368 (+ 1610us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:11.612370 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:11.612370 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:11.612377 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:11.614162 (+ 1785us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:11.614609 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:11.614611 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:11.614611 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:11.614666 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:11.614845 (+ 179us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:11.614845 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:11.614846 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:11.614951 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:11.615035 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:11.615131 (+ 96us) server_negotiation.cc:299] Negotiation successful
0812 00:02:11.615208 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1001,"thread_start_us":64,"threads_started":1}
I20260812 00:02:11.615589 25156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:11.604302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37448 (local address 127.11.206.124:36719)
0812 00:02:11.604557 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:11.604559 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:11.605408 (+ 849us) server_negotiation.cc:407] Connection header received
0812 00:02:11.605433 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:11.605434 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:11.605447 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:11.605498 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:11.607967 (+ 2469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.608739 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.611154 (+ 2415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.611387 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.611440 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:11.612649 (+ 1209us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:11.612650 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:11.612651 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:11.612658 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:11.614194 (+ 1536us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:11.614605 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:11.614606 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:11.614607 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:11.614672 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:11.614876 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:11.614877 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:11.614877 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:11.614994 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:11.615075 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:11.615422 (+ 347us) server_negotiation.cc:299] Negotiation successful
0812 00:02:11.615500 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":235,"thread_start_us":51,"threads_started":1}
I20260812 00:02:11.614202 22864 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:32966:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:02:11.616146 22864 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:02:11.623785 23867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:11.619888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.67:43193 (local address 127.0.0.1:59922)
0812 00:02:11.620009 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:11.620019 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:11.620060 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:11.620675 (+ 615us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:11.620676 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:11.620677 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:02:11.620717 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:11.620718 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.622085 (+ 1367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.622086 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:11.622938 (+ 852us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:11.622940 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.623572 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.623573 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:11.623630 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:11.623634 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:02:11.623675 (+ 41us) client_negotiation.cc:240] Negotiation successful
0812 00:02:11.623716 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104,"mutex_wait_us":33}
I20260812 00:02:11.623906 25170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:11.620139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59922 (local address 127.11.206.67:43193)
0812 00:02:11.620495 (+ 356us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:11.620500 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:11.620510 (+ 10us) server_negotiation.cc:407] Connection header received
0812 00:02:11.620565 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:11.620567 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:11.620580 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:11.620646 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:02:11.620795 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.621981 (+ 1186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.623019 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.623492 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.623555 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:11.623724 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:11.623761 (+ 37us) server_negotiation.cc:299] Negotiation successful
0812 00:02:11.623802 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":304,"thread_start_us":106,"threads_started":1}
I20260812 00:02:11.624532 25168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:11.619910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.66:32883 (local address 127.0.0.1:43182)
0812 00:02:11.620061 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:11.620071 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:11.620121 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:11.620699 (+ 578us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:11.620700 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:11.620702 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:02:11.620745 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:11.620746 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.622153 (+ 1407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.622154 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:11.623284 (+ 1130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:11.623287 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.624312 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.624313 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:11.624373 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:11.624377 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:02:11.624434 (+ 57us) client_negotiation.cc:240] Negotiation successful
0812 00:02:11.624470 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":92,"threads_started":1}
I20260812 00:02:11.624584 25173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:11.620338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43182 (local address 127.11.206.66:32883)
0812 00:02:11.620549 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:11.620552 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:11.620561 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:02:11.620591 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:11.620593 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:11.620604 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:11.620685 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:02:11.620827 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.621981 (+ 1154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.623376 (+ 1395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.624224 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.624309 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:11.624396 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:11.624453 (+ 57us) server_negotiation.cc:299] Negotiation successful
0812 00:02:11.624491 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":184,"thread_start_us":97,"threads_started":1}
I20260812 00:02:11.624743 25003 tablet_service.cc:1467] Processing CreateTablet for tablet b488a79313414f8baac6f5ca488eb79c (DEFAULT_TABLE table=test-table [id=40b3222eeb384b9a80efd90bf092976e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:02:11.625140 25003 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b488a79313414f8baac6f5ca488eb79c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:02:11.625165 25169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:11.619955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.65:45231 (local address 127.0.0.1:38664)
0812 00:02:11.620784 (+ 829us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:11.620794 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:11.620831 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:11.621078 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:11.621078 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:11.621080 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:02:11.621116 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:11.621118 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.622493 (+ 1375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.622494 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:11.623538 (+ 1044us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:11.623540 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.624957 (+ 1417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.624958 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:11.625003 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:11.625006 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:02:11.625051 (+ 45us) client_negotiation.cc:240] Negotiation successful
0812 00:02:11.625088 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":813,"thread_start_us":142,"threads_started":1}
I20260812 00:02:11.625211 25172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:11.620222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38664 (local address 127.11.206.65:45231)
0812 00:02:11.620943 (+ 721us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:11.620946 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:11.620953 (+ 7us) server_negotiation.cc:407] Connection header received
0812 00:02:11.620987 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:11.620989 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:11.621001 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:11.621062 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:02:11.621177 (+ 115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.622406 (+ 1229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.623623 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.624781 (+ 1158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.624847 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:11.624928 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:11.625088 (+ 160us) server_negotiation.cc:299] Negotiation successful
0812 00:02:11.625128 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":686,"thread_start_us":145,"threads_started":1}
I20260812 00:02:11.625247 24773 tablet_service.cc:1467] Processing CreateTablet for tablet b488a79313414f8baac6f5ca488eb79c (DEFAULT_TABLE table=test-table [id=40b3222eeb384b9a80efd90bf092976e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:02:11.625576 24773 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b488a79313414f8baac6f5ca488eb79c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:02:11.625845 24495 tablet_service.cc:1467] Processing CreateTablet for tablet b488a79313414f8baac6f5ca488eb79c (DEFAULT_TABLE table=test-table [id=40b3222eeb384b9a80efd90bf092976e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:02:11.626145 24495 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b488a79313414f8baac6f5ca488eb79c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:02:11.629518 25174 tablet_bootstrap.cc:492] T b488a79313414f8baac6f5ca488eb79c P d91daca07bd94d6fb77661eb0190366e: Bootstrap starting.
I20260812 00:02:11.629714 25177 tablet_bootstrap.cc:492] T b488a79313414f8baac6f5ca488eb79c P b4bdd64c3f904386ad369366b7824e03: Bootstrap starting.
I20260812 00:02:11.630378 25174 tablet_bootstrap.cc:654] T b488a79313414f8baac6f5ca488eb79c P d91daca07bd94d6fb77661eb0190366e: Neither blocks nor log segments found. Creating new log.
I20260812 00:02:11.630378 25177 tablet_bootstrap.cc:654] T b488a79313414f8baac6f5ca488eb79c P b4bdd64c3f904386ad369366b7824e03: Neither blocks nor log segments found. Creating new log.
I20260812 00:02:11.630385 25175 tablet_bootstrap.cc:492] T b488a79313414f8baac6f5ca488eb79c P 39630eacbe4b41bbb157bb7b8d99c4f4: Bootstrap starting.
I20260812 00:02:11.630894 25177 log.cc:824] T b488a79313414f8baac6f5ca488eb79c P b4bdd64c3f904386ad369366b7824e03: Log is configured to *not* fsync() on all Append() calls
I20260812 00:02:11.630894 25174 log.cc:824] T b488a79313414f8baac6f5ca488eb79c P d91daca07bd94d6fb77661eb0190366e: Log is configured to *not* fsync() on all Append() calls
I20260812 00:02:11.631464 25175 tablet_bootstrap.cc:654] T b488a79313414f8baac6f5ca488eb79c P 39630eacbe4b41bbb157bb7b8d99c4f4: Neither blocks nor log segments found. Creating new log.
I20260812 00:02:11.631690 25177 tablet_bootstrap.cc:492] T b488a79313414f8baac6f5ca488eb79c P b4bdd64c3f904386ad369366b7824e03: No bootstrap required, opened a new log
I20260812 00:02:11.631762 25177 ts_tablet_manager.cc:1397] T b488a79313414f8baac6f5ca488eb79c P b4bdd64c3f904386ad369366b7824e03: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 00:02:11.631978 25175 log.cc:824] T b488a79313414f8baac6f5ca488eb79c P 39630eacbe4b41bbb157bb7b8d99c4f4: Log is configured to *not* fsync() on all Append() calls
I20260812 00:02:11.632191 25174 tablet_bootstrap.cc:492] T b488a79313414f8baac6f5ca488eb79c P d91daca07bd94d6fb77661eb0190366e: No bootstrap required, opened a new log
I20260812 00:02:11.632274 25174 ts_tablet_manager.cc:1397] T b488a79313414f8baac6f5ca488eb79c P d91daca07bd94d6fb77661eb0190366e: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 00:02:11.632666 25175 tablet_bootstrap.cc:492] T b488a79313414f8baac6f5ca488eb79c P 39630eacbe4b41bbb157bb7b8d99c4f4: No bootstrap required, opened a new log
I20260812 00:02:11.632726 25175 ts_tablet_manager.cc:1397] T b488a79313414f8baac6f5ca488eb79c P 39630eacbe4b41bbb157bb7b8d99c4f4: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 00:02:11.634188 25177 raft_consensus.cc:348] T b488a79313414f8baac6f5ca488eb79c P b4bdd64c3f904386ad369366b7824e03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39630eacbe4b41bbb157bb7b8d99c4f4" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 43193 } } peers { permanent_uuid: "b4bdd64c3f904386ad369366b7824e03" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 32883 } } peers { permanent_uuid: "d91daca07bd94d6fb77661eb0190366e" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 45231 } }
I20260812 00:02:11.634357 25177 raft_consensus.cc:374] T b488a79313414f8baac6f5ca488eb79c P b4bdd64c3f904386ad369366b7824e03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:02:11.634392 25177 raft_consensus.cc:729] T b488a79313414f8baac6f5ca488eb79c P b4bdd64c3f904386ad369366b7824e03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4bdd64c3f904386ad369366b7824e03, State: Initialized, Role: FOLLOWER
I20260812 00:02:11.634536 25177 consensus_queue.cc:260] T b488a79313414f8baac6f5ca488eb79c P b4bdd64c3f904386ad369366b7824e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39630eacbe4b41bbb157bb7b8d99c4f4" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 43193 } } peers { permanent_uuid: "b4bdd64c3f904386ad369366b7824e03" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 32883 } } peers { permanent_uuid: "d91daca07bd94d6fb77661eb0190366e" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 45231 } }
I20260812 00:02:11.634812 25177 ts_tablet_manager.cc:1428] T b488a79313414f8baac6f5ca488eb79c P b4bdd64c3f904386ad369366b7824e03: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 00:02:11.634859 25174 raft_consensus.cc:348] T b488a79313414f8baac6f5ca488eb79c P d91daca07bd94d6fb77661eb0190366e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39630eacbe4b41bbb157bb7b8d99c4f4" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 43193 } } peers { permanent_uuid: "b4bdd64c3f904386ad369366b7824e03" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 32883 } } peers { permanent_uuid: "d91daca07bd94d6fb77661eb0190366e" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 45231 } }
I20260812 00:02:11.635001 25174 raft_consensus.cc:374] T b488a79313414f8baac6f5ca488eb79c P d91daca07bd94d6fb77661eb0190366e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:02:11.635033 25174 raft_consensus.cc:729] T b488a79313414f8baac6f5ca488eb79c P d91daca07bd94d6fb77661eb0190366e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d91daca07bd94d6fb77661eb0190366e, State: Initialized, Role: FOLLOWER
I20260812 00:02:11.635155 25174 consensus_queue.cc:260] T b488a79313414f8baac6f5ca488eb79c P d91daca07bd94d6fb77661eb0190366e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39630eacbe4b41bbb157bb7b8d99c4f4" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 43193 } } peers { permanent_uuid: "b4bdd64c3f904386ad369366b7824e03" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 32883 } } peers { permanent_uuid: "d91daca07bd94d6fb77661eb0190366e" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 45231 } }
I20260812 00:02:11.635097 25175 raft_consensus.cc:348] T b488a79313414f8baac6f5ca488eb79c P 39630eacbe4b41bbb157bb7b8d99c4f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39630eacbe4b41bbb157bb7b8d99c4f4" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 43193 } } peers { permanent_uuid: "b4bdd64c3f904386ad369366b7824e03" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 32883 } } peers { permanent_uuid: "d91daca07bd94d6fb77661eb0190366e" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 45231 } }
I20260812 00:02:11.635231 24888 heartbeater.cc:503] Master 127.11.206.126:40221 was elected leader, sending a full tablet report...
I20260812 00:02:11.635248 25175 raft_consensus.cc:374] T b488a79313414f8baac6f5ca488eb79c P 39630eacbe4b41bbb157bb7b8d99c4f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:02:11.635416 25174 ts_tablet_manager.cc:1428] T b488a79313414f8baac6f5ca488eb79c P d91daca07bd94d6fb77661eb0190366e: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 00:02:11.635432 25175 raft_consensus.cc:729] T b488a79313414f8baac6f5ca488eb79c P 39630eacbe4b41bbb157bb7b8d99c4f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39630eacbe4b41bbb157bb7b8d99c4f4, State: Initialized, Role: FOLLOWER
I20260812 00:02:11.635515 24634 heartbeater.cc:503] Master 127.11.206.126:40221 was elected leader, sending a full tablet report...
I20260812 00:02:11.635571 25175 consensus_queue.cc:260] T b488a79313414f8baac6f5ca488eb79c P 39630eacbe4b41bbb157bb7b8d99c4f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39630eacbe4b41bbb157bb7b8d99c4f4" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 43193 } } peers { permanent_uuid: "b4bdd64c3f904386ad369366b7824e03" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 32883 } } peers { permanent_uuid: "d91daca07bd94d6fb77661eb0190366e" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 45231 } }
I20260812 00:02:11.635855 25175 ts_tablet_manager.cc:1428] T b488a79313414f8baac6f5ca488eb79c P 39630eacbe4b41bbb157bb7b8d99c4f4: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 00:02:11.636199 25129 heartbeater.cc:503] Master 127.11.206.126:40221 was elected leader, sending a full tablet report...
I20260812 00:02:11.650992 25156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:11.648458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37450 (local address 127.11.206.124:36719)
0812 00:02:11.648520 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:11.648522 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:11.648530 (+ 8us) server_negotiation.cc:407] Connection header received
0812 00:02:11.648557 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:11.648557 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:11.648579 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:11.648632 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:02:11.648756 (+ 124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.649238 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.650245 (+ 1007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.650659 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.650725 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:11.650813 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:11.650874 (+ 61us) server_negotiation.cc:299] Negotiation successful
0812 00:02:11.650921 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260812 00:02:11.650992 25169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:11.648387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.124:36719 (local address 127.0.0.1:37450)
0812 00:02:11.648438 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:11.648449 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:11.648488 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:11.648644 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:11.648645 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:11.648647 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:02:11.648697 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:11.648698 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.649323 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.649324 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:11.650157 (+ 833us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:11.650160 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.650739 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.650740 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:11.650810 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:11.650814 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:02:11.650867 (+ 53us) client_negotiation.cc:240] Negotiation successful
0812 00:02:11.650912 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260812 00:02:11.651364 24317 raft_consensus.cc:1203] T 00000000000000000000000000000000 P fc02528e6aee4f539756717eea57931c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.9] Dedup: 1.7->[1.8-1.9]
I20260812 00:02:11.652222 24361 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc02528e6aee4f539756717eea57931c [sys.catalog]: SysCatalogTable state changed. Reason: New leader f8d9bea32edd4f1fbd437cddb7c4a5d0. Latest consensus state: current_term: 1 leader_uuid: "f8d9bea32edd4f1fbd437cddb7c4a5d0" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "f8d9bea32edd4f1fbd437cddb7c4a5d0" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 40221 } } peers { permanent_uuid: "1917b175bf5f470494dba47305c7c669" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 46169 } attrs { promote: false } } peers { permanent_uuid: "fc02528e6aee4f539756717eea57931c" member_type: NON_VOTER last_known_addr { host: "127.11.206.124" port: 36719 } attrs { promote: true } } }
I20260812 00:02:11.652333 24361 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc02528e6aee4f539756717eea57931c [sys.catalog]: This master's current role is: LEARNER
W20260812 00:02:11.679286 24891 tablet.cc:2369] T b488a79313414f8baac6f5ca488eb79c P b4bdd64c3f904386ad369366b7824e03: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:02:11.691454 25182 raft_consensus.cc:482] T b488a79313414f8baac6f5ca488eb79c P b4bdd64c3f904386ad369366b7824e03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:02:11.691592 25182 raft_consensus.cc:504] T b488a79313414f8baac6f5ca488eb79c P b4bdd64c3f904386ad369366b7824e03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39630eacbe4b41bbb157bb7b8d99c4f4" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 43193 } } peers { permanent_uuid: "b4bdd64c3f904386ad369366b7824e03" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 32883 } } peers { permanent_uuid: "d91daca07bd94d6fb77661eb0190366e" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 45231 } }
I20260812 00:02:11.692020 25182 leader_election.cc:288] T b488a79313414f8baac6f5ca488eb79c P b4bdd64c3f904386ad369366b7824e03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 39630eacbe4b41bbb157bb7b8d99c4f4 (127.11.206.67:43193), d91daca07bd94d6fb77661eb0190366e (127.11.206.65:45231)
I20260812 00:02:11.694734 24893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:11.692175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.67:43193 (local address 127.11.206.66:46455)
0812 00:02:11.692235 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:11.692247 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:11.692301 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:11.692433 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:11.692434 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:11.692435 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:02:11.692526 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:11.692528 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.693146 (+ 618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.693147 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:11.693925 (+ 778us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:11.693927 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.694434 (+ 507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.694435 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:11.694558 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:11.694562 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:02:11.694611 (+ 49us) client_negotiation.cc:240] Negotiation successful
0812 00:02:11.694658 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260812 00:02:11.694734 25170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:11.692258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.66:46455 (local address 127.11.206.67:43193)
0812 00:02:11.692326 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:11.692327 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:11.692335 (+ 8us) server_negotiation.cc:407] Connection header received
0812 00:02:11.692364 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:11.692364 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:11.692373 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:11.692420 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:02:11.692592 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.693066 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.694021 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.694359 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.694422 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:11.694431 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:11.694638 (+ 207us) server_negotiation.cc:299] Negotiation successful
0812 00:02:11.694675 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260812 00:02:11.694926 24894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:11.692177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.65:45231 (local address 127.11.206.66:33843)
0812 00:02:11.692370 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:11.692380 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:11.692429 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:11.692556 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:11.692557 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:11.692558 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:02:11.692672 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:11.692674 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.693287 (+ 613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.693288 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:11.694125 (+ 837us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:11.694127 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.694633 (+ 506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.694634 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:11.694756 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:11.694759 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:02:11.694810 (+ 51us) client_negotiation.cc:240] Negotiation successful
0812 00:02:11.694848 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":177,"mutex_wait_us":142}
I20260812 00:02:11.695072 25172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:11.692265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.66:33843 (local address 127.11.206.65:45231)
0812 00:02:11.692307 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:11.692309 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:11.692437 (+ 128us) server_negotiation.cc:407] Connection header received
0812 00:02:11.692486 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:11.692487 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:11.692495 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:11.692542 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:02:11.692755 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.693210 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.694213 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.694557 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.694617 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:11.694625 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:11.694952 (+ 327us) server_negotiation.cc:299] Negotiation successful
0812 00:02:11.695013 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 00:02:11.695235 25048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b488a79313414f8baac6f5ca488eb79c" candidate_uuid: "b4bdd64c3f904386ad369366b7824e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39630eacbe4b41bbb157bb7b8d99c4f4" is_pre_election: true
I20260812 00:02:11.695417 25048 raft_consensus.cc:2454] T b488a79313414f8baac6f5ca488eb79c P 39630eacbe4b41bbb157bb7b8d99c4f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4bdd64c3f904386ad369366b7824e03 in term 0.
I20260812 00:02:11.695530 24531 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b488a79313414f8baac6f5ca488eb79c" candidate_uuid: "b4bdd64c3f904386ad369366b7824e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d91daca07bd94d6fb77661eb0190366e" is_pre_election: true
I20260812 00:02:11.695708 24531 raft_consensus.cc:2454] T b488a79313414f8baac6f5ca488eb79c P d91daca07bd94d6fb77661eb0190366e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4bdd64c3f904386ad369366b7824e03 in term 0.
I20260812 00:02:11.695691 24686 leader_election.cc:302] T b488a79313414f8baac6f5ca488eb79c P b4bdd64c3f904386ad369366b7824e03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39630eacbe4b41bbb157bb7b8d99c4f4, b4bdd64c3f904386ad369366b7824e03; no voters:
I20260812 00:02:11.695822 25182 raft_consensus.cc:2781] T b488a79313414f8baac6f5ca488eb79c P b4bdd64c3f904386ad369366b7824e03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:02:11.695876 25182 raft_consensus.cc:482] T b488a79313414f8baac6f5ca488eb79c P b4bdd64c3f904386ad369366b7824e03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:02:11.695901 25182 raft_consensus.cc:3037] T b488a79313414f8baac6f5ca488eb79c P b4bdd64c3f904386ad369366b7824e03 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:02:11.696894 25182 raft_consensus.cc:504] T b488a79313414f8baac6f5ca488eb79c P b4bdd64c3f904386ad369366b7824e03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39630eacbe4b41bbb157bb7b8d99c4f4" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 43193 } } peers { permanent_uuid: "b4bdd64c3f904386ad369366b7824e03" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 32883 } } peers { permanent_uuid: "d91daca07bd94d6fb77661eb0190366e" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 45231 } }
I20260812 00:02:11.697016 25182 leader_election.cc:288] T b488a79313414f8baac6f5ca488eb79c P b4bdd64c3f904386ad369366b7824e03 [CANDIDATE]: Term 1 election: Requested vote from peers 39630eacbe4b41bbb157bb7b8d99c4f4 (127.11.206.67:43193), d91daca07bd94d6fb77661eb0190366e (127.11.206.65:45231)
I20260812 00:02:11.697149 25048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b488a79313414f8baac6f5ca488eb79c" candidate_uuid: "b4bdd64c3f904386ad369366b7824e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39630eacbe4b41bbb157bb7b8d99c4f4"
I20260812 00:02:11.697194 24531 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b488a79313414f8baac6f5ca488eb79c" candidate_uuid: "b4bdd64c3f904386ad369366b7824e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d91daca07bd94d6fb77661eb0190366e"
I20260812 00:02:11.697233 25048 raft_consensus.cc:3037] T b488a79313414f8baac6f5ca488eb79c P 39630eacbe4b41bbb157bb7b8d99c4f4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:02:11.697259 24531 raft_consensus.cc:3037] T b488a79313414f8baac6f5ca488eb79c P d91daca07bd94d6fb77661eb0190366e [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:02:11.698132 24531 raft_consensus.cc:2454] T b488a79313414f8baac6f5ca488eb79c P d91daca07bd94d6fb77661eb0190366e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4bdd64c3f904386ad369366b7824e03 in term 1.
I20260812 00:02:11.698184 25048 raft_consensus.cc:2454] T b488a79313414f8baac6f5ca488eb79c P 39630eacbe4b41bbb157bb7b8d99c4f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4bdd64c3f904386ad369366b7824e03 in term 1.
I20260812 00:02:11.698320 24686 leader_election.cc:302] T b488a79313414f8baac6f5ca488eb79c P b4bdd64c3f904386ad369366b7824e03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39630eacbe4b41bbb157bb7b8d99c4f4, b4bdd64c3f904386ad369366b7824e03; no voters:
I20260812 00:02:11.698422 25182 raft_consensus.cc:2781] T b488a79313414f8baac6f5ca488eb79c P b4bdd64c3f904386ad369366b7824e03 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:02:11.698567 25182 raft_consensus.cc:686] T b488a79313414f8baac6f5ca488eb79c P b4bdd64c3f904386ad369366b7824e03 [term 1 LEADER]: Becoming Leader. State: Replica: b4bdd64c3f904386ad369366b7824e03, State: Running, Role: LEADER
I20260812 00:02:11.698654 25182 consensus_queue.cc:237] T b488a79313414f8baac6f5ca488eb79c P b4bdd64c3f904386ad369366b7824e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39630eacbe4b41bbb157bb7b8d99c4f4" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 43193 } } peers { permanent_uuid: "b4bdd64c3f904386ad369366b7824e03" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 32883 } } peers { permanent_uuid: "d91daca07bd94d6fb77661eb0190366e" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 45231 } }
I20260812 00:02:11.699499 22864 catalog_manager.cc:5495] T b488a79313414f8baac6f5ca488eb79c P b4bdd64c3f904386ad369366b7824e03 reported cstate change: term changed from 0 to 1, leader changed from <none> to b4bdd64c3f904386ad369366b7824e03 (127.11.206.66). New cstate: current_term: 1 leader_uuid: "b4bdd64c3f904386ad369366b7824e03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39630eacbe4b41bbb157bb7b8d99c4f4" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 43193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4bdd64c3f904386ad369366b7824e03" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 32883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d91daca07bd94d6fb77661eb0190366e" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 45231 } health_report { overall_health: UNKNOWN } } }
I20260812 00:02:11.700111 23868 sys_catalog.cc:455] T 00000000000000000000000000000000 P f8d9bea32edd4f1fbd437cddb7c4a5d0 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f8d9bea32edd4f1fbd437cddb7c4a5d0" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "f8d9bea32edd4f1fbd437cddb7c4a5d0" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 40221 } } peers { permanent_uuid: "1917b175bf5f470494dba47305c7c669" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 46169 } attrs { promote: false } } peers { permanent_uuid: "fc02528e6aee4f539756717eea57931c" member_type: NON_VOTER last_known_addr { host: "127.11.206.124" port: 36719 } attrs { promote: true } } }
I20260812 00:02:11.700198 23868 sys_catalog.cc:458] T 00000000000000000000000000000000 P f8d9bea32edd4f1fbd437cddb7c4a5d0 [sys.catalog]: This master's current role is: LEADER
I20260812 00:02:11.701001 25199 raft_consensus.cc:1050] T 00000000000000000000000000000000 P f8d9bea32edd4f1fbd437cddb7c4a5d0: attempting to promote NON_VOTER fc02528e6aee4f539756717eea57931c to VOTER
I20260812 00:02:11.701398 25199 consensus_queue.cc:237] T 00000000000000000000000000000000 P f8d9bea32edd4f1fbd437cddb7c4a5d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 1.10, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "f8d9bea32edd4f1fbd437cddb7c4a5d0" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 40221 } } peers { permanent_uuid: "1917b175bf5f470494dba47305c7c669" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 46169 } attrs { promote: false } } peers { permanent_uuid: "fc02528e6aee4f539756717eea57931c" member_type: VOTER last_known_addr { host: "127.11.206.124" port: 36719 } attrs { promote: false } }
I20260812 00:02:11.701856 24317 raft_consensus.cc:1261] T 00000000000000000000000000000000 P fc02528e6aee4f539756717eea57931c [term 1 LEARNER]: Refusing update from remote peer f8d9bea32edd4f1fbd437cddb7c4a5d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20260812 00:02:11.701927 23958 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 1917b175bf5f470494dba47305c7c669 [term 1 FOLLOWER]: Refusing update from remote peer f8d9bea32edd4f1fbd437cddb7c4a5d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20260812 00:02:11.702101 23868 consensus_queue.cc:1035] T 00000000000000000000000000000000 P f8d9bea32edd4f1fbd437cddb7c4a5d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc02528e6aee4f539756717eea57931c" member_type: VOTER last_known_addr { host: "127.11.206.124" port: 36719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260812 00:02:11.702214 25200 consensus_queue.cc:1035] T 00000000000000000000000000000000 P f8d9bea32edd4f1fbd437cddb7c4a5d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1917b175bf5f470494dba47305c7c669" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 46169 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260812 00:02:11.702854 23868 raft_consensus.cc:2932] T 00000000000000000000000000000000 P f8d9bea32edd4f1fbd437cddb7c4a5d0 [term 1 LEADER]: Committing config change with OpId 1.11: config changed from index 7 to 11, fc02528e6aee4f539756717eea57931c (127.11.206.124) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "f8d9bea32edd4f1fbd437cddb7c4a5d0" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 40221 } } peers { permanent_uuid: "1917b175bf5f470494dba47305c7c669" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 46169 } attrs { promote: false } } peers { permanent_uuid: "fc02528e6aee4f539756717eea57931c" member_type: VOTER last_known_addr { host: "127.11.206.124" port: 36719 } attrs { promote: false } } }
I20260812 00:02:11.703059 23958 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 1917b175bf5f470494dba47305c7c669 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 7 to 11, fc02528e6aee4f539756717eea57931c (127.11.206.124) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "f8d9bea32edd4f1fbd437cddb7c4a5d0" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 40221 } } peers { permanent_uuid: "1917b175bf5f470494dba47305c7c669" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 46169 } attrs { promote: false } } peers { permanent_uuid: "fc02528e6aee4f539756717eea57931c" member_type: VOTER last_known_addr { host: "127.11.206.124" port: 36719 } attrs { promote: false } } }
I20260812 00:02:11.703028 24317 raft_consensus.cc:2932] T 00000000000000000000000000000000 P fc02528e6aee4f539756717eea57931c [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 7 to 11, fc02528e6aee4f539756717eea57931c (127.11.206.124) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "f8d9bea32edd4f1fbd437cddb7c4a5d0" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 40221 } } peers { permanent_uuid: "1917b175bf5f470494dba47305c7c669" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 46169 } attrs { promote: false } } peers { permanent_uuid: "fc02528e6aee4f539756717eea57931c" member_type: VOTER last_known_addr { host: "127.11.206.124" port: 36719 } attrs { promote: false } } }
I20260812 00:02:11.703662 23868 sys_catalog.cc:455] T 00000000000000000000000000000000 P f8d9bea32edd4f1fbd437cddb7c4a5d0 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "f8d9bea32edd4f1fbd437cddb7c4a5d0" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "f8d9bea32edd4f1fbd437cddb7c4a5d0" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 40221 } } peers { permanent_uuid: "1917b175bf5f470494dba47305c7c669" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 46169 } attrs { promote: false } } peers { permanent_uuid: "fc02528e6aee4f539756717eea57931c" member_type: VOTER last_known_addr { host: "127.11.206.124" port: 36719 } attrs { promote: false } } }
I20260812 00:02:11.703750 23868 sys_catalog.cc:458] T 00000000000000000000000000000000 P f8d9bea32edd4f1fbd437cddb7c4a5d0 [sys.catalog]: This master's current role is: LEADER
I20260812 00:02:11.703804 23868 sys_catalog.cc:455] T 00000000000000000000000000000000 P f8d9bea32edd4f1fbd437cddb7c4a5d0 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f8d9bea32edd4f1fbd437cddb7c4a5d0" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "f8d9bea32edd4f1fbd437cddb7c4a5d0" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 40221 } } peers { permanent_uuid: "1917b175bf5f470494dba47305c7c669" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 46169 } attrs { promote: false } } peers { permanent_uuid: "fc02528e6aee4f539756717eea57931c" member_type: VOTER last_known_addr { host: "127.11.206.124" port: 36719 } attrs { promote: false } } }
I20260812 00:02:11.703848 23868 sys_catalog.cc:458] T 00000000000000000000000000000000 P f8d9bea32edd4f1fbd437cddb7c4a5d0 [sys.catalog]: This master's current role is: LEADER
I20260812 00:02:11.703827 25200 sys_catalog.cc:455] T 00000000000000000000000000000000 P f8d9bea32edd4f1fbd437cddb7c4a5d0 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f8d9bea32edd4f1fbd437cddb7c4a5d0" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "f8d9bea32edd4f1fbd437cddb7c4a5d0" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 40221 } } peers { permanent_uuid: "1917b175bf5f470494dba47305c7c669" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 46169 } attrs { promote: false } } peers { permanent_uuid: "fc02528e6aee4f539756717eea57931c" member_type: VOTER last_known_addr { host: "127.11.206.124" port: 36719 } attrs { promote: false } } }
I20260812 00:02:11.703886 25200 sys_catalog.cc:458] T 00000000000000000000000000000000 P f8d9bea32edd4f1fbd437cddb7c4a5d0 [sys.catalog]: This master's current role is: LEADER
I20260812 00:02:11.703999 24361 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc02528e6aee4f539756717eea57931c [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f8d9bea32edd4f1fbd437cddb7c4a5d0" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "f8d9bea32edd4f1fbd437cddb7c4a5d0" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 40221 } } peers { permanent_uuid: "1917b175bf5f470494dba47305c7c669" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 46169 } attrs { promote: false } } peers { permanent_uuid: "fc02528e6aee4f539756717eea57931c" member_type: VOTER last_known_addr { host: "127.11.206.124" port: 36719 } attrs { promote: false } } }
I20260812 00:02:11.704061 24361 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc02528e6aee4f539756717eea57931c [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:02:11.704419 25202 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1917b175bf5f470494dba47305c7c669 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f8d9bea32edd4f1fbd437cddb7c4a5d0" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "f8d9bea32edd4f1fbd437cddb7c4a5d0" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 40221 } } peers { permanent_uuid: "1917b175bf5f470494dba47305c7c669" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 46169 } attrs { promote: false } } peers { permanent_uuid: "fc02528e6aee4f539756717eea57931c" member_type: VOTER last_known_addr { host: "127.11.206.124" port: 36719 } attrs { promote: false } } }
I20260812 00:02:11.704512 25202 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1917b175bf5f470494dba47305c7c669 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:02:11.714651 25173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:11.712109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43184 (local address 127.11.206.66:32883)
0812 00:02:11.712156 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:11.712158 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:11.712165 (+ 7us) server_negotiation.cc:407] Connection header received
0812 00:02:11.712198 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:11.712198 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:11.712216 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:11.712276 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:02:11.712512 (+ 236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.712984 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.713835 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.714026 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.714070 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:11.714282 (+ 212us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:02:11.714387 (+ 105us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:02:11.714449 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:11.714549 (+ 100us) server_negotiation.cc:299] Negotiation successful
0812 00:02:11.714573 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260812 00:02:11.716655 25048 raft_consensus.cc:1261] T b488a79313414f8baac6f5ca488eb79c P 39630eacbe4b41bbb157bb7b8d99c4f4 [term 1 FOLLOWER]: Refusing update from remote peer b4bdd64c3f904386ad369366b7824e03: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:02:11.716686 24531 raft_consensus.cc:1261] T b488a79313414f8baac6f5ca488eb79c P d91daca07bd94d6fb77661eb0190366e [term 1 FOLLOWER]: Refusing update from remote peer b4bdd64c3f904386ad369366b7824e03: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:02:11.717047 25196 consensus_queue.cc:1035] T b488a79313414f8baac6f5ca488eb79c P b4bdd64c3f904386ad369366b7824e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39630eacbe4b41bbb157bb7b8d99c4f4" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 43193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:02:11.717190 25182 consensus_queue.cc:1035] T b488a79313414f8baac6f5ca488eb79c P b4bdd64c3f904386ad369366b7824e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d91daca07bd94d6fb77661eb0190366e" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 45231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:02:11.721561 25207 mvcc.cc:205] Tried to move back new op lower bound from 7317475048308563968 to 7317475048238379008. Current Snapshot: MvccSnapshot[applied={T|T < 7317475048308563968}]
I20260812 00:02:11.724444 22864 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:32966:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:02:11.724527 22864 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:32966:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:02:11.725901 22864 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f8d9bea32edd4f1fbd437cddb7c4a5d0: Sending DeleteTablet for 3 replicas of tablet b488a79313414f8baac6f5ca488eb79c
I20260812 00:02:11.726249 25003 tablet_service.cc:1514] Processing DeleteTablet for tablet b488a79313414f8baac6f5ca488eb79c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:02:11 UTC) from {username='oryx', principal='oryx/127.11.206.126@KRBTEST.COM'} at 127.0.0.1:59922
I20260812 00:02:11.726253 24495 tablet_service.cc:1514] Processing DeleteTablet for tablet b488a79313414f8baac6f5ca488eb79c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:02:11 UTC) from {username='oryx', principal='oryx/127.11.206.126@KRBTEST.COM'} at 127.0.0.1:38664
I20260812 00:02:11.726500 25222 tablet_replica.cc:330] T b488a79313414f8baac6f5ca488eb79c P 39630eacbe4b41bbb157bb7b8d99c4f4: stopping tablet replica
I20260812 00:02:11.726476 24773 tablet_service.cc:1514] Processing DeleteTablet for tablet b488a79313414f8baac6f5ca488eb79c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:02:11 UTC) from {username='oryx', principal='oryx/127.11.206.126@KRBTEST.COM'} at 127.0.0.1:43182
I20260812 00:02:11.726604 25222 raft_consensus.cc:2229] T b488a79313414f8baac6f5ca488eb79c P 39630eacbe4b41bbb157bb7b8d99c4f4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:02:11.726717 25222 raft_consensus.cc:2258] T b488a79313414f8baac6f5ca488eb79c P 39630eacbe4b41bbb157bb7b8d99c4f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:02:11.726801 25224 tablet_replica.cc:330] T b488a79313414f8baac6f5ca488eb79c P b4bdd64c3f904386ad369366b7824e03: stopping tablet replica
I20260812 00:02:11.726926 25224 raft_consensus.cc:2229] T b488a79313414f8baac6f5ca488eb79c P b4bdd64c3f904386ad369366b7824e03 [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:02:11.727052 25224 raft_consensus.cc:2258] T b488a79313414f8baac6f5ca488eb79c P b4bdd64c3f904386ad369366b7824e03 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:02:11.727520 25224 ts_tablet_manager.cc:1905] T b488a79313414f8baac6f5ca488eb79c P b4bdd64c3f904386ad369366b7824e03: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:02:11.727685 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 22808
I20260812 00:02:11.736910 25156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:11.727097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37464 (local address 127.11.206.124:36719)
0812 00:02:11.727142 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:11.727144 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:11.729436 (+ 2292us) server_negotiation.cc:407] Connection header received
0812 00:02:11.729516 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:11.729517 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:11.729526 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:11.729550 (+ 24us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:11.730619 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.731278 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.732200 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.732477 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.732519 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:11.734096 (+ 1577us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:11.734098 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:11.734098 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:11.734105 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:11.735505 (+ 1400us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:11.735928 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:11.735930 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:11.735930 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:11.735994 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:11.736243 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:11.736244 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:11.736244 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:11.736385 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:11.736462 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:11.736699 (+ 237us) server_negotiation.cc:299] Negotiation successful
0812 00:02:11.736797 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 00:02:11.739755 25224 ts_tablet_manager.cc:1918] T b488a79313414f8baac6f5ca488eb79c P b4bdd64c3f904386ad369366b7824e03: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:02:11.739967 25224 log.cc:1196] T b488a79313414f8baac6f5ca488eb79c P b4bdd64c3f904386ad369366b7824e03: Deleting WAL directory at /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-1/wal/wals/b488a79313414f8baac6f5ca488eb79c
I20260812 00:02:11.740489 25224 ts_tablet_manager.cc:1939] T b488a79313414f8baac6f5ca488eb79c P b4bdd64c3f904386ad369366b7824e03: Deleting consensus metadata
I20260812 00:02:11.742118 25222 ts_tablet_manager.cc:1905] T b488a79313414f8baac6f5ca488eb79c P 39630eacbe4b41bbb157bb7b8d99c4f4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:02:11.744141 25222 ts_tablet_manager.cc:1918] T b488a79313414f8baac6f5ca488eb79c P 39630eacbe4b41bbb157bb7b8d99c4f4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:02:11.744236 25222 log.cc:1196] T b488a79313414f8baac6f5ca488eb79c P 39630eacbe4b41bbb157bb7b8d99c4f4: Deleting WAL directory at /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-2/wal/wals/b488a79313414f8baac6f5ca488eb79c
I20260812 00:02:11.744531 25222 ts_tablet_manager.cc:1939] T b488a79313414f8baac6f5ca488eb79c P 39630eacbe4b41bbb157bb7b8d99c4f4: Deleting consensus metadata
I20260812 00:02:11.745592 25223 tablet_replica.cc:330] T b488a79313414f8baac6f5ca488eb79c P d91daca07bd94d6fb77661eb0190366e: stopping tablet replica
I20260812 00:02:11.745736 25223 raft_consensus.cc:2229] T b488a79313414f8baac6f5ca488eb79c P d91daca07bd94d6fb77661eb0190366e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:02:11.745884 25223 raft_consensus.cc:2258] T b488a79313414f8baac6f5ca488eb79c P d91daca07bd94d6fb77661eb0190366e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:02:11.746428 25223 ts_tablet_manager.cc:1905] T b488a79313414f8baac6f5ca488eb79c P d91daca07bd94d6fb77661eb0190366e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:02:11.748216 25223 ts_tablet_manager.cc:1918] T b488a79313414f8baac6f5ca488eb79c P d91daca07bd94d6fb77661eb0190366e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:02:11.748329 25223 log.cc:1196] T b488a79313414f8baac6f5ca488eb79c P d91daca07bd94d6fb77661eb0190366e: Deleting WAL directory at /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-0/wal/wals/b488a79313414f8baac6f5ca488eb79c
I20260812 00:02:11.748622 25223 ts_tablet_manager.cc:1939] T b488a79313414f8baac6f5ca488eb79c P d91daca07bd94d6fb77661eb0190366e: Deleting consensus metadata
W20260812 00:02:11.749424 24412 connection.cc:535] server connection from 127.0.0.1:38664 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 00:02:11.749433 24686 connection.cc:535] server connection from 127.0.0.1:43182 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 00:02:11.749696 24933 connection.cc:535] server connection from 127.0.0.1:59922 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 00:02:11.758514 25145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:11.751318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47096 (local address 127.11.206.125:46169)
0812 00:02:11.751368 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:11.751370 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:11.751476 (+ 106us) server_negotiation.cc:407] Connection header received
0812 00:02:11.751565 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:11.751566 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:11.751582 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:11.751630 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:11.752212 (+ 582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.752730 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.754185 (+ 1455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.754392 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.754449 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:11.755719 (+ 1270us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:11.755720 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:11.755721 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:11.755730 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:11.757163 (+ 1433us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:11.757616 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:11.757618 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:11.757618 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:11.757699 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:11.757904 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:11.757905 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:11.757905 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:11.758072 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:11.758153 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:11.758309 (+ 156us) server_negotiation.cc:299] Negotiation successful
0812 00:02:11.758410 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260812 00:02:11.759742 25156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:11.751431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37466 (local address 127.11.206.124:36719)
0812 00:02:11.751488 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:11.751490 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:11.751598 (+ 108us) server_negotiation.cc:407] Connection header received
0812 00:02:11.751675 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:11.751676 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:11.751686 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:11.751734 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:11.752904 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.753742 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.754794 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:11.755104 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:11.755145 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:11.756866 (+ 1721us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:11.756868 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:11.756868 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:11.756877 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:11.758616 (+ 1739us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:11.758970 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:11.758971 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:11.758971 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:11.759032 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:11.759304 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:11.759305 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:11.759305 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:11.759415 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:11.759490 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:11.759615 (+ 125us) server_negotiation.cc:299] Negotiation successful
0812 00:02:11.759679 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260812 00:02:12.722208 25237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:12.721609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:40221 (local address 127.11.206.65:38283)
0812 00:02:12.721756 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:12.721860 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:40221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":70,"threads_started":1}
W20260812 00:02:12.722471 24634 heartbeater.cc:644] Failed to heartbeat to 127.11.206.126:40221 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.11.206.126:40221: connect: Connection refused (error 111)
I20260812 00:02:12.722568 25242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:12.722223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:40221 (local address 127.11.206.67:47687)
0812 00:02:12.722447 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:12.722524 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:40221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":74,"threads_started":1}
I20260812 00:02:12.722747 25238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:12.721686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:40221 (local address 127.11.206.66:39415)
0812 00:02:12.722592 (+ 906us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:12.722704 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:40221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":883,"thread_start_us":50,"threads_started":1}
W20260812 00:02:12.722841 25129 heartbeater.cc:644] Failed to heartbeat to 127.11.206.126:40221 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.11.206.126:40221: connect: Connection refused (error 111)
W20260812 00:02:12.722958 24888 heartbeater.cc:644] Failed to heartbeat to 127.11.206.126:40221 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.11.206.126:40221: connect: Connection refused (error 111)
I20260812 00:02:13.226495 25243 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1917b175bf5f470494dba47305c7c669 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f8d9bea32edd4f1fbd437cddb7c4a5d0)
I20260812 00:02:13.226647 25243 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1917b175bf5f470494dba47305c7c669 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "f8d9bea32edd4f1fbd437cddb7c4a5d0" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 40221 } } peers { permanent_uuid: "1917b175bf5f470494dba47305c7c669" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 46169 } attrs { promote: false } } peers { permanent_uuid: "fc02528e6aee4f539756717eea57931c" member_type: VOTER last_known_addr { host: "127.11.206.124" port: 36719 } attrs { promote: false } }
I20260812 00:02:13.226898 25243 leader_election.cc:288] T 00000000000000000000000000000000 P 1917b175bf5f470494dba47305c7c669 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f8d9bea32edd4f1fbd437cddb7c4a5d0 (127.11.206.126:40221), fc02528e6aee4f539756717eea57931c (127.11.206.124:36719)
I20260812 00:02:13.227008 25245 raft_consensus.cc:482] T 00000000000000000000000000000000 P fc02528e6aee4f539756717eea57931c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f8d9bea32edd4f1fbd437cddb7c4a5d0)
I20260812 00:02:13.227144 25245 raft_consensus.cc:504] T 00000000000000000000000000000000 P fc02528e6aee4f539756717eea57931c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "f8d9bea32edd4f1fbd437cddb7c4a5d0" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 40221 } } peers { permanent_uuid: "1917b175bf5f470494dba47305c7c669" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 46169 } attrs { promote: false } } peers { permanent_uuid: "fc02528e6aee4f539756717eea57931c" member_type: VOTER last_known_addr { host: "127.11.206.124" port: 36719 } attrs { promote: false } }
I20260812 00:02:13.227254 25248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:13.226997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:40221 (local address 127.0.0.1:33386)
0812 00:02:13.227150 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:13.227211 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:40221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":45,"threads_started":1}
W20260812 00:02:13.227393 23913 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.206.126:40221: connect: Connection refused (error 111)
I20260812 00:02:13.227411 25245 leader_election.cc:288] T 00000000000000000000000000000000 P fc02528e6aee4f539756717eea57931c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f8d9bea32edd4f1fbd437cddb7c4a5d0 (127.11.206.126:40221), 1917b175bf5f470494dba47305c7c669 (127.11.206.125:46169)
I20260812 00:02:13.227814 25248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:13.227717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:40221 (local address 127.0.0.1:33400)
0812 00:02:13.227763 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:13.227787 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:40221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
W20260812 00:02:13.227902 23913 leader_election.cc:334] T 00000000000000000000000000000000 P 1917b175bf5f470494dba47305c7c669 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f8d9bea32edd4f1fbd437cddb7c4a5d0 (127.11.206.126:40221): Network error: Client connection negotiation failed: client connection to 127.11.206.126:40221: connect: Connection refused (error 111)
I20260812 00:02:13.227952 25255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:13.227613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:40221 (local address 127.0.0.1:33394)
0812 00:02:13.227853 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:13.227911 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:40221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":52,"threads_started":1}
W20260812 00:02:13.228058 24264 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.206.126:40221: connect: Connection refused (error 111)
I20260812 00:02:13.228478 25255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:13.228376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:40221 (local address 127.0.0.1:33414)
0812 00:02:13.228422 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:13.228452 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:40221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260812 00:02:13.228574 24264 leader_election.cc:334] T 00000000000000000000000000000000 P fc02528e6aee4f539756717eea57931c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f8d9bea32edd4f1fbd437cddb7c4a5d0 (127.11.206.126:40221): Network error: Client connection negotiation failed: client connection to 127.11.206.126:40221: connect: Connection refused (error 111)
I20260812 00:02:13.230346 25249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:13.227179 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37480 (local address 127.11.206.124:36719)
0812 00:02:13.227279 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:13.227281 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:13.227422 (+ 141us) server_negotiation.cc:407] Connection header received
0812 00:02:13.227453 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:13.227453 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:13.227465 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:13.227533 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:02:13.227689 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:13.228404 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:13.229621 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:13.230012 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:13.230075 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:13.230084 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:13.230242 (+ 158us) server_negotiation.cc:299] Negotiation successful
0812 00:02:13.230286 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85,"thread_start_us":58,"threads_started":1}
I20260812 00:02:13.230360 25246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:13.227051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.124:36719 (local address 127.0.0.1:37480)
0812 00:02:13.227215 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:13.227283 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:13.227384 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:13.227539 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:13.227541 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:13.227543 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:02:13.227602 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:13.227604 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:13.228495 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:13.228496 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:13.229548 (+ 1052us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:13.229551 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:13.230088 (+ 537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:13.230106 (+ 18us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:13.230174 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:13.230179 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 00:02:13.230253 (+ 74us) client_negotiation.cc:240] Negotiation successful
0812 00:02:13.230296 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":45,"threads_started":1}
I20260812 00:02:13.230554 24317 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1917b175bf5f470494dba47305c7c669" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "fc02528e6aee4f539756717eea57931c" is_pre_election: true
I20260812 00:02:13.230654 24317 raft_consensus.cc:2454] T 00000000000000000000000000000000 P fc02528e6aee4f539756717eea57931c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1917b175bf5f470494dba47305c7c669 in term 1.
I20260812 00:02:13.230821 23907 leader_election.cc:302] T 00000000000000000000000000000000 P 1917b175bf5f470494dba47305c7c669 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1917b175bf5f470494dba47305c7c669, fc02528e6aee4f539756717eea57931c; no voters: f8d9bea32edd4f1fbd437cddb7c4a5d0
I20260812 00:02:13.230899 25259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:13.227718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47104 (local address 127.11.206.125:46169)
0812 00:02:13.228005 (+ 287us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:13.228007 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:13.228015 (+ 8us) server_negotiation.cc:407] Connection header received
0812 00:02:13.228035 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:13.228036 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:13.228045 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:13.228110 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:02:13.228284 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:13.229004 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:13.230119 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:13.230552 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:13.230616 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:13.230623 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:13.230806 (+ 183us) server_negotiation.cc:299] Negotiation successful
0812 00:02:13.230849 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":265,"thread_start_us":84,"threads_started":1}
I20260812 00:02:13.230892 25252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:13.227539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.125:46169 (local address 127.0.0.1:47104)
0812 00:02:13.227773 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:13.227783 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:13.227833 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:13.228144 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:13.228144 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:13.228147 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:02:13.228200 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:13.228203 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:13.229086 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:13.229087 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:13.229992 (+ 905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:13.229995 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:13.230626 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:13.230627 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:13.230720 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:13.230725 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 00:02:13.230779 (+ 54us) client_negotiation.cc:240] Negotiation successful
0812 00:02:13.230820 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":37,"threads_started":1}
I20260812 00:02:13.230942 25243 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1917b175bf5f470494dba47305c7c669 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 00:02:13.230967 25243 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1917b175bf5f470494dba47305c7c669 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f8d9bea32edd4f1fbd437cddb7c4a5d0)
I20260812 00:02:13.230984 25243 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1917b175bf5f470494dba47305c7c669 [term 1 FOLLOWER]: Advancing to term 2
I20260812 00:02:13.231637 25243 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1917b175bf5f470494dba47305c7c669 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "f8d9bea32edd4f1fbd437cddb7c4a5d0" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 40221 } } peers { permanent_uuid: "1917b175bf5f470494dba47305c7c669" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 46169 } attrs { promote: false } } peers { permanent_uuid: "fc02528e6aee4f539756717eea57931c" member_type: VOTER last_known_addr { host: "127.11.206.124" port: 36719 } attrs { promote: false } }
I20260812 00:02:13.231745 25243 leader_election.cc:288] T 00000000000000000000000000000000 P 1917b175bf5f470494dba47305c7c669 [CANDIDATE]: Term 2 election: Requested vote from peers f8d9bea32edd4f1fbd437cddb7c4a5d0 (127.11.206.126:40221), fc02528e6aee4f539756717eea57931c (127.11.206.124:36719)
I20260812 00:02:13.231956 25246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:13.231848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:40221 (local address 127.0.0.1:33416)
0812 00:02:13.231896 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:13.231928 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:40221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260812 00:02:13.232005 24317 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1917b175bf5f470494dba47305c7c669" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "fc02528e6aee4f539756717eea57931c"
I20260812 00:02:13.232012 23958 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fc02528e6aee4f539756717eea57931c" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "1917b175bf5f470494dba47305c7c669" is_pre_election: true
I20260812 00:02:13.232085 24317 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fc02528e6aee4f539756717eea57931c [term 1 FOLLOWER]: Advancing to term 2
I20260812 00:02:13.232106 23958 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 1917b175bf5f470494dba47305c7c669 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc02528e6aee4f539756717eea57931c in current term 2: Already voted for candidate 1917b175bf5f470494dba47305c7c669 in this term.
I20260812 00:02:13.232331 24256 leader_election.cc:302] T 00000000000000000000000000000000 P fc02528e6aee4f539756717eea57931c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc02528e6aee4f539756717eea57931c; no voters: 1917b175bf5f470494dba47305c7c669, f8d9bea32edd4f1fbd437cddb7c4a5d0
I20260812 00:02:13.232414 25246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:13.232333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:40221 (local address 127.0.0.1:33430)
0812 00:02:13.232364 (+ 31us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:13.232392 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:40221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":16}
W20260812 00:02:13.232482 23913 leader_election.cc:334] T 00000000000000000000000000000000 P 1917b175bf5f470494dba47305c7c669 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f8d9bea32edd4f1fbd437cddb7c4a5d0 (127.11.206.126:40221): Network error: Client connection negotiation failed: client connection to 127.11.206.126:40221: connect: Connection refused (error 111)
I20260812 00:02:13.232833 24317 raft_consensus.cc:2454] T 00000000000000000000000000000000 P fc02528e6aee4f539756717eea57931c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1917b175bf5f470494dba47305c7c669 in term 2.
I20260812 00:02:13.232915 25245 raft_consensus.cc:2726] T 00000000000000000000000000000000 P fc02528e6aee4f539756717eea57931c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 00:02:13.233003 23907 leader_election.cc:302] T 00000000000000000000000000000000 P 1917b175bf5f470494dba47305c7c669 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1917b175bf5f470494dba47305c7c669, fc02528e6aee4f539756717eea57931c; no voters: f8d9bea32edd4f1fbd437cddb7c4a5d0
I20260812 00:02:13.233072 25243 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1917b175bf5f470494dba47305c7c669 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 00:02:13.233191 25243 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1917b175bf5f470494dba47305c7c669 [term 2 LEADER]: Becoming Leader. State: Replica: 1917b175bf5f470494dba47305c7c669, State: Running, Role: LEADER
I20260812 00:02:13.233254 25243 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1917b175bf5f470494dba47305c7c669 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "f8d9bea32edd4f1fbd437cddb7c4a5d0" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 40221 } } peers { permanent_uuid: "1917b175bf5f470494dba47305c7c669" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 46169 } attrs { promote: false } } peers { permanent_uuid: "fc02528e6aee4f539756717eea57931c" member_type: VOTER last_known_addr { host: "127.11.206.124" port: 36719 } attrs { promote: false } }
I20260812 00:02:13.233579 25261 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1917b175bf5f470494dba47305c7c669 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1917b175bf5f470494dba47305c7c669. Latest consensus state: current_term: 2 leader_uuid: "1917b175bf5f470494dba47305c7c669" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "f8d9bea32edd4f1fbd437cddb7c4a5d0" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 40221 } } peers { permanent_uuid: "1917b175bf5f470494dba47305c7c669" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 46169 } attrs { promote: false } } peers { permanent_uuid: "fc02528e6aee4f539756717eea57931c" member_type: VOTER last_known_addr { host: "127.11.206.124" port: 36719 } attrs { promote: false } } }
I20260812 00:02:13.233675 25261 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1917b175bf5f470494dba47305c7c669 [sys.catalog]: This master's current role is: LEADER
I20260812 00:02:13.233861 25264 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:02:13.234390 25264 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:02:13.234477 25264 catalog_manager.cc:1259] Loaded cluster ID: 8e5c799ca7af493c8cb9aab24be43514
I20260812 00:02:13.234508 25264 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:02:13.234666 25264 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:02:13.234733 25264 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 1917b175bf5f470494dba47305c7c669: Loaded TSK: 0
I20260812 00:02:13.234870 25264 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:02:13.281647 23935 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47096:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:02:13.283223 23935 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:02:13.284237 25246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:13.284133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:40221 (local address 127.0.0.1:33444)
0812 00:02:13.284181 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:13.284212 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:40221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260812 00:02:13.284292 24317 raft_consensus.cc:1261] T 00000000000000000000000000000000 P fc02528e6aee4f539756717eea57931c [term 2 FOLLOWER]: Refusing update from remote peer 1917b175bf5f470494dba47305c7c669: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260812 00:02:13.284549 25261 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 1917b175bf5f470494dba47305c7c669 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc02528e6aee4f539756717eea57931c" member_type: VOTER last_known_addr { host: "127.11.206.124" port: 36719 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260812 00:02:13.284621 25246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:13.284520 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:40221 (local address 127.0.0.1:33452)
0812 00:02:13.284570 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:13.284596 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:40221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260812 00:02:13.284713 23913 consensus_peers.cc:487] T 00000000000000000000000000000000 P 1917b175bf5f470494dba47305c7c669 -> Peer f8d9bea32edd4f1fbd437cddb7c4a5d0 (127.11.206.126:40221): Couldn't send request to peer f8d9bea32edd4f1fbd437cddb7c4a5d0. Status: Network error: Client connection negotiation failed: client connection to 127.11.206.126:40221: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 00:02:13.285174 25245 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc02528e6aee4f539756717eea57931c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1917b175bf5f470494dba47305c7c669. Latest consensus state: current_term: 2 leader_uuid: "1917b175bf5f470494dba47305c7c669" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "f8d9bea32edd4f1fbd437cddb7c4a5d0" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 40221 } } peers { permanent_uuid: "1917b175bf5f470494dba47305c7c669" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 46169 } attrs { promote: false } } peers { permanent_uuid: "fc02528e6aee4f539756717eea57931c" member_type: VOTER last_known_addr { host: "127.11.206.124" port: 36719 } attrs { promote: false } } }
I20260812 00:02:13.285275 25245 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc02528e6aee4f539756717eea57931c [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:02:13.285691 25261 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1917b175bf5f470494dba47305c7c669 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "1917b175bf5f470494dba47305c7c669" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "f8d9bea32edd4f1fbd437cddb7c4a5d0" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 40221 } } peers { permanent_uuid: "1917b175bf5f470494dba47305c7c669" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 46169 } attrs { promote: false } } peers { permanent_uuid: "fc02528e6aee4f539756717eea57931c" member_type: VOTER last_known_addr { host: "127.11.206.124" port: 36719 } attrs { promote: false } } }
I20260812 00:02:13.285775 25261 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1917b175bf5f470494dba47305c7c669 [sys.catalog]: This master's current role is: LEADER
I20260812 00:02:13.285871 25245 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc02528e6aee4f539756717eea57931c [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "1917b175bf5f470494dba47305c7c669" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "f8d9bea32edd4f1fbd437cddb7c4a5d0" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 40221 } } peers { permanent_uuid: "1917b175bf5f470494dba47305c7c669" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 46169 } attrs { promote: false } } peers { permanent_uuid: "fc02528e6aee4f539756717eea57931c" member_type: VOTER last_known_addr { host: "127.11.206.124" port: 36719 } attrs { promote: false } } }
I20260812 00:02:13.285959 25245 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc02528e6aee4f539756717eea57931c [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:02:13.290571 25275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:13.287520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38666 (local address 127.11.206.65:45231)
0812 00:02:13.287614 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:13.287615 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:13.287716 (+ 101us) server_negotiation.cc:407] Connection header received
0812 00:02:13.287745 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:13.287746 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:13.287756 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:13.287922 (+ 166us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:02:13.288044 (+ 122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:13.288763 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:13.289783 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:13.290237 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:13.290315 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:13.290327 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:13.290464 (+ 137us) server_negotiation.cc:299] Negotiation successful
0812 00:02:13.290503 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74,"thread_start_us":51,"threads_started":1}
I20260812 00:02:13.290580 25274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:13.287463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.65:45231 (local address 127.0.0.1:38666)
0812 00:02:13.287654 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:13.287661 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:13.287705 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:13.287943 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:13.287943 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:13.287945 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:02:13.287971 (+ 26us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:13.287972 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:13.288853 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:13.288854 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:13.289656 (+ 802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:13.289659 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:13.290329 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:13.290330 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:13.290391 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:13.290396 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 00:02:13.290451 (+ 55us) client_negotiation.cc:240] Negotiation successful
0812 00:02:13.290495 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":176,"mutex_wait_us":5,"thread_start_us":71,"threads_started":1}
I20260812 00:02:13.290678 25246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:13.287386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.67:43193 (local address 127.0.0.1:59926)
0812 00:02:13.287557 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:13.287565 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:13.287588 (+ 23us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:13.287820 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:13.287821 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:13.287822 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:02:13.287874 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:13.287876 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:13.288584 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:13.288585 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:13.289658 (+ 1073us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:13.289661 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:13.290505 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:13.290506 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:13.290561 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:13.290565 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:02:13.290592 (+ 27us) client_negotiation.cc:240] Negotiation successful
0812 00:02:13.290625 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"mutex_wait_us":32}
I20260812 00:02:13.290872 24495 tablet_service.cc:1467] Processing CreateTablet for tablet d29f2e4f127e4563894007a80a08df80 (DEFAULT_TABLE table=test-table [id=dba709a3b0f244018476e8a6cade396c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:02:13.290899 25279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:13.287594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59926 (local address 127.11.206.67:43193)
0812 00:02:13.287695 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:13.287697 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:13.287705 (+ 8us) server_negotiation.cc:407] Connection header received
0812 00:02:13.287739 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:13.287740 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:13.287751 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:13.287821 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:02:13.288005 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:13.288505 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:13.289991 (+ 1486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:13.290423 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:13.290770 (+ 347us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:13.290785 (+ 15us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:13.290804 (+ 19us) server_negotiation.cc:299] Negotiation successful
0812 00:02:13.290843 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81,"thread_start_us":57,"threads_started":1}
I20260812 00:02:13.291002 24495 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d29f2e4f127e4563894007a80a08df80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:02:13.291093 25003 tablet_service.cc:1467] Processing CreateTablet for tablet d29f2e4f127e4563894007a80a08df80 (DEFAULT_TABLE table=test-table [id=dba709a3b0f244018476e8a6cade396c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:02:13.291190 25003 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d29f2e4f127e4563894007a80a08df80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:02:13.291618 25248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:13.287383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.66:32883 (local address 127.0.0.1:43186)
0812 00:02:13.287445 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:13.287455 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:13.287503 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:13.287847 (+ 344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:13.287848 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:13.287850 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:02:13.287895 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:13.287896 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:13.288843 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:13.288844 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:13.289932 (+ 1088us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:13.289934 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:13.291387 (+ 1453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:13.291388 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:13.291462 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:13.291466 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:02:13.291503 (+ 37us) client_negotiation.cc:240] Negotiation successful
0812 00:02:13.291544 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49,"mutex_wait_us":27}
I20260812 00:02:13.292078 25272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:13.287459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43186 (local address 127.11.206.66:32883)
0812 00:02:13.287719 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:13.287722 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:13.287729 (+ 7us) server_negotiation.cc:407] Connection header received
0812 00:02:13.287755 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:13.287756 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:13.287766 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:13.287952 (+ 186us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:02:13.287990 (+ 38us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:13.288755 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:13.290017 (+ 1262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:13.290551 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:13.291924 (+ 1373us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:13.291942 (+ 18us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:13.291962 (+ 20us) server_negotiation.cc:299] Negotiation successful
0812 00:02:13.292008 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":237,"thread_start_us":65,"threads_started":1}
I20260812 00:02:13.292404 25281 tablet_bootstrap.cc:492] T d29f2e4f127e4563894007a80a08df80 P 39630eacbe4b41bbb157bb7b8d99c4f4: Bootstrap starting.
I20260812 00:02:13.292400 24773 tablet_service.cc:1467] Processing CreateTablet for tablet d29f2e4f127e4563894007a80a08df80 (DEFAULT_TABLE table=test-table [id=dba709a3b0f244018476e8a6cade396c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:02:13.292510 24773 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d29f2e4f127e4563894007a80a08df80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:02:13.292790 25281 tablet_bootstrap.cc:654] T d29f2e4f127e4563894007a80a08df80 P 39630eacbe4b41bbb157bb7b8d99c4f4: Neither blocks nor log segments found. Creating new log.
I20260812 00:02:13.293329 25281 tablet_bootstrap.cc:492] T d29f2e4f127e4563894007a80a08df80 P 39630eacbe4b41bbb157bb7b8d99c4f4: No bootstrap required, opened a new log
I20260812 00:02:13.293402 25281 ts_tablet_manager.cc:1397] T d29f2e4f127e4563894007a80a08df80 P 39630eacbe4b41bbb157bb7b8d99c4f4: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 00:02:13.293512 25281 raft_consensus.cc:348] T d29f2e4f127e4563894007a80a08df80 P 39630eacbe4b41bbb157bb7b8d99c4f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4bdd64c3f904386ad369366b7824e03" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 32883 } } peers { permanent_uuid: "39630eacbe4b41bbb157bb7b8d99c4f4" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 43193 } } peers { permanent_uuid: "d91daca07bd94d6fb77661eb0190366e" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 45231 } }
I20260812 00:02:13.293579 25281 raft_consensus.cc:374] T d29f2e4f127e4563894007a80a08df80 P 39630eacbe4b41bbb157bb7b8d99c4f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:02:13.293597 25281 raft_consensus.cc:729] T d29f2e4f127e4563894007a80a08df80 P 39630eacbe4b41bbb157bb7b8d99c4f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39630eacbe4b41bbb157bb7b8d99c4f4, State: Initialized, Role: FOLLOWER
I20260812 00:02:13.293646 25281 consensus_queue.cc:260] T d29f2e4f127e4563894007a80a08df80 P 39630eacbe4b41bbb157bb7b8d99c4f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4bdd64c3f904386ad369366b7824e03" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 32883 } } peers { permanent_uuid: "39630eacbe4b41bbb157bb7b8d99c4f4" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 43193 } } peers { permanent_uuid: "d91daca07bd94d6fb77661eb0190366e" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 45231 } }
I20260812 00:02:13.293828 25281 ts_tablet_manager.cc:1428] T d29f2e4f127e4563894007a80a08df80 P 39630eacbe4b41bbb157bb7b8d99c4f4: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:13.293987 25287 tablet_bootstrap.cc:492] T d29f2e4f127e4563894007a80a08df80 P b4bdd64c3f904386ad369366b7824e03: Bootstrap starting.
I20260812 00:02:13.294183 25288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:13.293955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:40221 (local address 127.11.206.67:39215)
0812 00:02:13.294101 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:13.294143 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:40221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":89,"threads_started":1}
I20260812 00:02:13.294338 25287 tablet_bootstrap.cc:654] T d29f2e4f127e4563894007a80a08df80 P b4bdd64c3f904386ad369366b7824e03: Neither blocks nor log segments found. Creating new log.
I20260812 00:02:13.294637 25288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:13.294388 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:40221 (local address 127.11.206.67:37697)
0812 00:02:13.294584 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:13.294614 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:40221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":177}
I20260812 00:02:13.294627 25282 tablet_bootstrap.cc:492] T d29f2e4f127e4563894007a80a08df80 P d91daca07bd94d6fb77661eb0190366e: Bootstrap starting.
I20260812 00:02:13.294691 25130 heartbeater.cc:503] Master 127.11.206.125:46169 was elected leader, sending a full tablet report...
I20260812 00:02:13.295055 25282 tablet_bootstrap.cc:654] T d29f2e4f127e4563894007a80a08df80 P d91daca07bd94d6fb77661eb0190366e: Neither blocks nor log segments found. Creating new log.
I20260812 00:02:13.295101 25287 tablet_bootstrap.cc:492] T d29f2e4f127e4563894007a80a08df80 P b4bdd64c3f904386ad369366b7824e03: No bootstrap required, opened a new log
I20260812 00:02:13.295156 25287 ts_tablet_manager.cc:1397] T d29f2e4f127e4563894007a80a08df80 P b4bdd64c3f904386ad369366b7824e03: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 00:02:13.295267 25287 raft_consensus.cc:348] T d29f2e4f127e4563894007a80a08df80 P b4bdd64c3f904386ad369366b7824e03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4bdd64c3f904386ad369366b7824e03" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 32883 } } peers { permanent_uuid: "39630eacbe4b41bbb157bb7b8d99c4f4" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 43193 } } peers { permanent_uuid: "d91daca07bd94d6fb77661eb0190366e" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 45231 } }
I20260812 00:02:13.295336 25287 raft_consensus.cc:374] T d29f2e4f127e4563894007a80a08df80 P b4bdd64c3f904386ad369366b7824e03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:02:13.295348 25287 raft_consensus.cc:729] T d29f2e4f127e4563894007a80a08df80 P b4bdd64c3f904386ad369366b7824e03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4bdd64c3f904386ad369366b7824e03, State: Initialized, Role: FOLLOWER
I20260812 00:02:13.295382 25287 consensus_queue.cc:260] T d29f2e4f127e4563894007a80a08df80 P b4bdd64c3f904386ad369366b7824e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4bdd64c3f904386ad369366b7824e03" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 32883 } } peers { permanent_uuid: "39630eacbe4b41bbb157bb7b8d99c4f4" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 43193 } } peers { permanent_uuid: "d91daca07bd94d6fb77661eb0190366e" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 45231 } }
I20260812 00:02:13.295513 25287 ts_tablet_manager.cc:1428] T d29f2e4f127e4563894007a80a08df80 P b4bdd64c3f904386ad369366b7824e03: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260812 00:02:13.295578 25282 tablet_bootstrap.cc:492] T d29f2e4f127e4563894007a80a08df80 P d91daca07bd94d6fb77661eb0190366e: No bootstrap required, opened a new log
I20260812 00:02:13.295615 25282 ts_tablet_manager.cc:1397] T d29f2e4f127e4563894007a80a08df80 P d91daca07bd94d6fb77661eb0190366e: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 00:02:13.295725 25282 raft_consensus.cc:348] T d29f2e4f127e4563894007a80a08df80 P d91daca07bd94d6fb77661eb0190366e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4bdd64c3f904386ad369366b7824e03" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 32883 } } peers { permanent_uuid: "39630eacbe4b41bbb157bb7b8d99c4f4" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 43193 } } peers { permanent_uuid: "d91daca07bd94d6fb77661eb0190366e" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 45231 } }
I20260812 00:02:13.295790 25282 raft_consensus.cc:374] T d29f2e4f127e4563894007a80a08df80 P d91daca07bd94d6fb77661eb0190366e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:02:13.295809 25282 raft_consensus.cc:729] T d29f2e4f127e4563894007a80a08df80 P d91daca07bd94d6fb77661eb0190366e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d91daca07bd94d6fb77661eb0190366e, State: Initialized, Role: FOLLOWER
I20260812 00:02:13.295867 25282 consensus_queue.cc:260] T d29f2e4f127e4563894007a80a08df80 P d91daca07bd94d6fb77661eb0190366e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4bdd64c3f904386ad369366b7824e03" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 32883 } } peers { permanent_uuid: "39630eacbe4b41bbb157bb7b8d99c4f4" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 43193 } } peers { permanent_uuid: "d91daca07bd94d6fb77661eb0190366e" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 45231 } }
I20260812 00:02:13.296033 25282 ts_tablet_manager.cc:1428] T d29f2e4f127e4563894007a80a08df80 P d91daca07bd94d6fb77661eb0190366e: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260812 00:02:13.296311 25300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:13.295933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:40221 (local address 127.11.206.66:35067)
0812 00:02:13.296232 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:13.296279 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:40221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":277,"thread_start_us":85,"threads_started":1}
I20260812 00:02:13.296350 25301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:13.296154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:40221 (local address 127.11.206.65:49603)
0812 00:02:13.296276 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:13.296311 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:40221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":93,"threads_started":1}
I20260812 00:02:13.296675 25301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:13.296597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:40221 (local address 127.11.206.65:38019)
0812 00:02:13.296632 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:13.296653 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:40221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
I20260812 00:02:13.296847 24889 heartbeater.cc:503] Master 127.11.206.125:46169 was elected leader, sending a full tablet report...
I20260812 00:02:13.296919 25300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:13.296835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:40221 (local address 127.11.206.66:49663)
0812 00:02:13.296874 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:13.296894 (+ 20us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:40221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260812 00:02:13.346685 25131 tablet.cc:2369] T d29f2e4f127e4563894007a80a08df80 P 39630eacbe4b41bbb157bb7b8d99c4f4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:02:13.362398 25295 raft_consensus.cc:482] T d29f2e4f127e4563894007a80a08df80 P b4bdd64c3f904386ad369366b7824e03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:02:13.362494 25295 raft_consensus.cc:504] T d29f2e4f127e4563894007a80a08df80 P b4bdd64c3f904386ad369366b7824e03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4bdd64c3f904386ad369366b7824e03" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 32883 } } peers { permanent_uuid: "39630eacbe4b41bbb157bb7b8d99c4f4" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 43193 } } peers { permanent_uuid: "d91daca07bd94d6fb77661eb0190366e" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 45231 } }
I20260812 00:02:13.362661 25295 leader_election.cc:288] T d29f2e4f127e4563894007a80a08df80 P b4bdd64c3f904386ad369366b7824e03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 39630eacbe4b41bbb157bb7b8d99c4f4 (127.11.206.67:43193), d91daca07bd94d6fb77661eb0190366e (127.11.206.65:45231)
I20260812 00:02:13.362851 25048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d29f2e4f127e4563894007a80a08df80" candidate_uuid: "b4bdd64c3f904386ad369366b7824e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39630eacbe4b41bbb157bb7b8d99c4f4" is_pre_election: true
I20260812 00:02:13.362876 24531 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d29f2e4f127e4563894007a80a08df80" candidate_uuid: "b4bdd64c3f904386ad369366b7824e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d91daca07bd94d6fb77661eb0190366e" is_pre_election: true
I20260812 00:02:13.362941 25048 raft_consensus.cc:2454] T d29f2e4f127e4563894007a80a08df80 P 39630eacbe4b41bbb157bb7b8d99c4f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4bdd64c3f904386ad369366b7824e03 in term 0.
I20260812 00:02:13.362972 24531 raft_consensus.cc:2454] T d29f2e4f127e4563894007a80a08df80 P d91daca07bd94d6fb77661eb0190366e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4bdd64c3f904386ad369366b7824e03 in term 0.
I20260812 00:02:13.363092 24686 leader_election.cc:302] T d29f2e4f127e4563894007a80a08df80 P b4bdd64c3f904386ad369366b7824e03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39630eacbe4b41bbb157bb7b8d99c4f4, b4bdd64c3f904386ad369366b7824e03; no voters:
I20260812 00:02:13.363198 25295 raft_consensus.cc:2781] T d29f2e4f127e4563894007a80a08df80 P b4bdd64c3f904386ad369366b7824e03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:02:13.363246 25295 raft_consensus.cc:482] T d29f2e4f127e4563894007a80a08df80 P b4bdd64c3f904386ad369366b7824e03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:02:13.363286 25295 raft_consensus.cc:3037] T d29f2e4f127e4563894007a80a08df80 P b4bdd64c3f904386ad369366b7824e03 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:02:13.363981 25295 raft_consensus.cc:504] T d29f2e4f127e4563894007a80a08df80 P b4bdd64c3f904386ad369366b7824e03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4bdd64c3f904386ad369366b7824e03" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 32883 } } peers { permanent_uuid: "39630eacbe4b41bbb157bb7b8d99c4f4" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 43193 } } peers { permanent_uuid: "d91daca07bd94d6fb77661eb0190366e" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 45231 } }
I20260812 00:02:13.364099 25295 leader_election.cc:288] T d29f2e4f127e4563894007a80a08df80 P b4bdd64c3f904386ad369366b7824e03 [CANDIDATE]: Term 1 election: Requested vote from peers 39630eacbe4b41bbb157bb7b8d99c4f4 (127.11.206.67:43193), d91daca07bd94d6fb77661eb0190366e (127.11.206.65:45231)
I20260812 00:02:13.364256 25048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d29f2e4f127e4563894007a80a08df80" candidate_uuid: "b4bdd64c3f904386ad369366b7824e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39630eacbe4b41bbb157bb7b8d99c4f4"
I20260812 00:02:13.364261 24531 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d29f2e4f127e4563894007a80a08df80" candidate_uuid: "b4bdd64c3f904386ad369366b7824e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d91daca07bd94d6fb77661eb0190366e"
I20260812 00:02:13.364326 25048 raft_consensus.cc:3037] T d29f2e4f127e4563894007a80a08df80 P 39630eacbe4b41bbb157bb7b8d99c4f4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:02:13.364326 24531 raft_consensus.cc:3037] T d29f2e4f127e4563894007a80a08df80 P d91daca07bd94d6fb77661eb0190366e [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:02:13.364876 25048 raft_consensus.cc:2454] T d29f2e4f127e4563894007a80a08df80 P 39630eacbe4b41bbb157bb7b8d99c4f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4bdd64c3f904386ad369366b7824e03 in term 1.
I20260812 00:02:13.364902 24531 raft_consensus.cc:2454] T d29f2e4f127e4563894007a80a08df80 P d91daca07bd94d6fb77661eb0190366e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4bdd64c3f904386ad369366b7824e03 in term 1.
I20260812 00:02:13.365047 24685 leader_election.cc:302] T d29f2e4f127e4563894007a80a08df80 P b4bdd64c3f904386ad369366b7824e03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b4bdd64c3f904386ad369366b7824e03, d91daca07bd94d6fb77661eb0190366e; no voters:
I20260812 00:02:13.365154 25295 raft_consensus.cc:2781] T d29f2e4f127e4563894007a80a08df80 P b4bdd64c3f904386ad369366b7824e03 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:02:13.365316 25295 raft_consensus.cc:686] T d29f2e4f127e4563894007a80a08df80 P b4bdd64c3f904386ad369366b7824e03 [term 1 LEADER]: Becoming Leader. State: Replica: b4bdd64c3f904386ad369366b7824e03, State: Running, Role: LEADER
I20260812 00:02:13.365566 25295 consensus_queue.cc:237] T d29f2e4f127e4563894007a80a08df80 P b4bdd64c3f904386ad369366b7824e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4bdd64c3f904386ad369366b7824e03" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 32883 } } peers { permanent_uuid: "39630eacbe4b41bbb157bb7b8d99c4f4" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 43193 } } peers { permanent_uuid: "d91daca07bd94d6fb77661eb0190366e" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 45231 } }
I20260812 00:02:13.365631 25300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:13.365526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:40221 (local address 127.11.206.66:52101)
0812 00:02:13.365573 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:13.365606 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:40221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260812 00:02:13.366191 23937 catalog_manager.cc:5495] T d29f2e4f127e4563894007a80a08df80 P b4bdd64c3f904386ad369366b7824e03 reported cstate change: term changed from 0 to 1, leader changed from <none> to b4bdd64c3f904386ad369366b7824e03 (127.11.206.66). New cstate: current_term: 1 leader_uuid: "b4bdd64c3f904386ad369366b7824e03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4bdd64c3f904386ad369366b7824e03" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 32883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39630eacbe4b41bbb157bb7b8d99c4f4" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 43193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d91daca07bd94d6fb77661eb0190366e" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 45231 } health_report { overall_health: UNKNOWN } } }
I20260812 00:02:13.381394 25272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:13.379332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43192 (local address 127.11.206.66:32883)
0812 00:02:13.379394 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:13.379396 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:13.379405 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:02:13.379462 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:13.379462 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:13.379471 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:13.379516 (+ 45us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:02:13.379645 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:13.380112 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:13.380836 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:13.381010 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:13.381053 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:13.381179 (+ 126us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:02:13.381202 (+ 23us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:02:13.381233 (+ 31us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:13.381290 (+ 57us) server_negotiation.cc:299] Negotiation successful
0812 00:02:13.381307 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 00:02:13.382292 24531 raft_consensus.cc:1261] T d29f2e4f127e4563894007a80a08df80 P d91daca07bd94d6fb77661eb0190366e [term 1 FOLLOWER]: Refusing update from remote peer b4bdd64c3f904386ad369366b7824e03: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:02:13.382323 25048 raft_consensus.cc:1261] T d29f2e4f127e4563894007a80a08df80 P 39630eacbe4b41bbb157bb7b8d99c4f4 [term 1 FOLLOWER]: Refusing update from remote peer b4bdd64c3f904386ad369366b7824e03: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:02:13.382541 25302 consensus_queue.cc:1035] T d29f2e4f127e4563894007a80a08df80 P b4bdd64c3f904386ad369366b7824e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39630eacbe4b41bbb157bb7b8d99c4f4" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 43193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:02:13.382656 25295 consensus_queue.cc:1035] T d29f2e4f127e4563894007a80a08df80 P b4bdd64c3f904386ad369366b7824e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d91daca07bd94d6fb77661eb0190366e" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 45231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:02:13.383440 25288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:13.383258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:40221 (local address 127.11.206.67:43841)
0812 00:02:13.383364 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:13.383405 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:40221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
I20260812 00:02:13.383838 25301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:13.383738 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:40221 (local address 127.11.206.65:51825)
0812 00:02:13.383781 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:13.383807 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:40221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260812 00:02:13.384096 24637 heartbeater.cc:503] Master 127.11.206.125:46169 was elected leader, sending a full tablet report...
I20260812 00:02:13.384682 25300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:13.384583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:40221 (local address 127.11.206.66:41057)
0812 00:02:13.384629 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:13.384654 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:40221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260812 00:02:13.385247 25301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:13.385166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:40221 (local address 127.11.206.65:52971)
0812 00:02:13.385203 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:13.385224 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:40221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
I20260812 00:02:13.385239 25288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:13.385060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:40221 (local address 127.11.206.67:58525)
0812 00:02:13.385181 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:13.385211 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:40221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105}
I20260812 00:02:13.385463 25311 mvcc.cc:205] Tried to move back new op lower bound from 7317475055132069888 to 7317475055065722880. Current Snapshot: MvccSnapshot[applied={T|T < 7317475055132069888}]
I20260812 00:02:13.386345 23937 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47096:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:02:13.386442 23937 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47096:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:02:13.387622 23937 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1917b175bf5f470494dba47305c7c669: Sending DeleteTablet for 3 replicas of tablet d29f2e4f127e4563894007a80a08df80
I20260812 00:02:13.387907 25003 tablet_service.cc:1514] Processing DeleteTablet for tablet d29f2e4f127e4563894007a80a08df80 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:02:13 UTC) from {username='oryx', principal='oryx/127.11.206.125@KRBTEST.COM'} at 127.0.0.1:59926
I20260812 00:02:13.387928 24773 tablet_service.cc:1514] Processing DeleteTablet for tablet d29f2e4f127e4563894007a80a08df80 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:02:13 UTC) from {username='oryx', principal='oryx/127.11.206.125@KRBTEST.COM'} at 127.0.0.1:43186
I20260812 00:02:13.388130 24495 tablet_service.cc:1514] Processing DeleteTablet for tablet d29f2e4f127e4563894007a80a08df80 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:02:13 UTC) from {username='oryx', principal='oryx/127.11.206.125@KRBTEST.COM'} at 127.0.0.1:38666
I20260812 00:02:13.388281 25329 tablet_replica.cc:330] T d29f2e4f127e4563894007a80a08df80 P b4bdd64c3f904386ad369366b7824e03: stopping tablet replica
I20260812 00:02:13.388345 25329 raft_consensus.cc:2229] T d29f2e4f127e4563894007a80a08df80 P b4bdd64c3f904386ad369366b7824e03 [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:02:13.388404 25329 raft_consensus.cc:2258] T d29f2e4f127e4563894007a80a08df80 P b4bdd64c3f904386ad369366b7824e03 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:02:13.388406 25331 tablet_replica.cc:330] T d29f2e4f127e4563894007a80a08df80 P d91daca07bd94d6fb77661eb0190366e: stopping tablet replica
I20260812 00:02:13.388463 25331 raft_consensus.cc:2229] T d29f2e4f127e4563894007a80a08df80 P d91daca07bd94d6fb77661eb0190366e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:02:13.388504 25331 raft_consensus.cc:2258] T d29f2e4f127e4563894007a80a08df80 P d91daca07bd94d6fb77661eb0190366e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:02:13.388514 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 24215
I20260812 00:02:13.398259 25329 ts_tablet_manager.cc:1905] T d29f2e4f127e4563894007a80a08df80 P b4bdd64c3f904386ad369366b7824e03: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:02:13.400364 25328 tablet_replica.cc:330] T d29f2e4f127e4563894007a80a08df80 P 39630eacbe4b41bbb157bb7b8d99c4f4: stopping tablet replica
I20260812 00:02:13.400461 25328 raft_consensus.cc:2229] T d29f2e4f127e4563894007a80a08df80 P 39630eacbe4b41bbb157bb7b8d99c4f4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:02:13.400542 25328 raft_consensus.cc:2258] T d29f2e4f127e4563894007a80a08df80 P 39630eacbe4b41bbb157bb7b8d99c4f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:02:13.401032 25329 ts_tablet_manager.cc:1918] T d29f2e4f127e4563894007a80a08df80 P b4bdd64c3f904386ad369366b7824e03: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:02:13.401103 25329 log.cc:1196] T d29f2e4f127e4563894007a80a08df80 P b4bdd64c3f904386ad369366b7824e03: Deleting WAL directory at /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-1/wal/wals/d29f2e4f127e4563894007a80a08df80
I20260812 00:02:13.401273 25328 ts_tablet_manager.cc:1905] T d29f2e4f127e4563894007a80a08df80 P 39630eacbe4b41bbb157bb7b8d99c4f4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:02:13.401399 25329 ts_tablet_manager.cc:1939] T d29f2e4f127e4563894007a80a08df80 P b4bdd64c3f904386ad369366b7824e03: Deleting consensus metadata
I20260812 00:02:13.401798 23913 catalog_manager.cc:4841] TS b4bdd64c3f904386ad369366b7824e03 (127.11.206.66:32883): tablet d29f2e4f127e4563894007a80a08df80 (table test-table [id=dba709a3b0f244018476e8a6cade396c]) successfully deleted
I20260812 00:02:13.402702 25328 ts_tablet_manager.cc:1918] T d29f2e4f127e4563894007a80a08df80 P 39630eacbe4b41bbb157bb7b8d99c4f4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:02:13.402771 25328 log.cc:1196] T d29f2e4f127e4563894007a80a08df80 P 39630eacbe4b41bbb157bb7b8d99c4f4: Deleting WAL directory at /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786492899949492-12089-0/minicluster-data/ts-2/wal/wals/d29f2e4f127e4563894007a80a08df80
I20260812 00:02:13.402957 25328 ts_tablet_manager.cc:1939] T d29f2e4f127e4563894007a80a08df80 P 39630eacbe4b41bbb157bb7b8d99c4f4: Deleting consensus metadata
I20260812 00:02:13.403324 23909 catalog_manager.cc:4841] TS 39630eacbe4b41bbb157bb7b8d99c4f4 (127.11.206.67:43193): tablet d29f2e4f127e4563894007a80a08df80 (table test-table [id=dba709a3b0f244018476e8a6cade396c]) successfully deleted
I20260812 00:02:13.405942 25248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:13.405821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.65:45231 (local address 127.0.0.1:38672)
0812 00:02:13.405873 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:13.405905 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.65:45231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260812 00:02:13.405973 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 24650
W20260812 00:02:13.406106 23907 catalog_manager.cc:4584] TS d91daca07bd94d6fb77661eb0190366e (127.11.206.65:45231): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d29f2e4f127e4563894007a80a08df80: Network error: Client connection negotiation failed: client connection to 127.11.206.65:45231: connect: Connection refused (error 111)
I20260812 00:02:13.422565 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 24895
I20260812 00:02:13.437748 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 23697
I20260812 00:02:13.455724 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 24039
2026-08-12T00:02:13Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (4776 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:02:13 dist-test-slave-f0tn krb5kdc[25334](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:02:13 dist-test-slave-f0tn krb5kdc[25334](info): set up 2 sockets
Aug 12 00:02:13 dist-test-slave-f0tn krb5kdc[25334](info): commencing operation
krb5kdc: starting...
W20260812 00:02:14.641350 12089 mini_kdc.cc:121] Time spent starting KDC: real 1.161s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/krb5kdc/test-user.keytab.
Aug 12 00:02:14 dist-test-slave-f0tn krb5kdc[25334](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492934, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:02:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:02:14Z Disabled control of system clock
WARNING: no policy specified for oryx/127.11.206.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.206.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.206.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/krb5kdc/oryx_127.11.206.126.keytab.
Entry for principal oryx/127.11.206.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/krb5kdc/oryx_127.11.206.126.keytab.
I20260812 00:02:14.755604 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:36983
--webserver_interface=127.11.206.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/krb5kdc/oryx_127.11.206.126.keytab
--principal=oryx/127.11.206.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:41963
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.206.126:36983
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:02:14.836016 25354 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:02:14.836236 25354 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:02:14.836258 25354 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:02:14.837363 25354 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:02:14.837419 25354 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260812 00:02:14.837432 25354 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:02:14.837445 25354 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:02:14.837455 25354 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:02:14.837466 25354 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:02:14.838939 25354 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:41963
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.206.126:36983
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/krb5kdc/oryx_127.11.206.126.keytab
--principal=oryx/127.11.206.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:36983
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.206.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25354
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:02:14.839143 25354 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:02:14.839327 25354 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:02:14.844153 25368 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:14.844134 25366 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:14.844143 25365 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:14.844412 25354 server_base.cc:1034] running on GCE node
I20260812 00:02:14.844646 25354 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:02:14.844931 25354 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:02:14.846073 25354 hybrid_clock.cc:648] HybridClock initialized: now 1786492934846065 us; error 33 us; skew 500 ppm
Aug 12 00:02:14 dist-test-slave-f0tn krb5kdc[25334](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492934, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.206.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:02:14.848402 25354 init.cc:377] Logged in from keytab as oryx/127.11.206.126@KRBTEST.COM (short username oryx)
I20260812 00:02:14.848824 25354 webserver.cc:460] Webserver started at http://127.11.206.126:45353/ using document root <none> and password file <none>
I20260812 00:02:14.849011 25354 fs_manager.cc:359] Metadata directory not provided
I20260812 00:02:14.849050 25354 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:02:14.849143 25354 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:02:14.850209 25354 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/minicluster-data/master-0/data/instance:
uuid: "9aff16bf5c77499a83c2e866ba8d27a9"
format_stamp: "Formatted at 2026-08-12 00:02:14 on dist-test-slave-f0tn"
server_key: "1b609ce5e646261b29ab989d8872d2a6"
server_key_iv: "abf1addbbfbfe8dee2326e8bba172f4e"
server_key_version: "encryptionkey@0"
I20260812 00:02:14.850493 25354 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/minicluster-data/master-0/wal/instance:
uuid: "9aff16bf5c77499a83c2e866ba8d27a9"
format_stamp: "Formatted at 2026-08-12 00:02:14 on dist-test-slave-f0tn"
server_key: "1b609ce5e646261b29ab989d8872d2a6"
server_key_iv: "abf1addbbfbfe8dee2326e8bba172f4e"
server_key_version: "encryptionkey@0"
I20260812 00:02:14.851689 25354 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260812 00:02:14.852339 25381 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:14.852509 25354 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 00:02:14.852594 25354 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/minicluster-data/master-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/minicluster-data/master-0/wal
uuid: "9aff16bf5c77499a83c2e866ba8d27a9"
format_stamp: "Formatted at 2026-08-12 00:02:14 on dist-test-slave-f0tn"
server_key: "1b609ce5e646261b29ab989d8872d2a6"
server_key_iv: "abf1addbbfbfe8dee2326e8bba172f4e"
server_key_version: "encryptionkey@0"
I20260812 00:02:14.852648 25354 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:02:14.867167 25354 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:02:14.869040 25354 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:02:14.869155 25354 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:02:14.873636 25354 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.126:36983
I20260812 00:02:14.873697 25491 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.126:36983 every 8 connection(s)
I20260812 00:02:14.874002 25354 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
I20260812 00:02:14.874673 25495 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:02:14.876960 25495 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9aff16bf5c77499a83c2e866ba8d27a9: Bootstrap starting.
I20260812 00:02:14.877565 25495 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9aff16bf5c77499a83c2e866ba8d27a9: Neither blocks nor log segments found. Creating new log.
I20260812 00:02:14.877841 25495 log.cc:824] T 00000000000000000000000000000000 P 9aff16bf5c77499a83c2e866ba8d27a9: Log is configured to *not* fsync() on all Append() calls
I20260812 00:02:14.878459 25495 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9aff16bf5c77499a83c2e866ba8d27a9: No bootstrap required, opened a new log
I20260812 00:02:14.880535 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 25354
I20260812 00:02:14.880640 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/minicluster-data/master-0/wal/instance
I20260812 00:02:14.880556 25495 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9aff16bf5c77499a83c2e866ba8d27a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9aff16bf5c77499a83c2e866ba8d27a9" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 36983 } }
I20260812 00:02:14.880745 25495 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9aff16bf5c77499a83c2e866ba8d27a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:02:14.880788 25495 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9aff16bf5c77499a83c2e866ba8d27a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9aff16bf5c77499a83c2e866ba8d27a9, State: Initialized, Role: FOLLOWER
I20260812 00:02:14.880852 12089 external_mini_cluster.cc:1428] Setting key 314ab6cfcc6c0c310381b2b7a258f88c
I20260812 00:02:14.880937 25495 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9aff16bf5c77499a83c2e866ba8d27a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9aff16bf5c77499a83c2e866ba8d27a9" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 36983 } }
I20260812 00:02:14.881021 25495 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9aff16bf5c77499a83c2e866ba8d27a9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:02:14.881054 25495 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9aff16bf5c77499a83c2e866ba8d27a9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:02:14.881105 25495 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9aff16bf5c77499a83c2e866ba8d27a9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:02:14.881742 25495 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9aff16bf5c77499a83c2e866ba8d27a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9aff16bf5c77499a83c2e866ba8d27a9" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 36983 } }
I20260812 00:02:14.881847 25495 leader_election.cc:302] T 00000000000000000000000000000000 P 9aff16bf5c77499a83c2e866ba8d27a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9aff16bf5c77499a83c2e866ba8d27a9; no voters:
I20260812 00:02:14.882010 25495 leader_election.cc:288] T 00000000000000000000000000000000 P 9aff16bf5c77499a83c2e866ba8d27a9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:02:14.882053 25508 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9aff16bf5c77499a83c2e866ba8d27a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:02:14.882223 25508 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9aff16bf5c77499a83c2e866ba8d27a9 [term 1 LEADER]: Becoming Leader. State: Replica: 9aff16bf5c77499a83c2e866ba8d27a9, State: Running, Role: LEADER
I20260812 00:02:14.882372 25495 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9aff16bf5c77499a83c2e866ba8d27a9 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:02:14.882370 25508 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9aff16bf5c77499a83c2e866ba8d27a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9aff16bf5c77499a83c2e866ba8d27a9" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 36983 } }
I20260812 00:02:14.882953 25511 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9aff16bf5c77499a83c2e866ba8d27a9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9aff16bf5c77499a83c2e866ba8d27a9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9aff16bf5c77499a83c2e866ba8d27a9" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 36983 } } }
I20260812 00:02:14.883070 25511 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9aff16bf5c77499a83c2e866ba8d27a9 [sys.catalog]: This master's current role is: LEADER
I20260812 00:02:14.883409 25509 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9aff16bf5c77499a83c2e866ba8d27a9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9aff16bf5c77499a83c2e866ba8d27a9. Latest consensus state: current_term: 1 leader_uuid: "9aff16bf5c77499a83c2e866ba8d27a9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9aff16bf5c77499a83c2e866ba8d27a9" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 36983 } } }
I20260812 00:02:14.883549 25509 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9aff16bf5c77499a83c2e866ba8d27a9 [sys.catalog]: This master's current role is: LEADER
I20260812 00:02:14.883756 25523 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:02:14.884325 25523 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:02:14.885932 25523 catalog_manager.cc:1347] Generated new cluster ID: 2fcc98b51cdc41f8bd7b3c9252d4b308
I20260812 00:02:14.885994 25523 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 00:02:14 dist-test-slave-f0tn krb5kdc[25334](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492934, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM
I20260812 00:02:14.891801 25503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:14.881361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60390 (local address 127.11.206.126:36983)
0812 00:02:14.881593 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:14.881603 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:14.881641 (+ 38us) server_negotiation.cc:407] Connection header received
0812 00:02:14.881749 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:14.881755 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:14.881813 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:14.881949 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:14.882794 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:14.884207 (+ 1413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:14.885277 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:14.885844 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:14.885956 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:14.888249 (+ 2293us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:14.888252 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:14.888252 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:14.888262 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:14.890357 (+ 2095us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:14.890705 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:14.890708 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:14.890708 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:14.890804 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:14.890990 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:14.890990 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:14.890991 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:14.891234 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:14.891379 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:14.891484 (+ 105us) server_negotiation.cc:299] Negotiation successful
0812 00:02:14.891616 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":174,"thread_start_us":93,"threads_started":1}
I20260812 00:02:14.899384 25523 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:02:14.899869 25523 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:02:14.902040 25523 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9aff16bf5c77499a83c2e866ba8d27a9: Generated new TSK 0
I20260812 00:02:14.902192 25523 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.11.206.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.206.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.206.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/krb5kdc/oryx_127.11.206.65.keytab.
Entry for principal oryx/127.11.206.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/krb5kdc/oryx_127.11.206.65.keytab.
I20260812 00:02:14.929926 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.65:0
--local_ip_for_outbound_sockets=127.11.206.65
--webserver_interface=127.11.206.65
--webserver_port=0
--tserver_master_addrs=127.11.206.126:36983
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/krb5kdc/oryx_127.11.206.65.keytab
--principal=oryx/127.11.206.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:41963
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:02:15.025322 25548 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:02:15.025547 25548 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:02:15.025568 25548 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:02:15.026703 25548 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:02:15.026754 25548 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:02:15.026772 25548 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 00:02:15.026788 25548 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.65
I20260812 00:02:15.028306 25548 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:41963
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/krb5kdc/oryx_127.11.206.65.keytab
--principal=oryx/127.11.206.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.206.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.206.126:36983
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25548
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.65
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:02:15.028553 25548 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:02:15.028795 25548 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:02:15.033665 25560 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:15.033680 25566 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:15.033792 25563 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:15.033895 25548 server_base.cc:1034] running on GCE node
I20260812 00:02:15.034083 25548 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:02:15.034307 25548 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:02:15.035475 25548 hybrid_clock.cc:648] HybridClock initialized: now 1786492935035451 us; error 38 us; skew 500 ppm
Aug 12 00:02:15 dist-test-slave-f0tn krb5kdc[25334](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492935, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.206.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:02:15.038061 25548 init.cc:377] Logged in from keytab as oryx/127.11.206.65@KRBTEST.COM (short username oryx)
I20260812 00:02:15.038473 25548 webserver.cc:460] Webserver started at http://127.11.206.65:35327/ using document root <none> and password file <none>
I20260812 00:02:15.038693 25548 fs_manager.cc:359] Metadata directory not provided
I20260812 00:02:15.038741 25548 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:02:15.038862 25548 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:02:15.039893 25548 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/minicluster-data/ts-0/data/instance:
uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0"
format_stamp: "Formatted at 2026-08-12 00:02:15 on dist-test-slave-f0tn"
server_key: "d8fc594de61b9425e5526442682ea4dc"
server_key_iv: "e93c4e31d4c6dca3909f4dda8b06e64f"
server_key_version: "encryptionkey@0"
I20260812 00:02:15.040235 25548 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/minicluster-data/ts-0/wal/instance:
uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0"
format_stamp: "Formatted at 2026-08-12 00:02:15 on dist-test-slave-f0tn"
server_key: "d8fc594de61b9425e5526442682ea4dc"
server_key_iv: "e93c4e31d4c6dca3909f4dda8b06e64f"
server_key_version: "encryptionkey@0"
I20260812 00:02:15.041502 25548 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 00:02:15.042243 25582 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:15.042407 25548 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:02:15.042490 25548 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/minicluster-data/ts-0/wal
uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0"
format_stamp: "Formatted at 2026-08-12 00:02:15 on dist-test-slave-f0tn"
server_key: "d8fc594de61b9425e5526442682ea4dc"
server_key_iv: "e93c4e31d4c6dca3909f4dda8b06e64f"
server_key_version: "encryptionkey@0"
I20260812 00:02:15.042551 25548 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:02:15.054776 25548 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:02:15.056885 25548 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:02:15.056998 25548 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:02:15.057518 25548 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:02:15.057559 25548 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:15.057580 25548 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:02:15.057592 25548 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:15.063767 25548 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.65:37549
I20260812 00:02:15.064109 25548 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
Aug 12 00:02:15 dist-test-slave-f0tn krb5kdc[25334](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492935, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.206.65@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM
I20260812 00:02:15.064371 25808 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.65:37549 every 8 connection(s)
I20260812 00:02:15.065562 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 25548
I20260812 00:02:15.065662 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/minicluster-data/ts-0/wal/instance
I20260812 00:02:15.065845 12089 external_mini_cluster.cc:1428] Setting key f2d67367cc31be0fcf784e6842048ef6
I20260812 00:02:15.067510 25503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:15.057940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.65:49517 (local address 127.11.206.126:36983)
0812 00:02:15.058007 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:15.058009 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:15.058199 (+ 190us) server_negotiation.cc:407] Connection header received
0812 00:02:15.058675 (+ 476us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:15.058676 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:15.058693 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:15.058773 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:15.059565 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:15.060312 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:15.061819 (+ 1507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:15.062126 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:15.062205 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:15.064704 (+ 2499us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:15.064705 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:15.064705 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:15.064715 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:15.066164 (+ 1449us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:15.066567 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:15.066568 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:15.066568 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:15.066632 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:15.066918 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:15.066919 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:15.066919 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:15.067021 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:15.067067 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:15.067368 (+ 301us) server_negotiation.cc:299] Negotiation successful
0812 00:02:15.067444 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260812 00:02:15.067737 25600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:15.057914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:36983 (local address 127.11.206.65:49517)
0812 00:02:15.058071 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:15.058109 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:15.058582 (+ 473us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:15.058861 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:15.058864 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:15.059183 (+ 319us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:15.059463 (+ 280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:15.059470 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:15.060408 (+ 938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:15.060409 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:15.061718 (+ 1309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:15.061722 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:15.062206 (+ 484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:15.062207 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:15.062322 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:15.062852 (+ 530us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:15.062863 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:15.064593 (+ 1730us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:02:15.066238 (+ 1645us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:15.066244 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:15.066246 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:15.066499 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:15.066695 (+ 196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:15.066696 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:15.066696 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:15.066860 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:15.067075 (+ 215us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:02:15.067080 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:02:15.067241 (+ 161us) client_negotiation.cc:769] Sending connection context
0812 00:02:15.067352 (+ 111us) client_negotiation.cc:240] Negotiation successful
0812 00:02:15.067513 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":69,"threads_started":1}
I20260812 00:02:15.068254 25809 heartbeater.cc:347] Connected to a master server at 127.11.206.126:36983
I20260812 00:02:15.068351 25809 heartbeater.cc:464] Registering TS with master...
I20260812 00:02:15.068544 25809 heartbeater.cc:511] Master 127.11.206.126:36983 requested a full tablet report, sending...
I20260812 00:02:15.069111 25412 ts_manager.cc:194] Registered new tserver with Master: cb90632f9b2b4d42a67a7279aa0f1ec0 (127.11.206.65:37549)
I20260812 00:02:15.069916 25412 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.206.65@KRBTEST.COM'} at 127.11.206.65:49517
I20260812 00:02:15.074719 25819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:15.069151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:36983 (local address 127.11.206.65:39589)
0812 00:02:15.069324 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:15.069332 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:15.069406 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:15.069540 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:15.069540 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:15.069686 (+ 146us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:15.069734 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:15.069736 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:15.070525 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:15.070526 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:15.071020 (+ 494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:15.071022 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:15.071446 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:15.071447 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:15.071491 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:15.071876 (+ 385us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:15.071881 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:15.072146 (+ 265us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:02:15.073734 (+ 1588us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:15.073735 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:15.073735 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:15.073919 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:15.074148 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:15.074149 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:15.074149 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:15.074219 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:15.074483 (+ 264us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:02:15.074484 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:02:15.074520 (+ 36us) client_negotiation.cc:769] Sending connection context
0812 00:02:15.074575 (+ 55us) client_negotiation.cc:240] Negotiation successful
0812 00:02:15.074654 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":66,"threads_started":1}
I20260812 00:02:15.074800 25503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:15.069217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.65:39589 (local address 127.11.206.126:36983)
0812 00:02:15.069266 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:15.069268 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:15.069412 (+ 144us) server_negotiation.cc:407] Connection header received
0812 00:02:15.069458 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:15.069458 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:15.069468 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:15.069532 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:15.069794 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:15.070438 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:15.071105 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:15.071377 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:15.071446 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:15.072230 (+ 784us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:15.072231 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:15.072232 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:15.072239 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:15.073641 (+ 1402us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:15.073997 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:15.073998 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:15.073998 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:15.074057 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:15.074290 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:15.074291 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:15.074291 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:15.074421 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:15.074491 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:15.074621 (+ 130us) server_negotiation.cc:299] Negotiation successful
0812 00:02:15.074716 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
WARNING: no policy specified for oryx/127.11.206.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.206.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.206.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/krb5kdc/oryx_127.11.206.66.keytab.
Entry for principal oryx/127.11.206.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/krb5kdc/oryx_127.11.206.66.keytab.
I20260812 00:02:15.094167 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.66:0
--local_ip_for_outbound_sockets=127.11.206.66
--webserver_interface=127.11.206.66
--webserver_port=0
--tserver_master_addrs=127.11.206.126:36983
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/krb5kdc/oryx_127.11.206.66.keytab
--principal=oryx/127.11.206.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:41963
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:02:15.176075 25821 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:02:15.176286 25821 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:02:15.176311 25821 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:02:15.177443 25821 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:02:15.177487 25821 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:02:15.177507 25821 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 00:02:15.177528 25821 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.66
I20260812 00:02:15.179049 25821 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:41963
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/krb5kdc/oryx_127.11.206.66.keytab
--principal=oryx/127.11.206.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.206.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.206.126:36983
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25821
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.66
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:02:15.179247 25821 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:02:15.179425 25821 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 00:02:15.184394 25821 server_base.cc:1034] running on GCE node
W20260812 00:02:15.184362 25831 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:15.184381 25833 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:15.184372 25835 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:15.184780 25821 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:02:15.185016 25821 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:02:15.186153 25821 hybrid_clock.cc:648] HybridClock initialized: now 1786492935186136 us; error 34 us; skew 500 ppm
Aug 12 00:02:15 dist-test-slave-f0tn krb5kdc[25334](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492935, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.206.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:02:15.188519 25821 init.cc:377] Logged in from keytab as oryx/127.11.206.66@KRBTEST.COM (short username oryx)
I20260812 00:02:15.188946 25821 webserver.cc:460] Webserver started at http://127.11.206.66:41155/ using document root <none> and password file <none>
I20260812 00:02:15.189160 25821 fs_manager.cc:359] Metadata directory not provided
I20260812 00:02:15.189208 25821 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:02:15.189343 25821 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:02:15.190342 25821 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/minicluster-data/ts-1/data/instance:
uuid: "f94a933b286f4427b9bf531107a94661"
format_stamp: "Formatted at 2026-08-12 00:02:15 on dist-test-slave-f0tn"
server_key: "c512e6bfde5c7fb6736151101396b14e"
server_key_iv: "3d33fa9ce65dfcdf1426fe18b09e0698"
server_key_version: "encryptionkey@0"
I20260812 00:02:15.190672 25821 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/minicluster-data/ts-1/wal/instance:
uuid: "f94a933b286f4427b9bf531107a94661"
format_stamp: "Formatted at 2026-08-12 00:02:15 on dist-test-slave-f0tn"
server_key: "c512e6bfde5c7fb6736151101396b14e"
server_key_iv: "3d33fa9ce65dfcdf1426fe18b09e0698"
server_key_version: "encryptionkey@0"
I20260812 00:02:15.191880 25821 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 00:02:15.192504 25849 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:15.192662 25821 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:02:15.192744 25821 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/minicluster-data/ts-1/wal
uuid: "f94a933b286f4427b9bf531107a94661"
format_stamp: "Formatted at 2026-08-12 00:02:15 on dist-test-slave-f0tn"
server_key: "c512e6bfde5c7fb6736151101396b14e"
server_key_iv: "3d33fa9ce65dfcdf1426fe18b09e0698"
server_key_version: "encryptionkey@0"
I20260812 00:02:15.192808 25821 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:02:15.203802 25821 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:02:15.205703 25821 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:02:15.205833 25821 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:02:15.206305 25821 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:02:15.206343 25821 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:15.206370 25821 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:02:15.206387 25821 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:15.212626 25821 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.66:37465
I20260812 00:02:15.212721 26057 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.66:37465 every 8 connection(s)
I20260812 00:02:15.213025 25821 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
Aug 12 00:02:15 dist-test-slave-f0tn krb5kdc[25334](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492935, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.206.66@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM
I20260812 00:02:15.215845 25503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:15.206752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.66:60129 (local address 127.11.206.126:36983)
0812 00:02:15.206819 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:15.206822 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:15.207004 (+ 182us) server_negotiation.cc:407] Connection header received
0812 00:02:15.207553 (+ 549us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:15.207555 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:15.207569 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:15.207644 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:15.208488 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:15.209269 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:15.210756 (+ 1487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:15.211050 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:15.211132 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:15.213633 (+ 2501us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:15.213634 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:15.213634 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:15.213642 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:15.214747 (+ 1105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:15.215109 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:15.215109 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:15.215110 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:15.215155 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:15.215352 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:15.215353 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:15.215353 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:15.215460 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:15.215509 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:15.215713 (+ 204us) server_negotiation.cc:299] Negotiation successful
0812 00:02:15.215782 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260812 00:02:15.216048 25869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:15.206706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:36983 (local address 127.11.206.66:60129)
0812 00:02:15.206893 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:15.206934 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:15.207425 (+ 491us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:15.207733 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:15.207737 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:15.208102 (+ 365us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:15.208379 (+ 277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:15.208386 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:15.209370 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:15.209371 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:15.210658 (+ 1287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:15.210662 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:15.211131 (+ 469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:15.211132 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:15.211235 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:15.211824 (+ 589us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:15.211835 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:15.213540 (+ 1705us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:02:15.214825 (+ 1285us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:15.214831 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:15.214833 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:15.215049 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:15.215200 (+ 151us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:15.215201 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:15.215201 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:15.215305 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:15.215505 (+ 200us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:02:15.215508 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:02:15.215623 (+ 115us) client_negotiation.cc:769] Sending connection context
0812 00:02:15.215699 (+ 76us) client_negotiation.cc:240] Negotiation successful
0812 00:02:15.215829 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":79,"threads_started":1}
I20260812 00:02:15.216568 26058 heartbeater.cc:347] Connected to a master server at 127.11.206.126:36983
I20260812 00:02:15.216657 26058 heartbeater.cc:464] Registering TS with master...
I20260812 00:02:15.216861 26058 heartbeater.cc:511] Master 127.11.206.126:36983 requested a full tablet report, sending...
I20260812 00:02:15.217298 25410 ts_manager.cc:194] Registered new tserver with Master: f94a933b286f4427b9bf531107a94661 (127.11.206.66:37465)
I20260812 00:02:15.217808 25410 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.206.66@KRBTEST.COM'} at 127.11.206.66:60129
I20260812 00:02:15.219200 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 25821
I20260812 00:02:15.219313 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/minicluster-data/ts-1/wal/instance
I20260812 00:02:15.219506 12089 external_mini_cluster.cc:1428] Setting key ef38cc95f476559c594b7b3a39bc9b64
I20260812 00:02:15.222788 26076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:15.217581 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:36983 (local address 127.11.206.66:46269)
0812 00:02:15.217707 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:15.217718 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:15.217774 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:15.217901 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:15.217902 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:15.218087 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:15.218138 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:15.218139 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:15.218766 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:15.218767 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:15.219277 (+ 510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:15.219278 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:15.219691 (+ 413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:15.219693 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:15.219766 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:15.220172 (+ 406us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:15.220176 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:15.220465 (+ 289us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:02:15.221886 (+ 1421us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:15.221887 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:15.221888 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:15.222051 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:15.222230 (+ 179us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:15.222230 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:15.222230 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:15.222281 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:15.222561 (+ 280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:02:15.222562 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:02:15.222597 (+ 35us) client_negotiation.cc:769] Sending connection context
0812 00:02:15.222644 (+ 47us) client_negotiation.cc:240] Negotiation successful
0812 00:02:15.222718 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":56,"threads_started":1}
I20260812 00:02:15.222846 25503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:15.217651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.66:46269 (local address 127.11.206.126:36983)
0812 00:02:15.217698 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:15.217700 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:15.217759 (+ 59us) server_negotiation.cc:407] Connection header received
0812 00:02:15.217816 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:15.217817 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:15.217827 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:15.217871 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:15.218210 (+ 339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:15.218673 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:15.219395 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:15.219581 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:15.219635 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:15.220540 (+ 905us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:15.220541 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:15.220542 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:15.220549 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:15.221800 (+ 1251us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:15.222115 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:15.222116 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:15.222116 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:15.222175 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:15.222326 (+ 151us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:15.222327 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:15.222327 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:15.222506 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:15.222569 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:15.222690 (+ 121us) server_negotiation.cc:299] Negotiation successful
0812 00:02:15.222763 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
WARNING: no policy specified for oryx/127.11.206.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.206.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.206.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/krb5kdc/oryx_127.11.206.67.keytab.
Entry for principal oryx/127.11.206.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/krb5kdc/oryx_127.11.206.67.keytab.
I20260812 00:02:15.243805 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.67:0
--local_ip_for_outbound_sockets=127.11.206.67
--webserver_interface=127.11.206.67
--webserver_port=0
--tserver_master_addrs=127.11.206.126:36983
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/krb5kdc/oryx_127.11.206.67.keytab
--principal=oryx/127.11.206.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:41963
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:02:15.323690 26080 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:02:15.323902 26080 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:02:15.323931 26080 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:02:15.325044 26080 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:02:15.325086 26080 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:02:15.325111 26080 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 00:02:15.325133 26080 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.67
I20260812 00:02:15.326627 26080 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:41963
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/krb5kdc/oryx_127.11.206.67.keytab
--principal=oryx/127.11.206.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.206.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.206.126:36983
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26080
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.67
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:02:15.326884 26080 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:02:15.327105 26080 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:02:15.332006 26093 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:15.332010 26099 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:15.332010 26096 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:15.332247 26080 server_base.cc:1034] running on GCE node
I20260812 00:02:15.332520 26080 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:02:15.332737 26080 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:02:15.333877 26080 hybrid_clock.cc:648] HybridClock initialized: now 1786492935333867 us; error 31 us; skew 500 ppm
Aug 12 00:02:15 dist-test-slave-f0tn krb5kdc[25334](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492935, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.206.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:02:15.336316 26080 init.cc:377] Logged in from keytab as oryx/127.11.206.67@KRBTEST.COM (short username oryx)
I20260812 00:02:15.336747 26080 webserver.cc:460] Webserver started at http://127.11.206.67:43945/ using document root <none> and password file <none>
I20260812 00:02:15.336969 26080 fs_manager.cc:359] Metadata directory not provided
I20260812 00:02:15.337013 26080 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:02:15.337141 26080 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:02:15.338240 26080 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/minicluster-data/ts-2/data/instance:
uuid: "d9866a7f50b441a9a7c03f98515dd5b6"
format_stamp: "Formatted at 2026-08-12 00:02:15 on dist-test-slave-f0tn"
server_key: "7e661f8bcdb0dbef7680f313a0f7dbb9"
server_key_iv: "365d013223cfd4ca9050e27b26d20eec"
server_key_version: "encryptionkey@0"
I20260812 00:02:15.338578 26080 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/minicluster-data/ts-2/wal/instance:
uuid: "d9866a7f50b441a9a7c03f98515dd5b6"
format_stamp: "Formatted at 2026-08-12 00:02:15 on dist-test-slave-f0tn"
server_key: "7e661f8bcdb0dbef7680f313a0f7dbb9"
server_key_iv: "365d013223cfd4ca9050e27b26d20eec"
server_key_version: "encryptionkey@0"
I20260812 00:02:15.339869 26080 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260812 00:02:15.340590 26111 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:15.340771 26080 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 00:02:15.340862 26080 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/minicluster-data/ts-2/wal
uuid: "d9866a7f50b441a9a7c03f98515dd5b6"
format_stamp: "Formatted at 2026-08-12 00:02:15 on dist-test-slave-f0tn"
server_key: "7e661f8bcdb0dbef7680f313a0f7dbb9"
server_key_iv: "365d013223cfd4ca9050e27b26d20eec"
server_key_version: "encryptionkey@0"
I20260812 00:02:15.340919 26080 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:02:15.351431 26080 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:02:15.353540 26080 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:02:15.353650 26080 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:02:15.354121 26080 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:02:15.354162 26080 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:15.354183 26080 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:02:15.354194 26080 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:15.360993 26080 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.67:42795
I20260812 00:02:15.361076 26347 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.67:42795 every 8 connection(s)
Aug 12 00:02:15 dist-test-slave-f0tn krb5kdc[25334](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492935, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.206.67@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM
I20260812 00:02:15.361397 26080 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
I20260812 00:02:15.364557 25503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:15.354672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.67:50137 (local address 127.11.206.126:36983)
0812 00:02:15.354721 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:15.354724 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:15.354923 (+ 199us) server_negotiation.cc:407] Connection header received
0812 00:02:15.355458 (+ 535us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:15.355460 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:15.355474 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:15.355534 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:15.356465 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:15.357237 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:15.358833 (+ 1596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:15.359137 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:15.359202 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:15.361959 (+ 2757us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:15.361961 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:15.361961 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:15.361970 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:15.363266 (+ 1296us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:15.363652 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:15.363654 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:15.363654 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:15.363712 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:15.363937 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:15.363938 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:15.363938 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:15.364054 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:15.364119 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:15.364384 (+ 265us) server_negotiation.cc:299] Negotiation successful
0812 00:02:15.364469 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 00:02:15.364728 26127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:15.354623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:36983 (local address 127.11.206.67:50137)
0812 00:02:15.354790 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:15.354833 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:15.355354 (+ 521us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:15.355658 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:15.355664 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:15.356051 (+ 387us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:15.356356 (+ 305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:15.356364 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:15.357344 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:15.357345 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:15.358706 (+ 1361us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:15.358710 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:15.359220 (+ 510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:15.359223 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:15.359377 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:15.360005 (+ 628us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:15.360023 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:15.361865 (+ 1842us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:02:15.363347 (+ 1482us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:15.363353 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:15.363355 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:15.363570 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:15.363768 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:15.363769 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:15.363769 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:15.363877 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:15.364113 (+ 236us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:02:15.364119 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:02:15.364259 (+ 140us) client_negotiation.cc:769] Sending connection context
0812 00:02:15.364347 (+ 88us) client_negotiation.cc:240] Negotiation successful
0812 00:02:15.364504 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":78,"threads_started":1}
I20260812 00:02:15.365135 26348 heartbeater.cc:347] Connected to a master server at 127.11.206.126:36983
I20260812 00:02:15.365212 26348 heartbeater.cc:464] Registering TS with master...
I20260812 00:02:15.365408 26348 heartbeater.cc:511] Master 127.11.206.126:36983 requested a full tablet report, sending...
I20260812 00:02:15.365851 25412 ts_manager.cc:194] Registered new tserver with Master: d9866a7f50b441a9a7c03f98515dd5b6 (127.11.206.67:42795)
I20260812 00:02:15.366302 25412 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.206.67@KRBTEST.COM'} at 127.11.206.67:50137
I20260812 00:02:15.368460 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 26080
I20260812 00:02:15.368567 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/minicluster-data/ts-2/wal/instance
I20260812 00:02:15.368794 12089 external_mini_cluster.cc:1428] Setting key 544c35a1e79af1c55caad9398addf193
I20260812 00:02:15.369714 12089 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:02:15.371560 26358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:15.366085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:36983 (local address 127.11.206.67:49435)
0812 00:02:15.366214 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:15.366224 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:15.366278 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:15.366384 (+ 106us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:15.366385 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:15.366575 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:15.366644 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:15.366646 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:15.367283 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:15.367284 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:15.367840 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:15.367842 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:15.368183 (+ 341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:15.368184 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:15.368246 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:15.368681 (+ 435us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:15.368685 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:15.368981 (+ 296us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:02:15.370619 (+ 1638us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:15.370620 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:15.370620 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:15.370784 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:15.371010 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:15.371011 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:15.371012 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:15.371079 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:15.371313 (+ 234us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:02:15.371314 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:02:15.371350 (+ 36us) client_negotiation.cc:769] Sending connection context
0812 00:02:15.371396 (+ 46us) client_negotiation.cc:240] Negotiation successful
0812 00:02:15.371478 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":81,"threads_started":1}
I20260812 00:02:15.371569 25503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:15.366159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.67:49435 (local address 127.11.206.126:36983)
0812 00:02:15.366202 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:15.366204 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:15.366265 (+ 61us) server_negotiation.cc:407] Connection header received
0812 00:02:15.366329 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:15.366329 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:15.366339 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:15.366382 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:15.366718 (+ 336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:15.367191 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:15.367910 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:15.368119 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:15.368189 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:15.369057 (+ 868us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:15.369058 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:15.369059 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:15.369065 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:15.370529 (+ 1464us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:15.370866 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:15.370867 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:15.370867 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:15.370925 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:15.371143 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:15.371143 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:15.371143 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:15.371259 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:15.371320 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:15.371419 (+ 99us) server_negotiation.cc:299] Negotiation successful
0812 00:02:15.371490 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
Aug 12 00:02:15 dist-test-slave-f0tn krb5kdc[25334](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492935, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 00:02:15 dist-test-slave-f0tn krb5kdc[25334](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:02:15 dist-test-slave-f0tn krb5kdc[25334](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
W20260812 00:02:15.391762 25503 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:02:15.386773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60394 (local address 127.11.206.126:36983)
0812 00:02:15.386833 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:15.386835 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:15.386846 (+ 11us) server_negotiation.cc:407] Connection header received
0812 00:02:15.386871 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:15.386872 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:15.386881 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:15.386930 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:15.387451 (+ 521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:15.387934 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:15.388610 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:15.388786 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:15.388829 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:15.391675 (+ 2846us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60394: BlockingRecv error: recv got EOF from 127.0.0.1:60394 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
Aug 12 00:02:15 dist-test-slave-f0tn krb5kdc[25334](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492935, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM
I20260812 00:02:15.398546 25503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:15.392530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60410 (local address 127.11.206.126:36983)
0812 00:02:15.392577 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:15.392579 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:15.392606 (+ 27us) server_negotiation.cc:407] Connection header received
0812 00:02:15.392685 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:15.392686 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:15.392694 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:15.392736 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:15.393173 (+ 437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:15.393686 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:15.394332 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:15.394510 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:15.394563 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:15.396486 (+ 1923us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:15.396488 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:15.396488 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:15.396496 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:15.397583 (+ 1087us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:15.397876 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:15.397877 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:15.397878 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:15.397928 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:15.398093 (+ 165us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:15.398093 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:15.398094 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:15.398198 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:15.398289 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:15.398380 (+ 91us) server_negotiation.cc:299] Negotiation successful
0812 00:02:15.398455 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 00:02:15.399894 25412 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60410:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:02:15.401420 25412 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:02:15.406883 26383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:15.403420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.67:42795 (local address 127.0.0.1:41788)
0812 00:02:15.403572 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:15.403625 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:15.403688 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:15.404032 (+ 344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:15.404033 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:15.404035 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:02:15.404090 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:15.404092 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:15.404980 (+ 888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:15.404981 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:15.405918 (+ 937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:15.405921 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:15.406587 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:15.406588 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:15.406669 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:15.406683 (+ 14us) client_negotiation.cc:769] Sending connection context
0812 00:02:15.406744 (+ 61us) client_negotiation.cc:240] Negotiation successful
0812 00:02:15.406806 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":52,"threads_started":1}
I20260812 00:02:15.406898 26384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:15.403532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41788 (local address 127.11.206.67:42795)
0812 00:02:15.403879 (+ 347us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:15.403883 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:15.403893 (+ 10us) server_negotiation.cc:407] Connection header received
0812 00:02:15.403932 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:15.403934 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:15.403949 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:15.404020 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:02:15.404182 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:15.404900 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:15.406004 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:15.406505 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:15.406567 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:15.406641 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:15.406771 (+ 130us) server_negotiation.cc:299] Negotiation successful
0812 00:02:15.406806 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":305,"thread_start_us":85,"threads_started":1}
I20260812 00:02:15.407645 26382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:15.403607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.66:37465 (local address 127.0.0.1:34098)
0812 00:02:15.403789 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:15.403797 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:15.403833 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:15.404233 (+ 400us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:15.404234 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:15.404235 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:02:15.404267 (+ 32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:15.404269 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:15.405456 (+ 1187us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:15.405457 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:15.406539 (+ 1082us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:15.406542 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:15.407417 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:15.407418 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:15.407478 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:15.407482 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:02:15.407539 (+ 57us) client_negotiation.cc:240] Negotiation successful
0812 00:02:15.407577 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"mutex_wait_us":4,"thread_start_us":55,"threads_started":1}
I20260812 00:02:15.407686 26392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:15.403818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34098 (local address 127.11.206.66:37465)
0812 00:02:15.404044 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:15.404048 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:15.404057 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:02:15.404096 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:15.404098 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:15.404113 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:15.404185 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:02:15.404329 (+ 144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:15.405361 (+ 1032us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:15.406632 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:15.407340 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:15.407415 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:15.407483 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:15.407554 (+ 71us) server_negotiation.cc:299] Negotiation successful
0812 00:02:15.407590 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":189,"thread_start_us":91,"threads_started":1}
I20260812 00:02:15.407827 26390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:15.403564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38898 (local address 127.11.206.65:37549)
0812 00:02:15.403777 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:15.403782 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:15.403792 (+ 10us) server_negotiation.cc:407] Connection header received
0812 00:02:15.403831 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:15.403833 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:15.403849 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:15.403922 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:02:15.404082 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:15.405214 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:15.406638 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:15.407340 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:15.407386 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:15.407456 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:15.407678 (+ 222us) server_negotiation.cc:299] Negotiation successful
0812 00:02:15.407718 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":183,"thread_start_us":102,"threads_started":1}
I20260812 00:02:15.407898 26182 tablet_service.cc:1467] Processing CreateTablet for tablet 8c128be1c0f740028cbe09bed5243b68 (DEFAULT_TABLE table=test-table [id=2d12d1feedc94ce494a5f99d6f394444]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:02:15.408035 26387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:15.403435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.65:37549 (local address 127.0.0.1:38898)
0812 00:02:15.403697 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:15.403709 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:15.403758 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:15.403929 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:15.403932 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:15.403934 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:02:15.403995 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:15.403997 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:15.405398 (+ 1401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:15.405399 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:15.406540 (+ 1141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:15.406542 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:15.407519 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:15.407520 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:15.407589 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:15.407593 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:02:15.407925 (+ 332us) client_negotiation.cc:240] Negotiation successful
0812 00:02:15.407974 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":248,"mutex_wait_us":4,"thread_start_us":54,"threads_started":1}
I20260812 00:02:15.408281 26182 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8c128be1c0f740028cbe09bed5243b68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:02:15.408717 25682 tablet_service.cc:1467] Processing CreateTablet for tablet 8c128be1c0f740028cbe09bed5243b68 (DEFAULT_TABLE table=test-table [id=2d12d1feedc94ce494a5f99d6f394444]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:02:15.409065 25682 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8c128be1c0f740028cbe09bed5243b68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:02:15.412228 26394 tablet_bootstrap.cc:492] T 8c128be1c0f740028cbe09bed5243b68 P d9866a7f50b441a9a7c03f98515dd5b6: Bootstrap starting.
I20260812 00:02:15.412765 26395 tablet_bootstrap.cc:492] T 8c128be1c0f740028cbe09bed5243b68 P cb90632f9b2b4d42a67a7279aa0f1ec0: Bootstrap starting.
I20260812 00:02:15.412828 26394 tablet_bootstrap.cc:654] T 8c128be1c0f740028cbe09bed5243b68 P d9866a7f50b441a9a7c03f98515dd5b6: Neither blocks nor log segments found. Creating new log.
I20260812 00:02:15.413163 26394 log.cc:824] T 8c128be1c0f740028cbe09bed5243b68 P d9866a7f50b441a9a7c03f98515dd5b6: Log is configured to *not* fsync() on all Append() calls
I20260812 00:02:15.413154 25945 tablet_service.cc:1467] Processing CreateTablet for tablet 8c128be1c0f740028cbe09bed5243b68 (DEFAULT_TABLE table=test-table [id=2d12d1feedc94ce494a5f99d6f394444]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:02:15.413483 26395 tablet_bootstrap.cc:654] T 8c128be1c0f740028cbe09bed5243b68 P cb90632f9b2b4d42a67a7279aa0f1ec0: Neither blocks nor log segments found. Creating new log.
I20260812 00:02:15.413545 25945 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8c128be1c0f740028cbe09bed5243b68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:02:15.413810 26395 log.cc:824] T 8c128be1c0f740028cbe09bed5243b68 P cb90632f9b2b4d42a67a7279aa0f1ec0: Log is configured to *not* fsync() on all Append() calls
I20260812 00:02:15.414578 26395 tablet_bootstrap.cc:492] T 8c128be1c0f740028cbe09bed5243b68 P cb90632f9b2b4d42a67a7279aa0f1ec0: No bootstrap required, opened a new log
I20260812 00:02:15.414654 26395 ts_tablet_manager.cc:1397] T 8c128be1c0f740028cbe09bed5243b68 P cb90632f9b2b4d42a67a7279aa0f1ec0: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260812 00:02:15.416692 26395 raft_consensus.cc:348] T 8c128be1c0f740028cbe09bed5243b68 P cb90632f9b2b4d42a67a7279aa0f1ec0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9866a7f50b441a9a7c03f98515dd5b6" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 42795 } } peers { permanent_uuid: "f94a933b286f4427b9bf531107a94661" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37465 } } peers { permanent_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 37549 } }
I20260812 00:02:15.416872 26395 raft_consensus.cc:374] T 8c128be1c0f740028cbe09bed5243b68 P cb90632f9b2b4d42a67a7279aa0f1ec0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:02:15.416921 26395 raft_consensus.cc:729] T 8c128be1c0f740028cbe09bed5243b68 P cb90632f9b2b4d42a67a7279aa0f1ec0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb90632f9b2b4d42a67a7279aa0f1ec0, State: Initialized, Role: FOLLOWER
I20260812 00:02:15.417045 26395 consensus_queue.cc:260] T 8c128be1c0f740028cbe09bed5243b68 P cb90632f9b2b4d42a67a7279aa0f1ec0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9866a7f50b441a9a7c03f98515dd5b6" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 42795 } } peers { permanent_uuid: "f94a933b286f4427b9bf531107a94661" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37465 } } peers { permanent_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 37549 } }
I20260812 00:02:15.417310 26395 ts_tablet_manager.cc:1428] T 8c128be1c0f740028cbe09bed5243b68 P cb90632f9b2b4d42a67a7279aa0f1ec0: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260812 00:02:15.417346 26398 tablet_bootstrap.cc:492] T 8c128be1c0f740028cbe09bed5243b68 P f94a933b286f4427b9bf531107a94661: Bootstrap starting.
I20260812 00:02:15.417583 25809 heartbeater.cc:503] Master 127.11.206.126:36983 was elected leader, sending a full tablet report...
I20260812 00:02:15.417915 26394 tablet_bootstrap.cc:492] T 8c128be1c0f740028cbe09bed5243b68 P d9866a7f50b441a9a7c03f98515dd5b6: No bootstrap required, opened a new log
I20260812 00:02:15.417986 26394 ts_tablet_manager.cc:1397] T 8c128be1c0f740028cbe09bed5243b68 P d9866a7f50b441a9a7c03f98515dd5b6: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260812 00:02:15.418079 26398 tablet_bootstrap.cc:654] T 8c128be1c0f740028cbe09bed5243b68 P f94a933b286f4427b9bf531107a94661: Neither blocks nor log segments found. Creating new log.
I20260812 00:02:15.418390 26398 log.cc:824] T 8c128be1c0f740028cbe09bed5243b68 P f94a933b286f4427b9bf531107a94661: Log is configured to *not* fsync() on all Append() calls
I20260812 00:02:15.419145 26398 tablet_bootstrap.cc:492] T 8c128be1c0f740028cbe09bed5243b68 P f94a933b286f4427b9bf531107a94661: No bootstrap required, opened a new log
I20260812 00:02:15.419200 26398 ts_tablet_manager.cc:1397] T 8c128be1c0f740028cbe09bed5243b68 P f94a933b286f4427b9bf531107a94661: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260812 00:02:15.420118 26394 raft_consensus.cc:348] T 8c128be1c0f740028cbe09bed5243b68 P d9866a7f50b441a9a7c03f98515dd5b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9866a7f50b441a9a7c03f98515dd5b6" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 42795 } } peers { permanent_uuid: "f94a933b286f4427b9bf531107a94661" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37465 } } peers { permanent_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 37549 } }
I20260812 00:02:15.420269 26394 raft_consensus.cc:374] T 8c128be1c0f740028cbe09bed5243b68 P d9866a7f50b441a9a7c03f98515dd5b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:02:15.420300 26394 raft_consensus.cc:729] T 8c128be1c0f740028cbe09bed5243b68 P d9866a7f50b441a9a7c03f98515dd5b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9866a7f50b441a9a7c03f98515dd5b6, State: Initialized, Role: FOLLOWER
I20260812 00:02:15.420413 26394 consensus_queue.cc:260] T 8c128be1c0f740028cbe09bed5243b68 P d9866a7f50b441a9a7c03f98515dd5b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9866a7f50b441a9a7c03f98515dd5b6" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 42795 } } peers { permanent_uuid: "f94a933b286f4427b9bf531107a94661" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37465 } } peers { permanent_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 37549 } }
I20260812 00:02:15.420673 26394 ts_tablet_manager.cc:1428] T 8c128be1c0f740028cbe09bed5243b68 P d9866a7f50b441a9a7c03f98515dd5b6: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 00:02:15.420711 26348 heartbeater.cc:503] Master 127.11.206.126:36983 was elected leader, sending a full tablet report...
I20260812 00:02:15.421281 26398 raft_consensus.cc:348] T 8c128be1c0f740028cbe09bed5243b68 P f94a933b286f4427b9bf531107a94661 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9866a7f50b441a9a7c03f98515dd5b6" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 42795 } } peers { permanent_uuid: "f94a933b286f4427b9bf531107a94661" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37465 } } peers { permanent_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 37549 } }
I20260812 00:02:15.421430 26398 raft_consensus.cc:374] T 8c128be1c0f740028cbe09bed5243b68 P f94a933b286f4427b9bf531107a94661 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:02:15.421473 26398 raft_consensus.cc:729] T 8c128be1c0f740028cbe09bed5243b68 P f94a933b286f4427b9bf531107a94661 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f94a933b286f4427b9bf531107a94661, State: Initialized, Role: FOLLOWER
I20260812 00:02:15.421597 26398 consensus_queue.cc:260] T 8c128be1c0f740028cbe09bed5243b68 P f94a933b286f4427b9bf531107a94661 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9866a7f50b441a9a7c03f98515dd5b6" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 42795 } } peers { permanent_uuid: "f94a933b286f4427b9bf531107a94661" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37465 } } peers { permanent_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 37549 } }
I20260812 00:02:15.421810 26398 ts_tablet_manager.cc:1428] T 8c128be1c0f740028cbe09bed5243b68 P f94a933b286f4427b9bf531107a94661: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260812 00:02:15.421867 26058 heartbeater.cc:503] Master 127.11.206.126:36983 was elected leader, sending a full tablet report...
W20260812 00:02:15.463637 26059 tablet.cc:2369] T 8c128be1c0f740028cbe09bed5243b68 P f94a933b286f4427b9bf531107a94661: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:02:15.503909 26404 raft_consensus.cc:482] T 8c128be1c0f740028cbe09bed5243b68 P d9866a7f50b441a9a7c03f98515dd5b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:02:15.504040 26404 raft_consensus.cc:504] T 8c128be1c0f740028cbe09bed5243b68 P d9866a7f50b441a9a7c03f98515dd5b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9866a7f50b441a9a7c03f98515dd5b6" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 42795 } } peers { permanent_uuid: "f94a933b286f4427b9bf531107a94661" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37465 } } peers { permanent_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 37549 } }
I20260812 00:02:15.504410 26404 leader_election.cc:288] T 8c128be1c0f740028cbe09bed5243b68 P d9866a7f50b441a9a7c03f98515dd5b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f94a933b286f4427b9bf531107a94661 (127.11.206.66:37465), cb90632f9b2b4d42a67a7279aa0f1ec0 (127.11.206.65:37549)
I20260812 00:02:15.508214 26392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:15.504685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.67:37901 (local address 127.11.206.66:37465)
0812 00:02:15.504742 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:15.504744 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:15.504758 (+ 14us) server_negotiation.cc:407] Connection header received
0812 00:02:15.504850 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:15.504851 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:15.504858 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:15.504905 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:02:15.505082 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:15.505865 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:15.507288 (+ 1423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:15.507847 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:15.507925 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:15.507932 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:15.508099 (+ 167us) server_negotiation.cc:299] Negotiation successful
0812 00:02:15.508139 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260812 00:02:15.508214 26390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:15.504686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.67:39961 (local address 127.11.206.65:37549)
0812 00:02:15.504741 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:15.504744 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:15.505031 (+ 287us) server_negotiation.cc:407] Connection header received
0812 00:02:15.505087 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:15.505088 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:15.505097 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:15.505141 (+ 44us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:02:15.505292 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:15.505979 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:15.507285 (+ 1306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:15.507842 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:15.507919 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:15.507929 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:15.508098 (+ 169us) server_negotiation.cc:299] Negotiation successful
0812 00:02:15.508139 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260812 00:02:15.508241 26406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:15.504622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.65:37549 (local address 127.11.206.67:39961)
0812 00:02:15.504964 (+ 342us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:15.504973 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:15.505029 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:15.505152 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:15.505153 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:15.505154 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:02:15.505209 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:15.505210 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:15.506045 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:15.506046 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:15.507193 (+ 1147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:15.507196 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:15.507925 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:15.507925 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:15.508024 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:15.508029 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 00:02:15.508081 (+ 52us) client_negotiation.cc:240] Negotiation successful
0812 00:02:15.508129 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":327,"mutex_wait_us":153,"thread_start_us":122,"threads_started":1}
I20260812 00:02:15.508240 26127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:15.504616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.66:37465 (local address 127.11.206.67:37901)
0812 00:02:15.504696 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:15.504709 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:15.504774 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:15.504928 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:15.504929 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:15.504931 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:02:15.505005 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:15.505007 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:15.505938 (+ 931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:15.505939 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:15.507193 (+ 1254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:15.507196 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:15.507924 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:15.507925 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:15.508028 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:15.508030 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 00:02:15.508081 (+ 51us) client_negotiation.cc:240] Negotiation successful
0812 00:02:15.508129 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":57,"mutex_wait_us":10}
I20260812 00:02:15.508602 25686 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c128be1c0f740028cbe09bed5243b68" candidate_uuid: "d9866a7f50b441a9a7c03f98515dd5b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" is_pre_election: true
I20260812 00:02:15.508772 25686 raft_consensus.cc:2454] T 8c128be1c0f740028cbe09bed5243b68 P cb90632f9b2b4d42a67a7279aa0f1ec0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9866a7f50b441a9a7c03f98515dd5b6 in term 0.
I20260812 00:02:15.508948 25980 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c128be1c0f740028cbe09bed5243b68" candidate_uuid: "d9866a7f50b441a9a7c03f98515dd5b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f94a933b286f4427b9bf531107a94661" is_pre_election: true
I20260812 00:02:15.509029 26117 leader_election.cc:302] T 8c128be1c0f740028cbe09bed5243b68 P d9866a7f50b441a9a7c03f98515dd5b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cb90632f9b2b4d42a67a7279aa0f1ec0, d9866a7f50b441a9a7c03f98515dd5b6; no voters:
I20260812 00:02:15.509083 25980 raft_consensus.cc:2454] T 8c128be1c0f740028cbe09bed5243b68 P f94a933b286f4427b9bf531107a94661 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9866a7f50b441a9a7c03f98515dd5b6 in term 0.
I20260812 00:02:15.509166 26404 raft_consensus.cc:2781] T 8c128be1c0f740028cbe09bed5243b68 P d9866a7f50b441a9a7c03f98515dd5b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:02:15.509222 26404 raft_consensus.cc:482] T 8c128be1c0f740028cbe09bed5243b68 P d9866a7f50b441a9a7c03f98515dd5b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:02:15.509246 26404 raft_consensus.cc:3037] T 8c128be1c0f740028cbe09bed5243b68 P d9866a7f50b441a9a7c03f98515dd5b6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:02:15.510174 26404 raft_consensus.cc:504] T 8c128be1c0f740028cbe09bed5243b68 P d9866a7f50b441a9a7c03f98515dd5b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9866a7f50b441a9a7c03f98515dd5b6" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 42795 } } peers { permanent_uuid: "f94a933b286f4427b9bf531107a94661" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37465 } } peers { permanent_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 37549 } }
I20260812 00:02:15.510305 26404 leader_election.cc:288] T 8c128be1c0f740028cbe09bed5243b68 P d9866a7f50b441a9a7c03f98515dd5b6 [CANDIDATE]: Term 1 election: Requested vote from peers f94a933b286f4427b9bf531107a94661 (127.11.206.66:37465), cb90632f9b2b4d42a67a7279aa0f1ec0 (127.11.206.65:37549)
I20260812 00:02:15.510458 25980 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c128be1c0f740028cbe09bed5243b68" candidate_uuid: "d9866a7f50b441a9a7c03f98515dd5b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f94a933b286f4427b9bf531107a94661"
I20260812 00:02:15.510537 25980 raft_consensus.cc:3037] T 8c128be1c0f740028cbe09bed5243b68 P f94a933b286f4427b9bf531107a94661 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:02:15.510535 25686 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c128be1c0f740028cbe09bed5243b68" candidate_uuid: "d9866a7f50b441a9a7c03f98515dd5b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0"
I20260812 00:02:15.510617 25686 raft_consensus.cc:3037] T 8c128be1c0f740028cbe09bed5243b68 P cb90632f9b2b4d42a67a7279aa0f1ec0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:02:15.511241 25980 raft_consensus.cc:2454] T 8c128be1c0f740028cbe09bed5243b68 P f94a933b286f4427b9bf531107a94661 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9866a7f50b441a9a7c03f98515dd5b6 in term 1.
I20260812 00:02:15.511369 25686 raft_consensus.cc:2454] T 8c128be1c0f740028cbe09bed5243b68 P cb90632f9b2b4d42a67a7279aa0f1ec0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9866a7f50b441a9a7c03f98515dd5b6 in term 1.
I20260812 00:02:15.511525 26120 leader_election.cc:302] T 8c128be1c0f740028cbe09bed5243b68 P d9866a7f50b441a9a7c03f98515dd5b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d9866a7f50b441a9a7c03f98515dd5b6, f94a933b286f4427b9bf531107a94661; no voters:
I20260812 00:02:15.511643 26404 raft_consensus.cc:2781] T 8c128be1c0f740028cbe09bed5243b68 P d9866a7f50b441a9a7c03f98515dd5b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:02:15.511832 26404 raft_consensus.cc:686] T 8c128be1c0f740028cbe09bed5243b68 P d9866a7f50b441a9a7c03f98515dd5b6 [term 1 LEADER]: Becoming Leader. State: Replica: d9866a7f50b441a9a7c03f98515dd5b6, State: Running, Role: LEADER
I20260812 00:02:15.511927 26404 consensus_queue.cc:237] T 8c128be1c0f740028cbe09bed5243b68 P d9866a7f50b441a9a7c03f98515dd5b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9866a7f50b441a9a7c03f98515dd5b6" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 42795 } } peers { permanent_uuid: "f94a933b286f4427b9bf531107a94661" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37465 } } peers { permanent_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 37549 } }
I20260812 00:02:15.512802 25410 catalog_manager.cc:5495] T 8c128be1c0f740028cbe09bed5243b68 P d9866a7f50b441a9a7c03f98515dd5b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to d9866a7f50b441a9a7c03f98515dd5b6 (127.11.206.67). New cstate: current_term: 1 leader_uuid: "d9866a7f50b441a9a7c03f98515dd5b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9866a7f50b441a9a7c03f98515dd5b6" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 42795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f94a933b286f4427b9bf531107a94661" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 37549 } health_report { overall_health: UNKNOWN } } }
I20260812 00:02:15.524873 26384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:15.522761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41802 (local address 127.11.206.67:42795)
0812 00:02:15.522824 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:15.522826 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:15.522835 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:02:15.522866 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:15.522867 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:15.522884 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:15.522949 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:02:15.523085 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:15.523564 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:15.524274 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:15.524464 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:15.524516 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:15.524627 (+ 111us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:02:15.524726 (+ 99us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:02:15.524784 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:15.524801 (+ 17us) server_negotiation.cc:299] Negotiation successful
0812 00:02:15.524819 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260812 00:02:15.526675 25686 raft_consensus.cc:1261] T 8c128be1c0f740028cbe09bed5243b68 P cb90632f9b2b4d42a67a7279aa0f1ec0 [term 1 FOLLOWER]: Refusing update from remote peer d9866a7f50b441a9a7c03f98515dd5b6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:02:15.526675 25980 raft_consensus.cc:1261] T 8c128be1c0f740028cbe09bed5243b68 P f94a933b286f4427b9bf531107a94661 [term 1 FOLLOWER]: Refusing update from remote peer d9866a7f50b441a9a7c03f98515dd5b6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:02:15.527033 26407 consensus_queue.cc:1035] T 8c128be1c0f740028cbe09bed5243b68 P d9866a7f50b441a9a7c03f98515dd5b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f94a933b286f4427b9bf531107a94661" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:02:15.527158 26404 consensus_queue.cc:1035] T 8c128be1c0f740028cbe09bed5243b68 P d9866a7f50b441a9a7c03f98515dd5b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 37549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:02:15.529241 26410 mvcc.cc:205] Tried to move back new op lower bound from 7317475063914565632 to 7317475063857643520. Current Snapshot: MvccSnapshot[applied={T|T < 7317475063914565632}]
I20260812 00:02:15.529748 26413 mvcc.cc:205] Tried to move back new op lower bound from 7317475063914565632 to 7317475063857643520. Current Snapshot: MvccSnapshot[applied={T|T < 7317475063914565632}]
I20260812 00:02:15.531749 25412 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60410:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:02:15.531831 25412 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60410:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:02:15.532512 25412 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9aff16bf5c77499a83c2e866ba8d27a9: Sending DeleteTablet for 3 replicas of tablet 8c128be1c0f740028cbe09bed5243b68
I20260812 00:02:15.532840 25945 tablet_service.cc:1514] Processing DeleteTablet for tablet 8c128be1c0f740028cbe09bed5243b68 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:02:15 UTC) from {username='oryx', principal='oryx/127.11.206.126@KRBTEST.COM'} at 127.0.0.1:34098
I20260812 00:02:15.532840 25682 tablet_service.cc:1514] Processing DeleteTablet for tablet 8c128be1c0f740028cbe09bed5243b68 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:02:15 UTC) from {username='oryx', principal='oryx/127.11.206.126@KRBTEST.COM'} at 127.0.0.1:38898
I20260812 00:02:15.533052 26182 tablet_service.cc:1514] Processing DeleteTablet for tablet 8c128be1c0f740028cbe09bed5243b68 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:02:15 UTC) from {username='oryx', principal='oryx/127.11.206.126@KRBTEST.COM'} at 127.0.0.1:41788
I20260812 00:02:15.533247 26431 tablet_replica.cc:330] T 8c128be1c0f740028cbe09bed5243b68 P d9866a7f50b441a9a7c03f98515dd5b6: stopping tablet replica
I20260812 00:02:15.533367 26431 raft_consensus.cc:2229] T 8c128be1c0f740028cbe09bed5243b68 P d9866a7f50b441a9a7c03f98515dd5b6 [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:02:15.533362 26427 tablet_replica.cc:330] T 8c128be1c0f740028cbe09bed5243b68 P f94a933b286f4427b9bf531107a94661: stopping tablet replica
I20260812 00:02:15.533479 26427 raft_consensus.cc:2229] T 8c128be1c0f740028cbe09bed5243b68 P f94a933b286f4427b9bf531107a94661 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:02:15.533522 26431 raft_consensus.cc:2258] T 8c128be1c0f740028cbe09bed5243b68 P d9866a7f50b441a9a7c03f98515dd5b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:02:15.533500 25412 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60410:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:02:15.533638 25412 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:02:15.533911 26427 raft_consensus.cc:2258] T 8c128be1c0f740028cbe09bed5243b68 P f94a933b286f4427b9bf531107a94661 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:02:15.534380 26427 ts_tablet_manager.cc:1905] T 8c128be1c0f740028cbe09bed5243b68 P f94a933b286f4427b9bf531107a94661: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:02:15.534936 25945 tablet_service.cc:1467] Processing CreateTablet for tablet 7b0950f44133428da14d8cec69d5e2be (DEFAULT_TABLE table=test-table [id=3508ba3dace5434abed4754f6f4ef433]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:02:15.534953 26182 tablet_service.cc:1467] Processing CreateTablet for tablet 7b0950f44133428da14d8cec69d5e2be (DEFAULT_TABLE table=test-table [id=3508ba3dace5434abed4754f6f4ef433]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:02:15.535046 26182 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b0950f44133428da14d8cec69d5e2be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:02:15.535046 25945 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b0950f44133428da14d8cec69d5e2be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:02:15.536278 26398 tablet_bootstrap.cc:492] T 7b0950f44133428da14d8cec69d5e2be P f94a933b286f4427b9bf531107a94661: Bootstrap starting.
I20260812 00:02:15.536284 26394 tablet_bootstrap.cc:492] T 7b0950f44133428da14d8cec69d5e2be P d9866a7f50b441a9a7c03f98515dd5b6: Bootstrap starting.
I20260812 00:02:15.536686 26398 tablet_bootstrap.cc:654] T 7b0950f44133428da14d8cec69d5e2be P f94a933b286f4427b9bf531107a94661: Neither blocks nor log segments found. Creating new log.
I20260812 00:02:15.536701 26394 tablet_bootstrap.cc:654] T 7b0950f44133428da14d8cec69d5e2be P d9866a7f50b441a9a7c03f98515dd5b6: Neither blocks nor log segments found. Creating new log.
I20260812 00:02:15.537599 26427 ts_tablet_manager.cc:1918] T 8c128be1c0f740028cbe09bed5243b68 P f94a933b286f4427b9bf531107a94661: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:02:15.537681 26427 log.cc:1196] T 8c128be1c0f740028cbe09bed5243b68 P f94a933b286f4427b9bf531107a94661: Deleting WAL directory at /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/minicluster-data/ts-1/wal/wals/8c128be1c0f740028cbe09bed5243b68
I20260812 00:02:15.537953 26427 ts_tablet_manager.cc:1939] T 8c128be1c0f740028cbe09bed5243b68 P f94a933b286f4427b9bf531107a94661: Deleting consensus metadata
I20260812 00:02:15.537959 26431 ts_tablet_manager.cc:1905] T 8c128be1c0f740028cbe09bed5243b68 P d9866a7f50b441a9a7c03f98515dd5b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:02:15.538010 26398 tablet_bootstrap.cc:492] T 7b0950f44133428da14d8cec69d5e2be P f94a933b286f4427b9bf531107a94661: No bootstrap required, opened a new log
I20260812 00:02:15.538056 26398 ts_tablet_manager.cc:1397] T 7b0950f44133428da14d8cec69d5e2be P f94a933b286f4427b9bf531107a94661: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.000s
I20260812 00:02:15.538192 26398 raft_consensus.cc:348] T 7b0950f44133428da14d8cec69d5e2be P f94a933b286f4427b9bf531107a94661 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 37549 } } peers { permanent_uuid: "f94a933b286f4427b9bf531107a94661" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37465 } } peers { permanent_uuid: "d9866a7f50b441a9a7c03f98515dd5b6" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 42795 } }
I20260812 00:02:15.538267 26398 raft_consensus.cc:374] T 7b0950f44133428da14d8cec69d5e2be P f94a933b286f4427b9bf531107a94661 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:02:15.538286 26398 raft_consensus.cc:729] T 7b0950f44133428da14d8cec69d5e2be P f94a933b286f4427b9bf531107a94661 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f94a933b286f4427b9bf531107a94661, State: Initialized, Role: FOLLOWER
I20260812 00:02:15.538327 26398 consensus_queue.cc:260] T 7b0950f44133428da14d8cec69d5e2be P f94a933b286f4427b9bf531107a94661 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 37549 } } peers { permanent_uuid: "f94a933b286f4427b9bf531107a94661" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37465 } } peers { permanent_uuid: "d9866a7f50b441a9a7c03f98515dd5b6" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 42795 } }
I20260812 00:02:15.538400 26398 ts_tablet_manager.cc:1428] T 7b0950f44133428da14d8cec69d5e2be P f94a933b286f4427b9bf531107a94661: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:15.538403 25682 tablet_service.cc:1467] Processing CreateTablet for tablet 7b0950f44133428da14d8cec69d5e2be (DEFAULT_TABLE table=test-table [id=3508ba3dace5434abed4754f6f4ef433]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:02:15.538518 25682 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b0950f44133428da14d8cec69d5e2be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:02:15.538861 26394 tablet_bootstrap.cc:492] T 7b0950f44133428da14d8cec69d5e2be P d9866a7f50b441a9a7c03f98515dd5b6: No bootstrap required, opened a new log
I20260812 00:02:15.538899 26394 ts_tablet_manager.cc:1397] T 7b0950f44133428da14d8cec69d5e2be P d9866a7f50b441a9a7c03f98515dd5b6: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260812 00:02:15.539026 26394 raft_consensus.cc:348] T 7b0950f44133428da14d8cec69d5e2be P d9866a7f50b441a9a7c03f98515dd5b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 37549 } } peers { permanent_uuid: "f94a933b286f4427b9bf531107a94661" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37465 } } peers { permanent_uuid: "d9866a7f50b441a9a7c03f98515dd5b6" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 42795 } }
I20260812 00:02:15.539077 26394 raft_consensus.cc:374] T 7b0950f44133428da14d8cec69d5e2be P d9866a7f50b441a9a7c03f98515dd5b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:02:15.539094 26394 raft_consensus.cc:729] T 7b0950f44133428da14d8cec69d5e2be P d9866a7f50b441a9a7c03f98515dd5b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9866a7f50b441a9a7c03f98515dd5b6, State: Initialized, Role: FOLLOWER
I20260812 00:02:15.539139 26394 consensus_queue.cc:260] T 7b0950f44133428da14d8cec69d5e2be P d9866a7f50b441a9a7c03f98515dd5b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 37549 } } peers { permanent_uuid: "f94a933b286f4427b9bf531107a94661" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37465 } } peers { permanent_uuid: "d9866a7f50b441a9a7c03f98515dd5b6" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 42795 } }
I20260812 00:02:15.539217 26394 ts_tablet_manager.cc:1428] T 7b0950f44133428da14d8cec69d5e2be P d9866a7f50b441a9a7c03f98515dd5b6: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:15.539383 26431 ts_tablet_manager.cc:1918] T 8c128be1c0f740028cbe09bed5243b68 P d9866a7f50b441a9a7c03f98515dd5b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:02:15.539438 26431 log.cc:1196] T 8c128be1c0f740028cbe09bed5243b68 P d9866a7f50b441a9a7c03f98515dd5b6: Deleting WAL directory at /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/minicluster-data/ts-2/wal/wals/8c128be1c0f740028cbe09bed5243b68
I20260812 00:02:15.539650 26431 ts_tablet_manager.cc:1939] T 8c128be1c0f740028cbe09bed5243b68 P d9866a7f50b441a9a7c03f98515dd5b6: Deleting consensus metadata
I20260812 00:02:15.539745 25390 catalog_manager.cc:4841] TS f94a933b286f4427b9bf531107a94661 (127.11.206.66:37465): tablet 8c128be1c0f740028cbe09bed5243b68 (table test-table [id=2d12d1feedc94ce494a5f99d6f394444]) successfully deleted
I20260812 00:02:15.539953 26395 tablet_bootstrap.cc:492] T 7b0950f44133428da14d8cec69d5e2be P cb90632f9b2b4d42a67a7279aa0f1ec0: Bootstrap starting.
I20260812 00:02:15.540328 26395 tablet_bootstrap.cc:654] T 7b0950f44133428da14d8cec69d5e2be P cb90632f9b2b4d42a67a7279aa0f1ec0: Neither blocks nor log segments found. Creating new log.
I20260812 00:02:15.540715 25390 catalog_manager.cc:4841] TS d9866a7f50b441a9a7c03f98515dd5b6 (127.11.206.67:42795): tablet 8c128be1c0f740028cbe09bed5243b68 (table test-table [id=2d12d1feedc94ce494a5f99d6f394444]) successfully deleted
I20260812 00:02:15.538527 26430 tablet_replica.cc:330] T 8c128be1c0f740028cbe09bed5243b68 P cb90632f9b2b4d42a67a7279aa0f1ec0: stopping tablet replica
I20260812 00:02:15.541109 26430 raft_consensus.cc:2229] T 8c128be1c0f740028cbe09bed5243b68 P cb90632f9b2b4d42a67a7279aa0f1ec0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:02:15.541225 26430 raft_consensus.cc:2258] T 8c128be1c0f740028cbe09bed5243b68 P cb90632f9b2b4d42a67a7279aa0f1ec0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:02:15.541504 26395 tablet_bootstrap.cc:492] T 7b0950f44133428da14d8cec69d5e2be P cb90632f9b2b4d42a67a7279aa0f1ec0: No bootstrap required, opened a new log
I20260812 00:02:15.541545 26395 ts_tablet_manager.cc:1397] T 7b0950f44133428da14d8cec69d5e2be P cb90632f9b2b4d42a67a7279aa0f1ec0: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260812 00:02:15.541677 26395 raft_consensus.cc:348] T 7b0950f44133428da14d8cec69d5e2be P cb90632f9b2b4d42a67a7279aa0f1ec0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 37549 } } peers { permanent_uuid: "f94a933b286f4427b9bf531107a94661" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37465 } } peers { permanent_uuid: "d9866a7f50b441a9a7c03f98515dd5b6" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 42795 } }
I20260812 00:02:15.541738 26395 raft_consensus.cc:374] T 7b0950f44133428da14d8cec69d5e2be P cb90632f9b2b4d42a67a7279aa0f1ec0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:02:15.541765 26395 raft_consensus.cc:729] T 7b0950f44133428da14d8cec69d5e2be P cb90632f9b2b4d42a67a7279aa0f1ec0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb90632f9b2b4d42a67a7279aa0f1ec0, State: Initialized, Role: FOLLOWER
I20260812 00:02:15.541824 26395 consensus_queue.cc:260] T 7b0950f44133428da14d8cec69d5e2be P cb90632f9b2b4d42a67a7279aa0f1ec0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 37549 } } peers { permanent_uuid: "f94a933b286f4427b9bf531107a94661" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37465 } } peers { permanent_uuid: "d9866a7f50b441a9a7c03f98515dd5b6" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 42795 } }
I20260812 00:02:15.541908 26395 ts_tablet_manager.cc:1428] T 7b0950f44133428da14d8cec69d5e2be P cb90632f9b2b4d42a67a7279aa0f1ec0: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:15.542280 26430 ts_tablet_manager.cc:1905] T 8c128be1c0f740028cbe09bed5243b68 P cb90632f9b2b4d42a67a7279aa0f1ec0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:02:15.543467 26430 ts_tablet_manager.cc:1918] T 8c128be1c0f740028cbe09bed5243b68 P cb90632f9b2b4d42a67a7279aa0f1ec0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:02:15.543542 26430 log.cc:1196] T 8c128be1c0f740028cbe09bed5243b68 P cb90632f9b2b4d42a67a7279aa0f1ec0: Deleting WAL directory at /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/minicluster-data/ts-0/wal/wals/8c128be1c0f740028cbe09bed5243b68
I20260812 00:02:15.543745 26430 ts_tablet_manager.cc:1939] T 8c128be1c0f740028cbe09bed5243b68 P cb90632f9b2b4d42a67a7279aa0f1ec0: Deleting consensus metadata
I20260812 00:02:15.544100 25389 catalog_manager.cc:4841] TS cb90632f9b2b4d42a67a7279aa0f1ec0 (127.11.206.65:37549): tablet 8c128be1c0f740028cbe09bed5243b68 (table test-table [id=2d12d1feedc94ce494a5f99d6f394444]) successfully deleted
W20260812 00:02:15.564998 25810 tablet.cc:2369] T 7b0950f44133428da14d8cec69d5e2be P cb90632f9b2b4d42a67a7279aa0f1ec0: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 00:02:15.611984 26349 tablet.cc:2369] T 7b0950f44133428da14d8cec69d5e2be P d9866a7f50b441a9a7c03f98515dd5b6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:02:15.612464 26401 raft_consensus.cc:482] T 7b0950f44133428da14d8cec69d5e2be P cb90632f9b2b4d42a67a7279aa0f1ec0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:02:15.612555 26401 raft_consensus.cc:504] T 7b0950f44133428da14d8cec69d5e2be P cb90632f9b2b4d42a67a7279aa0f1ec0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 37549 } } peers { permanent_uuid: "f94a933b286f4427b9bf531107a94661" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37465 } } peers { permanent_uuid: "d9866a7f50b441a9a7c03f98515dd5b6" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 42795 } }
I20260812 00:02:15.612921 26401 leader_election.cc:288] T 7b0950f44133428da14d8cec69d5e2be P cb90632f9b2b4d42a67a7279aa0f1ec0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f94a933b286f4427b9bf531107a94661 (127.11.206.66:37465), d9866a7f50b441a9a7c03f98515dd5b6 (127.11.206.67:42795)
I20260812 00:02:15.616710 26444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:15.613260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.67:42795 (local address 127.11.206.65:60085)
0812 00:02:15.613444 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:15.613455 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:15.613552 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:15.613732 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:15.613733 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:15.613735 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:02:15.613794 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:15.613796 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:15.614404 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:15.614405 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:15.615666 (+ 1261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:15.615668 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:15.616435 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:15.616436 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:15.616516 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:15.616521 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 00:02:15.616573 (+ 52us) client_negotiation.cc:240] Negotiation successful
0812 00:02:15.616619 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"mutex_wait_us":30,"thread_start_us":62,"threads_started":1}
I20260812 00:02:15.616698 26384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:15.613338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.65:60085 (local address 127.11.206.67:42795)
0812 00:02:15.613409 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:15.613411 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:15.613521 (+ 110us) server_negotiation.cc:407] Connection header received
0812 00:02:15.613633 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:15.613634 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:15.613646 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:15.613692 (+ 46us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:02:15.613865 (+ 173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:15.614323 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:15.615771 (+ 1448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:15.616348 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:15.616429 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:15.616445 (+ 16us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:15.616597 (+ 152us) server_negotiation.cc:299] Negotiation successful
0812 00:02:15.616639 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260812 00:02:15.617362 26392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:15.613184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.65:43425 (local address 127.11.206.66:37465)
0812 00:02:15.613399 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:15.613401 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:15.613410 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:02:15.613437 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:15.613438 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:15.613446 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:15.613495 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:02:15.613674 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:15.614403 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:15.616483 (+ 2080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:15.617030 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:15.617113 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:15.617122 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:15.617254 (+ 132us) server_negotiation.cc:299] Negotiation successful
0812 00:02:15.617298 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":164}
I20260812 00:02:15.617287 26252 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b0950f44133428da14d8cec69d5e2be" candidate_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9866a7f50b441a9a7c03f98515dd5b6" is_pre_election: true
I20260812 00:02:15.617460 26252 raft_consensus.cc:2454] T 7b0950f44133428da14d8cec69d5e2be P d9866a7f50b441a9a7c03f98515dd5b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb90632f9b2b4d42a67a7279aa0f1ec0 in term 0.
I20260812 00:02:15.617370 26443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:15.613083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.66:37465 (local address 127.11.206.65:43425)
0812 00:02:15.613198 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:15.613209 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:15.613278 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:15.613527 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:15.613528 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:15.613530 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:02:15.613606 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:15.613609 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:15.614499 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:15.614500 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:15.615665 (+ 1165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:15.615668 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:15.617112 (+ 1444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:15.617113 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:15.617171 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:15.617192 (+ 21us) client_negotiation.cc:769] Sending connection context
0812 00:02:15.617242 (+ 50us) client_negotiation.cc:240] Negotiation successful
0812 00:02:15.617292 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":95,"mutex_wait_us":3,"thread_start_us":68,"threads_started":1}
I20260812 00:02:15.617686 25588 leader_election.cc:302] T 7b0950f44133428da14d8cec69d5e2be P cb90632f9b2b4d42a67a7279aa0f1ec0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cb90632f9b2b4d42a67a7279aa0f1ec0, d9866a7f50b441a9a7c03f98515dd5b6; no voters:
I20260812 00:02:15.617818 26401 raft_consensus.cc:2781] T 7b0950f44133428da14d8cec69d5e2be P cb90632f9b2b4d42a67a7279aa0f1ec0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:02:15.617861 26401 raft_consensus.cc:482] T 7b0950f44133428da14d8cec69d5e2be P cb90632f9b2b4d42a67a7279aa0f1ec0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:02:15.617885 26401 raft_consensus.cc:3037] T 7b0950f44133428da14d8cec69d5e2be P cb90632f9b2b4d42a67a7279aa0f1ec0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:02:15.617957 25980 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b0950f44133428da14d8cec69d5e2be" candidate_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f94a933b286f4427b9bf531107a94661" is_pre_election: true
I20260812 00:02:15.618044 25980 raft_consensus.cc:2454] T 7b0950f44133428da14d8cec69d5e2be P f94a933b286f4427b9bf531107a94661 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb90632f9b2b4d42a67a7279aa0f1ec0 in term 0.
I20260812 00:02:15.618650 26401 raft_consensus.cc:504] T 7b0950f44133428da14d8cec69d5e2be P cb90632f9b2b4d42a67a7279aa0f1ec0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 37549 } } peers { permanent_uuid: "f94a933b286f4427b9bf531107a94661" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37465 } } peers { permanent_uuid: "d9866a7f50b441a9a7c03f98515dd5b6" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 42795 } }
I20260812 00:02:15.618763 26401 leader_election.cc:288] T 7b0950f44133428da14d8cec69d5e2be P cb90632f9b2b4d42a67a7279aa0f1ec0 [CANDIDATE]: Term 1 election: Requested vote from peers f94a933b286f4427b9bf531107a94661 (127.11.206.66:37465), d9866a7f50b441a9a7c03f98515dd5b6 (127.11.206.67:42795)
I20260812 00:02:15.618918 25980 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b0950f44133428da14d8cec69d5e2be" candidate_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f94a933b286f4427b9bf531107a94661"
I20260812 00:02:15.618996 25980 raft_consensus.cc:3037] T 7b0950f44133428da14d8cec69d5e2be P f94a933b286f4427b9bf531107a94661 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:02:15.618978 26252 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b0950f44133428da14d8cec69d5e2be" candidate_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9866a7f50b441a9a7c03f98515dd5b6"
I20260812 00:02:15.619037 26252 raft_consensus.cc:3037] T 7b0950f44133428da14d8cec69d5e2be P d9866a7f50b441a9a7c03f98515dd5b6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:02:15.619798 25980 raft_consensus.cc:2454] T 7b0950f44133428da14d8cec69d5e2be P f94a933b286f4427b9bf531107a94661 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb90632f9b2b4d42a67a7279aa0f1ec0 in term 1.
I20260812 00:02:15.619967 25588 leader_election.cc:302] T 7b0950f44133428da14d8cec69d5e2be P cb90632f9b2b4d42a67a7279aa0f1ec0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cb90632f9b2b4d42a67a7279aa0f1ec0, f94a933b286f4427b9bf531107a94661; no voters:
I20260812 00:02:15.620052 26401 raft_consensus.cc:2781] T 7b0950f44133428da14d8cec69d5e2be P cb90632f9b2b4d42a67a7279aa0f1ec0 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:02:15.620191 26401 raft_consensus.cc:686] T 7b0950f44133428da14d8cec69d5e2be P cb90632f9b2b4d42a67a7279aa0f1ec0 [term 1 LEADER]: Becoming Leader. State: Replica: cb90632f9b2b4d42a67a7279aa0f1ec0, State: Running, Role: LEADER
I20260812 00:02:15.620206 26252 raft_consensus.cc:2454] T 7b0950f44133428da14d8cec69d5e2be P d9866a7f50b441a9a7c03f98515dd5b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb90632f9b2b4d42a67a7279aa0f1ec0 in term 1.
I20260812 00:02:15.620280 26401 consensus_queue.cc:237] T 7b0950f44133428da14d8cec69d5e2be P cb90632f9b2b4d42a67a7279aa0f1ec0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 37549 } } peers { permanent_uuid: "f94a933b286f4427b9bf531107a94661" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37465 } } peers { permanent_uuid: "d9866a7f50b441a9a7c03f98515dd5b6" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 42795 } }
I20260812 00:02:15.621006 25412 catalog_manager.cc:5495] T 7b0950f44133428da14d8cec69d5e2be P cb90632f9b2b4d42a67a7279aa0f1ec0 reported cstate change: term changed from 0 to 1, leader changed from <none> to cb90632f9b2b4d42a67a7279aa0f1ec0 (127.11.206.65). New cstate: current_term: 1 leader_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 37549 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f94a933b286f4427b9bf531107a94661" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9866a7f50b441a9a7c03f98515dd5b6" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 42795 } health_report { overall_health: UNKNOWN } } }
Aug 12 00:02:15 dist-test-slave-f0tn krb5kdc[25334](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492934, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.206.126@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM
I20260812 00:02:15.656723 26465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:15.650142 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:36983 (local address 127.0.0.1:60422)
0812 00:02:15.650303 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:15.650315 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:15.650381 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:15.650519 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:15.650519 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:15.650817 (+ 298us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:15.650866 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:15.650868 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:15.651455 (+ 587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:15.651455 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:15.651974 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:15.651976 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:15.652276 (+ 300us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:15.652276 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:15.652314 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:15.652840 (+ 526us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:15.652844 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:15.654221 (+ 1377us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:02:15.655642 (+ 1421us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:15.655650 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:15.655652 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:15.655836 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:15.656086 (+ 250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:15.656087 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:15.656088 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:15.656168 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:15.656391 (+ 223us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:02:15.656400 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:02:15.656445 (+ 45us) client_negotiation.cc:769] Sending connection context
0812 00:02:15.656504 (+ 59us) client_negotiation.cc:240] Negotiation successful
0812 00:02:15.656612 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":101,"threads_started":1}
I20260812 00:02:15.656782 25503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:15.650186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60422 (local address 127.11.206.126:36983)
0812 00:02:15.650241 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:15.650244 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:15.650375 (+ 131us) server_negotiation.cc:407] Connection header received
0812 00:02:15.650425 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:15.650426 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:15.650435 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:15.650492 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:15.650923 (+ 431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:15.651396 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:15.652039 (+ 643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:15.652221 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:15.652272 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:15.654317 (+ 2045us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:15.654318 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:15.654319 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:15.654325 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:15.655566 (+ 1241us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:15.655900 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:15.655901 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:15.655901 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:15.655949 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:15.656231 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:15.656231 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:15.656232 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:15.656332 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:15.656378 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:15.656532 (+ 154us) server_negotiation.cc:299] Negotiation successful
0812 00:02:15.656658 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":60,"server-negotiator.queue_time_us":34}
I20260812 00:02:15.658880 25412 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.11.206.126@KRBTEST.COM'} at 127.0.0.1:60422:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260812 00:02:15.659089 25412 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:02:15.660482 26182 tablet_service.cc:1467] Processing CreateTablet for tablet 896c95ebf1f042ffa5419b99498907a5 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=705449037e464e84a845fb0811720a0c]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 00:02:15.660472 25682 tablet_service.cc:1467] Processing CreateTablet for tablet 896c95ebf1f042ffa5419b99498907a5 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=705449037e464e84a845fb0811720a0c]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 00:02:15.660501 25945 tablet_service.cc:1467] Processing CreateTablet for tablet 896c95ebf1f042ffa5419b99498907a5 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=705449037e464e84a845fb0811720a0c]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 00:02:15.660637 25945 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 896c95ebf1f042ffa5419b99498907a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:02:15.660637 25682 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 896c95ebf1f042ffa5419b99498907a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:02:15.660640 26182 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 896c95ebf1f042ffa5419b99498907a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:02:15.661816 26394 tablet_bootstrap.cc:492] T 896c95ebf1f042ffa5419b99498907a5 P d9866a7f50b441a9a7c03f98515dd5b6: Bootstrap starting.
I20260812 00:02:15.662127 26395 tablet_bootstrap.cc:492] T 896c95ebf1f042ffa5419b99498907a5 P cb90632f9b2b4d42a67a7279aa0f1ec0: Bootstrap starting.
I20260812 00:02:15.662149 26394 tablet_bootstrap.cc:654] T 896c95ebf1f042ffa5419b99498907a5 P d9866a7f50b441a9a7c03f98515dd5b6: Neither blocks nor log segments found. Creating new log.
I20260812 00:02:15.662133 26398 tablet_bootstrap.cc:492] T 896c95ebf1f042ffa5419b99498907a5 P f94a933b286f4427b9bf531107a94661: Bootstrap starting.
I20260812 00:02:15.662547 26395 tablet_bootstrap.cc:654] T 896c95ebf1f042ffa5419b99498907a5 P cb90632f9b2b4d42a67a7279aa0f1ec0: Neither blocks nor log segments found. Creating new log.
I20260812 00:02:15.662549 26398 tablet_bootstrap.cc:654] T 896c95ebf1f042ffa5419b99498907a5 P f94a933b286f4427b9bf531107a94661: Neither blocks nor log segments found. Creating new log.
I20260812 00:02:15.662889 26394 tablet_bootstrap.cc:492] T 896c95ebf1f042ffa5419b99498907a5 P d9866a7f50b441a9a7c03f98515dd5b6: No bootstrap required, opened a new log
I20260812 00:02:15.662943 26394 ts_tablet_manager.cc:1397] T 896c95ebf1f042ffa5419b99498907a5 P d9866a7f50b441a9a7c03f98515dd5b6: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 00:02:15.663061 26394 raft_consensus.cc:348] T 896c95ebf1f042ffa5419b99498907a5 P d9866a7f50b441a9a7c03f98515dd5b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 37549 } } peers { permanent_uuid: "f94a933b286f4427b9bf531107a94661" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37465 } } peers { permanent_uuid: "d9866a7f50b441a9a7c03f98515dd5b6" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 42795 } }
I20260812 00:02:15.663138 26394 raft_consensus.cc:374] T 896c95ebf1f042ffa5419b99498907a5 P d9866a7f50b441a9a7c03f98515dd5b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:02:15.663154 26394 raft_consensus.cc:729] T 896c95ebf1f042ffa5419b99498907a5 P d9866a7f50b441a9a7c03f98515dd5b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9866a7f50b441a9a7c03f98515dd5b6, State: Initialized, Role: FOLLOWER
I20260812 00:02:15.663190 26394 consensus_queue.cc:260] T 896c95ebf1f042ffa5419b99498907a5 P d9866a7f50b441a9a7c03f98515dd5b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 37549 } } peers { permanent_uuid: "f94a933b286f4427b9bf531107a94661" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37465 } } peers { permanent_uuid: "d9866a7f50b441a9a7c03f98515dd5b6" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 42795 } }
I20260812 00:02:15.663214 26398 tablet_bootstrap.cc:492] T 896c95ebf1f042ffa5419b99498907a5 P f94a933b286f4427b9bf531107a94661: No bootstrap required, opened a new log
I20260812 00:02:15.663259 26398 ts_tablet_manager.cc:1397] T 896c95ebf1f042ffa5419b99498907a5 P f94a933b286f4427b9bf531107a94661: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260812 00:02:15.663292 26394 ts_tablet_manager.cc:1428] T 896c95ebf1f042ffa5419b99498907a5 P d9866a7f50b441a9a7c03f98515dd5b6: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:15.663395 26417 tablet_replica.cc:439] T 896c95ebf1f042ffa5419b99498907a5 P d9866a7f50b441a9a7c03f98515dd5b6: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 37549 } } peers { permanent_uuid: "f94a933b286f4427b9bf531107a94661" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37465 } } peers { permanent_uuid: "d9866a7f50b441a9a7c03f98515dd5b6" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 42795 } } }
I20260812 00:02:15.663405 26398 raft_consensus.cc:348] T 896c95ebf1f042ffa5419b99498907a5 P f94a933b286f4427b9bf531107a94661 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 37549 } } peers { permanent_uuid: "f94a933b286f4427b9bf531107a94661" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37465 } } peers { permanent_uuid: "d9866a7f50b441a9a7c03f98515dd5b6" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 42795 } }
I20260812 00:02:15.663460 26417 tablet_replica.cc:442] T 896c95ebf1f042ffa5419b99498907a5 P d9866a7f50b441a9a7c03f98515dd5b6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:02:15.663470 26398 raft_consensus.cc:374] T 896c95ebf1f042ffa5419b99498907a5 P f94a933b286f4427b9bf531107a94661 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:02:15.663496 26398 raft_consensus.cc:729] T 896c95ebf1f042ffa5419b99498907a5 P f94a933b286f4427b9bf531107a94661 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f94a933b286f4427b9bf531107a94661, State: Initialized, Role: FOLLOWER
I20260812 00:02:15.663532 26398 consensus_queue.cc:260] T 896c95ebf1f042ffa5419b99498907a5 P f94a933b286f4427b9bf531107a94661 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 37549 } } peers { permanent_uuid: "f94a933b286f4427b9bf531107a94661" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37465 } } peers { permanent_uuid: "d9866a7f50b441a9a7c03f98515dd5b6" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 42795 } }
I20260812 00:02:15.663616 26398 ts_tablet_manager.cc:1428] T 896c95ebf1f042ffa5419b99498907a5 P f94a933b286f4427b9bf531107a94661: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:15.663770 26405 tablet_replica.cc:439] T 896c95ebf1f042ffa5419b99498907a5 P f94a933b286f4427b9bf531107a94661: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 37549 } } peers { permanent_uuid: "f94a933b286f4427b9bf531107a94661" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37465 } } peers { permanent_uuid: "d9866a7f50b441a9a7c03f98515dd5b6" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 42795 } } }
I20260812 00:02:15.663854 26405 tablet_replica.cc:442] T 896c95ebf1f042ffa5419b99498907a5 P f94a933b286f4427b9bf531107a94661: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:02:15.664148 26395 tablet_bootstrap.cc:492] T 896c95ebf1f042ffa5419b99498907a5 P cb90632f9b2b4d42a67a7279aa0f1ec0: No bootstrap required, opened a new log
I20260812 00:02:15.664196 26395 ts_tablet_manager.cc:1397] T 896c95ebf1f042ffa5419b99498907a5 P cb90632f9b2b4d42a67a7279aa0f1ec0: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260812 00:02:15.664333 26395 raft_consensus.cc:348] T 896c95ebf1f042ffa5419b99498907a5 P cb90632f9b2b4d42a67a7279aa0f1ec0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 37549 } } peers { permanent_uuid: "f94a933b286f4427b9bf531107a94661" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37465 } } peers { permanent_uuid: "d9866a7f50b441a9a7c03f98515dd5b6" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 42795 } }
I20260812 00:02:15.664395 26395 raft_consensus.cc:374] T 896c95ebf1f042ffa5419b99498907a5 P cb90632f9b2b4d42a67a7279aa0f1ec0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:02:15.664412 26395 raft_consensus.cc:729] T 896c95ebf1f042ffa5419b99498907a5 P cb90632f9b2b4d42a67a7279aa0f1ec0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb90632f9b2b4d42a67a7279aa0f1ec0, State: Initialized, Role: FOLLOWER
I20260812 00:02:15.664454 26395 consensus_queue.cc:260] T 896c95ebf1f042ffa5419b99498907a5 P cb90632f9b2b4d42a67a7279aa0f1ec0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 37549 } } peers { permanent_uuid: "f94a933b286f4427b9bf531107a94661" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37465 } } peers { permanent_uuid: "d9866a7f50b441a9a7c03f98515dd5b6" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 42795 } }
I20260812 00:02:15.664542 26395 ts_tablet_manager.cc:1428] T 896c95ebf1f042ffa5419b99498907a5 P cb90632f9b2b4d42a67a7279aa0f1ec0: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:15.664589 26401 tablet_replica.cc:439] T 896c95ebf1f042ffa5419b99498907a5 P cb90632f9b2b4d42a67a7279aa0f1ec0: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 37549 } } peers { permanent_uuid: "f94a933b286f4427b9bf531107a94661" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37465 } } peers { permanent_uuid: "d9866a7f50b441a9a7c03f98515dd5b6" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 42795 } } }
I20260812 00:02:15.664666 26401 tablet_replica.cc:442] T 896c95ebf1f042ffa5419b99498907a5 P cb90632f9b2b4d42a67a7279aa0f1ec0: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:02:15.942961 26401 raft_consensus.cc:482] T 896c95ebf1f042ffa5419b99498907a5 P cb90632f9b2b4d42a67a7279aa0f1ec0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:02:15.943060 26401 raft_consensus.cc:504] T 896c95ebf1f042ffa5419b99498907a5 P cb90632f9b2b4d42a67a7279aa0f1ec0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 37549 } } peers { permanent_uuid: "f94a933b286f4427b9bf531107a94661" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37465 } } peers { permanent_uuid: "d9866a7f50b441a9a7c03f98515dd5b6" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 42795 } }
I20260812 00:02:15.943216 26401 leader_election.cc:288] T 896c95ebf1f042ffa5419b99498907a5 P cb90632f9b2b4d42a67a7279aa0f1ec0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f94a933b286f4427b9bf531107a94661 (127.11.206.66:37465), d9866a7f50b441a9a7c03f98515dd5b6 (127.11.206.67:42795)
I20260812 00:02:15.943439 25980 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "896c95ebf1f042ffa5419b99498907a5" candidate_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f94a933b286f4427b9bf531107a94661" is_pre_election: true
I20260812 00:02:15.943459 26252 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "896c95ebf1f042ffa5419b99498907a5" candidate_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9866a7f50b441a9a7c03f98515dd5b6" is_pre_election: true
I20260812 00:02:15.943549 25980 raft_consensus.cc:2454] T 896c95ebf1f042ffa5419b99498907a5 P f94a933b286f4427b9bf531107a94661 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb90632f9b2b4d42a67a7279aa0f1ec0 in term 0.
I20260812 00:02:15.943549 26252 raft_consensus.cc:2454] T 896c95ebf1f042ffa5419b99498907a5 P d9866a7f50b441a9a7c03f98515dd5b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb90632f9b2b4d42a67a7279aa0f1ec0 in term 0.
I20260812 00:02:15.943696 25588 leader_election.cc:302] T 896c95ebf1f042ffa5419b99498907a5 P cb90632f9b2b4d42a67a7279aa0f1ec0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cb90632f9b2b4d42a67a7279aa0f1ec0, f94a933b286f4427b9bf531107a94661; no voters:
I20260812 00:02:15.943794 26401 raft_consensus.cc:2781] T 896c95ebf1f042ffa5419b99498907a5 P cb90632f9b2b4d42a67a7279aa0f1ec0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:02:15.943833 26401 raft_consensus.cc:482] T 896c95ebf1f042ffa5419b99498907a5 P cb90632f9b2b4d42a67a7279aa0f1ec0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:02:15.943859 26401 raft_consensus.cc:3037] T 896c95ebf1f042ffa5419b99498907a5 P cb90632f9b2b4d42a67a7279aa0f1ec0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:02:15.944571 26401 raft_consensus.cc:504] T 896c95ebf1f042ffa5419b99498907a5 P cb90632f9b2b4d42a67a7279aa0f1ec0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 37549 } } peers { permanent_uuid: "f94a933b286f4427b9bf531107a94661" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37465 } } peers { permanent_uuid: "d9866a7f50b441a9a7c03f98515dd5b6" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 42795 } }
I20260812 00:02:15.944675 26401 leader_election.cc:288] T 896c95ebf1f042ffa5419b99498907a5 P cb90632f9b2b4d42a67a7279aa0f1ec0 [CANDIDATE]: Term 1 election: Requested vote from peers f94a933b286f4427b9bf531107a94661 (127.11.206.66:37465), d9866a7f50b441a9a7c03f98515dd5b6 (127.11.206.67:42795)
I20260812 00:02:15.944872 25980 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "896c95ebf1f042ffa5419b99498907a5" candidate_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f94a933b286f4427b9bf531107a94661"
I20260812 00:02:15.944908 26252 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "896c95ebf1f042ffa5419b99498907a5" candidate_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9866a7f50b441a9a7c03f98515dd5b6"
I20260812 00:02:15.944967 25980 raft_consensus.cc:3037] T 896c95ebf1f042ffa5419b99498907a5 P f94a933b286f4427b9bf531107a94661 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:02:15.944972 26252 raft_consensus.cc:3037] T 896c95ebf1f042ffa5419b99498907a5 P d9866a7f50b441a9a7c03f98515dd5b6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:02:15.945750 26252 raft_consensus.cc:2454] T 896c95ebf1f042ffa5419b99498907a5 P d9866a7f50b441a9a7c03f98515dd5b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb90632f9b2b4d42a67a7279aa0f1ec0 in term 1.
I20260812 00:02:15.945760 25980 raft_consensus.cc:2454] T 896c95ebf1f042ffa5419b99498907a5 P f94a933b286f4427b9bf531107a94661 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb90632f9b2b4d42a67a7279aa0f1ec0 in term 1.
I20260812 00:02:15.945933 25588 leader_election.cc:302] T 896c95ebf1f042ffa5419b99498907a5 P cb90632f9b2b4d42a67a7279aa0f1ec0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cb90632f9b2b4d42a67a7279aa0f1ec0, f94a933b286f4427b9bf531107a94661; no voters:
I20260812 00:02:15.946024 26401 raft_consensus.cc:2781] T 896c95ebf1f042ffa5419b99498907a5 P cb90632f9b2b4d42a67a7279aa0f1ec0 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:02:15.946075 26401 raft_consensus.cc:686] T 896c95ebf1f042ffa5419b99498907a5 P cb90632f9b2b4d42a67a7279aa0f1ec0 [term 1 LEADER]: Becoming Leader. State: Replica: cb90632f9b2b4d42a67a7279aa0f1ec0, State: Running, Role: LEADER
I20260812 00:02:15.946121 26401 consensus_queue.cc:237] T 896c95ebf1f042ffa5419b99498907a5 P cb90632f9b2b4d42a67a7279aa0f1ec0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 37549 } } peers { permanent_uuid: "f94a933b286f4427b9bf531107a94661" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37465 } } peers { permanent_uuid: "d9866a7f50b441a9a7c03f98515dd5b6" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 42795 } }
I20260812 00:02:15.946439 26446 tablet_replica.cc:439] T 896c95ebf1f042ffa5419b99498907a5 P cb90632f9b2b4d42a67a7279aa0f1ec0: TxnStatusTablet state changed. Reason: New leader cb90632f9b2b4d42a67a7279aa0f1ec0. Latest consensus state: current_term: 1 leader_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 37549 } } peers { permanent_uuid: "f94a933b286f4427b9bf531107a94661" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37465 } } peers { permanent_uuid: "d9866a7f50b441a9a7c03f98515dd5b6" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 42795 } } }
I20260812 00:02:15.946527 26446 tablet_replica.cc:442] T 896c95ebf1f042ffa5419b99498907a5 P cb90632f9b2b4d42a67a7279aa0f1ec0: This TxnStatusTablet replica's current role is: LEADER
I20260812 00:02:15.946699 26471 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260812 00:02:15.946841 26471 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260812 00:02:15.946807 25410 catalog_manager.cc:5495] T 896c95ebf1f042ffa5419b99498907a5 P cb90632f9b2b4d42a67a7279aa0f1ec0 reported cstate change: term changed from 0 to 1, leader changed from <none> to cb90632f9b2b4d42a67a7279aa0f1ec0 (127.11.206.65). New cstate: current_term: 1 leader_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 37549 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f94a933b286f4427b9bf531107a94661" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9866a7f50b441a9a7c03f98515dd5b6" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260812 00:02:15.996713 26446 consensus_queue.cc:1035] T 7b0950f44133428da14d8cec69d5e2be P cb90632f9b2b4d42a67a7279aa0f1ec0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f94a933b286f4427b9bf531107a94661" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:02:15.998651 26401 consensus_queue.cc:1035] T 7b0950f44133428da14d8cec69d5e2be P cb90632f9b2b4d42a67a7279aa0f1ec0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9866a7f50b441a9a7c03f98515dd5b6" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:02:16.017421 26465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:16.014779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.65:37549 (local address 127.0.0.1:38902)
0812 00:02:16.014847 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:16.014860 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:16.014923 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:16.015141 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:16.015142 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:16.015143 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 00:02:16.015196 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:16.015199 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:16.015822 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:16.015823 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:16.016526 (+ 703us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:16.016531 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:16.016885 (+ 354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:16.016886 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:16.016957 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:16.016976 (+ 19us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 00:02:16.017219 (+ 243us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 00:02:16.017229 (+ 10us) client_negotiation.cc:769] Sending connection context
0812 00:02:16.017273 (+ 44us) client_negotiation.cc:240] Negotiation successful
0812 00:02:16.017326 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260812 00:02:16.017426 26484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:16.014874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38902 (local address 127.11.206.65:37549)
0812 00:02:16.015003 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:16.015005 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:16.015013 (+ 8us) server_negotiation.cc:407] Connection header received
0812 00:02:16.015045 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:16.015046 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:16.015062 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:16.015126 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:02:16.015272 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:16.015745 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:16.016604 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:16.016820 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:16.016876 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:16.017058 (+ 182us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:02:16.017160 (+ 102us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:02:16.017222 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:16.017277 (+ 55us) server_negotiation.cc:299] Negotiation successful
0812 00:02:16.017300 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109,"thread_start_us":66,"threads_started":1}
I20260812 00:02:16.018687 26252 raft_consensus.cc:1261] T 896c95ebf1f042ffa5419b99498907a5 P d9866a7f50b441a9a7c03f98515dd5b6 [term 1 FOLLOWER]: Refusing update from remote peer cb90632f9b2b4d42a67a7279aa0f1ec0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:02:16.018711 25980 raft_consensus.cc:1261] T 896c95ebf1f042ffa5419b99498907a5 P f94a933b286f4427b9bf531107a94661 [term 1 FOLLOWER]: Refusing update from remote peer cb90632f9b2b4d42a67a7279aa0f1ec0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:02:16.018934 26446 consensus_queue.cc:1035] T 896c95ebf1f042ffa5419b99498907a5 P cb90632f9b2b4d42a67a7279aa0f1ec0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9866a7f50b441a9a7c03f98515dd5b6" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:02:16.019052 26401 consensus_queue.cc:1035] T 896c95ebf1f042ffa5419b99498907a5 P cb90632f9b2b4d42a67a7279aa0f1ec0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f94a933b286f4427b9bf531107a94661" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:02:16.019660 26405 tablet_replica.cc:439] T 896c95ebf1f042ffa5419b99498907a5 P f94a933b286f4427b9bf531107a94661: TxnStatusTablet state changed. Reason: New leader cb90632f9b2b4d42a67a7279aa0f1ec0. Latest consensus state: current_term: 1 leader_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 37549 } } peers { permanent_uuid: "f94a933b286f4427b9bf531107a94661" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37465 } } peers { permanent_uuid: "d9866a7f50b441a9a7c03f98515dd5b6" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 42795 } } }
I20260812 00:02:16.019757 26405 tablet_replica.cc:442] T 896c95ebf1f042ffa5419b99498907a5 P f94a933b286f4427b9bf531107a94661: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:02:16.019708 26417 tablet_replica.cc:439] T 896c95ebf1f042ffa5419b99498907a5 P d9866a7f50b441a9a7c03f98515dd5b6: TxnStatusTablet state changed. Reason: New leader cb90632f9b2b4d42a67a7279aa0f1ec0. Latest consensus state: current_term: 1 leader_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 37549 } } peers { permanent_uuid: "f94a933b286f4427b9bf531107a94661" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37465 } } peers { permanent_uuid: "d9866a7f50b441a9a7c03f98515dd5b6" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 42795 } } }
I20260812 00:02:16.019825 26417 tablet_replica.cc:442] T 896c95ebf1f042ffa5419b99498907a5 P d9866a7f50b441a9a7c03f98515dd5b6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:02:16.020493 26446 tablet_replica.cc:439] T 896c95ebf1f042ffa5419b99498907a5 P cb90632f9b2b4d42a67a7279aa0f1ec0: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 37549 } } peers { permanent_uuid: "f94a933b286f4427b9bf531107a94661" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37465 } } peers { permanent_uuid: "d9866a7f50b441a9a7c03f98515dd5b6" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 42795 } } }
I20260812 00:02:16.020572 26446 tablet_replica.cc:442] T 896c95ebf1f042ffa5419b99498907a5 P cb90632f9b2b4d42a67a7279aa0f1ec0: This TxnStatusTablet replica's current role is: LEADER
I20260812 00:02:16.021051 26405 tablet_replica.cc:439] T 896c95ebf1f042ffa5419b99498907a5 P f94a933b286f4427b9bf531107a94661: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 37549 } } peers { permanent_uuid: "f94a933b286f4427b9bf531107a94661" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37465 } } peers { permanent_uuid: "d9866a7f50b441a9a7c03f98515dd5b6" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 42795 } } }
I20260812 00:02:16.021136 26405 tablet_replica.cc:442] T 896c95ebf1f042ffa5419b99498907a5 P f94a933b286f4427b9bf531107a94661: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:02:16.022025 26401 tablet_replica.cc:439] T 896c95ebf1f042ffa5419b99498907a5 P cb90632f9b2b4d42a67a7279aa0f1ec0: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 37549 } } peers { permanent_uuid: "f94a933b286f4427b9bf531107a94661" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37465 } } peers { permanent_uuid: "d9866a7f50b441a9a7c03f98515dd5b6" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 42795 } } }
I20260812 00:02:16.022123 26401 tablet_replica.cc:442] T 896c95ebf1f042ffa5419b99498907a5 P cb90632f9b2b4d42a67a7279aa0f1ec0: This TxnStatusTablet replica's current role is: LEADER
I20260812 00:02:16.022240 26417 tablet_replica.cc:439] T 896c95ebf1f042ffa5419b99498907a5 P d9866a7f50b441a9a7c03f98515dd5b6: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 37549 } } peers { permanent_uuid: "f94a933b286f4427b9bf531107a94661" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37465 } } peers { permanent_uuid: "d9866a7f50b441a9a7c03f98515dd5b6" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 42795 } } }
I20260812 00:02:16.022336 26417 tablet_replica.cc:442] T 896c95ebf1f042ffa5419b99498907a5 P d9866a7f50b441a9a7c03f98515dd5b6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:02:16.025309 26484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:16.023215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38918 (local address 127.11.206.65:37549)
0812 00:02:16.023251 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:16.023259 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:16.023269 (+ 10us) server_negotiation.cc:407] Connection header received
0812 00:02:16.023331 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:16.023331 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:16.023341 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:16.023392 (+ 51us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:02:16.023496 (+ 104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:16.023949 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:16.024684 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:16.024887 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:16.024941 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:16.025088 (+ 147us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:02:16.025122 (+ 34us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:02:16.025165 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:16.025217 (+ 52us) server_negotiation.cc:299] Negotiation successful
0812 00:02:16.025237 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260812 00:02:16.030519 26484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:16.028015 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.65:55991 (local address 127.11.206.65:37549)
0812 00:02:16.028063 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:16.028065 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:16.028219 (+ 154us) server_negotiation.cc:407] Connection header received
0812 00:02:16.028248 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:16.028249 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:16.028260 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:16.028321 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:02:16.028418 (+ 97us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:16.029099 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:16.029916 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:16.030089 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:16.030142 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:16.030293 (+ 151us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:02:16.030322 (+ 29us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:02:16.030362 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:16.030423 (+ 61us) server_negotiation.cc:299] Negotiation successful
0812 00:02:16.030439 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260812 00:02:16.030599 26493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:16.027941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.65:37549 (local address 127.11.206.65:55991)
0812 00:02:16.028121 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:16.028128 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:16.028177 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:16.028322 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:16.028323 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:16.028324 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 00:02:16.028376 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:16.028377 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:16.029188 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:16.029188 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:16.029839 (+ 651us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:16.029841 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:16.030148 (+ 307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:16.030149 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:16.030210 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:16.030223 (+ 13us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 00:02:16.030372 (+ 149us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 00:02:16.030374 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 00:02:16.030414 (+ 40us) client_negotiation.cc:240] Negotiation successful
0812 00:02:16.030457 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":84,"threads_started":1}
I20260812 00:02:16.047432 25412 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60410:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:02:16.047541 25412 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60410:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:02:16.048151 25412 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9aff16bf5c77499a83c2e866ba8d27a9: Sending DeleteTablet for 3 replicas of tablet 7b0950f44133428da14d8cec69d5e2be
I20260812 00:02:16.048377 25678 tablet_service.cc:1514] Processing DeleteTablet for tablet 7b0950f44133428da14d8cec69d5e2be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:02:16 UTC) from {username='oryx', principal='oryx/127.11.206.126@KRBTEST.COM'} at 127.0.0.1:38898
I20260812 00:02:16.048416 26182 tablet_service.cc:1514] Processing DeleteTablet for tablet 7b0950f44133428da14d8cec69d5e2be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:02:16 UTC) from {username='oryx', principal='oryx/127.11.206.126@KRBTEST.COM'} at 127.0.0.1:41788
I20260812 00:02:16.048599 26497 tablet_replica.cc:330] T 7b0950f44133428da14d8cec69d5e2be P d9866a7f50b441a9a7c03f98515dd5b6: stopping tablet replica
I20260812 00:02:16.048643 25945 tablet_service.cc:1514] Processing DeleteTablet for tablet 7b0950f44133428da14d8cec69d5e2be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:02:16 UTC) from {username='oryx', principal='oryx/127.11.206.126@KRBTEST.COM'} at 127.0.0.1:34098
I20260812 00:02:16.048687 26497 raft_consensus.cc:2229] T 7b0950f44133428da14d8cec69d5e2be P d9866a7f50b441a9a7c03f98515dd5b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:02:16.048738 26497 raft_consensus.cc:2258] T 7b0950f44133428da14d8cec69d5e2be P d9866a7f50b441a9a7c03f98515dd5b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:02:16.048889 26498 tablet_replica.cc:330] T 7b0950f44133428da14d8cec69d5e2be P f94a933b286f4427b9bf531107a94661: stopping tablet replica
I20260812 00:02:16.048945 26498 raft_consensus.cc:2229] T 7b0950f44133428da14d8cec69d5e2be P f94a933b286f4427b9bf531107a94661 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:02:16.048985 26498 raft_consensus.cc:2258] T 7b0950f44133428da14d8cec69d5e2be P f94a933b286f4427b9bf531107a94661 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:02:16.049029 26497 ts_tablet_manager.cc:1905] T 7b0950f44133428da14d8cec69d5e2be P d9866a7f50b441a9a7c03f98515dd5b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:02:16.049228 26498 ts_tablet_manager.cc:1905] T 7b0950f44133428da14d8cec69d5e2be P f94a933b286f4427b9bf531107a94661: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:02:16.050865 26498 ts_tablet_manager.cc:1918] T 7b0950f44133428da14d8cec69d5e2be P f94a933b286f4427b9bf531107a94661: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 00:02:16.050916 26498 log.cc:1196] T 7b0950f44133428da14d8cec69d5e2be P f94a933b286f4427b9bf531107a94661: Deleting WAL directory at /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/minicluster-data/ts-1/wal/wals/7b0950f44133428da14d8cec69d5e2be
I20260812 00:02:16.051079 26497 ts_tablet_manager.cc:1918] T 7b0950f44133428da14d8cec69d5e2be P d9866a7f50b441a9a7c03f98515dd5b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 00:02:16.051123 26498 ts_tablet_manager.cc:1939] T 7b0950f44133428da14d8cec69d5e2be P f94a933b286f4427b9bf531107a94661: Deleting consensus metadata
I20260812 00:02:16.051139 26497 log.cc:1196] T 7b0950f44133428da14d8cec69d5e2be P d9866a7f50b441a9a7c03f98515dd5b6: Deleting WAL directory at /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/minicluster-data/ts-2/wal/wals/7b0950f44133428da14d8cec69d5e2be
I20260812 00:02:16.051363 26497 ts_tablet_manager.cc:1939] T 7b0950f44133428da14d8cec69d5e2be P d9866a7f50b441a9a7c03f98515dd5b6: Deleting consensus metadata
I20260812 00:02:16.051438 25390 catalog_manager.cc:4841] TS f94a933b286f4427b9bf531107a94661 (127.11.206.66:37465): tablet 7b0950f44133428da14d8cec69d5e2be (table test-table [id=3508ba3dace5434abed4754f6f4ef433]) successfully deleted
I20260812 00:02:16.051669 25390 catalog_manager.cc:4841] TS d9866a7f50b441a9a7c03f98515dd5b6 (127.11.206.67:42795): tablet 7b0950f44133428da14d8cec69d5e2be (table test-table [id=3508ba3dace5434abed4754f6f4ef433]) successfully deleted
I20260812 00:02:16.051682 26496 tablet_replica.cc:330] T 7b0950f44133428da14d8cec69d5e2be P cb90632f9b2b4d42a67a7279aa0f1ec0: stopping tablet replica
I20260812 00:02:16.051743 26496 raft_consensus.cc:2229] T 7b0950f44133428da14d8cec69d5e2be P cb90632f9b2b4d42a67a7279aa0f1ec0 [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:02:16.051864 26496 raft_consensus.cc:2258] T 7b0950f44133428da14d8cec69d5e2be P cb90632f9b2b4d42a67a7279aa0f1ec0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:02:16.052105 26496 ts_tablet_manager.cc:1905] T 7b0950f44133428da14d8cec69d5e2be P cb90632f9b2b4d42a67a7279aa0f1ec0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:02:16.053332 26496 ts_tablet_manager.cc:1918] T 7b0950f44133428da14d8cec69d5e2be P cb90632f9b2b4d42a67a7279aa0f1ec0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 00:02:16.053422 26496 log.cc:1196] T 7b0950f44133428da14d8cec69d5e2be P cb90632f9b2b4d42a67a7279aa0f1ec0: Deleting WAL directory at /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/minicluster-data/ts-0/wal/wals/7b0950f44133428da14d8cec69d5e2be
I20260812 00:02:16.053673 26496 ts_tablet_manager.cc:1939] T 7b0950f44133428da14d8cec69d5e2be P cb90632f9b2b4d42a67a7279aa0f1ec0: Deleting consensus metadata
I20260812 00:02:16.054004 25389 catalog_manager.cc:4841] TS cb90632f9b2b4d42a67a7279aa0f1ec0 (127.11.206.65:37549): tablet 7b0950f44133428da14d8cec69d5e2be (table test-table [id=3508ba3dace5434abed4754f6f4ef433]) successfully deleted
Aug 12 00:02:16 dist-test-slave-f0tn krb5kdc[25334](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492936, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 00:02:16 dist-test-slave-f0tn krb5kdc[25334](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:02:16 dist-test-slave-f0tn krb5kdc[25334](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
W20260812 00:02:16.075071 25503 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:02:16.069659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60438 (local address 127.11.206.126:36983)
0812 00:02:16.069703 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:16.069705 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:16.069897 (+ 192us) server_negotiation.cc:407] Connection header received
0812 00:02:16.069965 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:16.069966 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:16.069978 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:16.070036 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:16.070622 (+ 586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:16.071119 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:16.071858 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:16.072055 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:16.072112 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:16.075006 (+ 2894us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60438: BlockingRecv error: recv got EOF from 127.0.0.1:60438 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
Aug 12 00:02:16 dist-test-slave-f0tn krb5kdc[25334](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492936, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM
I20260812 00:02:16.082850 25503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:16.075896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60450 (local address 127.11.206.126:36983)
0812 00:02:16.075946 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:16.075948 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:16.075956 (+ 8us) server_negotiation.cc:407] Connection header received
0812 00:02:16.076013 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:16.076014 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:16.076024 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:16.076068 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:16.076506 (+ 438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:16.076976 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:16.077697 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:16.077898 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:16.077952 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:16.080284 (+ 2332us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:16.080286 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:16.080286 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:16.080293 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:16.081678 (+ 1385us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:16.082078 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:16.082079 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:16.082079 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:16.082129 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:16.082386 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:16.082387 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:16.082387 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:16.082495 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:16.082568 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:16.082716 (+ 148us) server_negotiation.cc:299] Negotiation successful
0812 00:02:16.082778 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 00:02:16.084487 25412 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60450:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:02:16.084649 25412 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:02:16.086119 25945 tablet_service.cc:1467] Processing CreateTablet for tablet 5c828d63e8ec4926a3cb835ec7013e90 (DEFAULT_TABLE table=test-table [id=e62718eabd2942c19da248d70c90ebdb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:02:16.086118 25678 tablet_service.cc:1467] Processing CreateTablet for tablet 5c828d63e8ec4926a3cb835ec7013e90 (DEFAULT_TABLE table=test-table [id=e62718eabd2942c19da248d70c90ebdb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:02:16.086267 25945 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c828d63e8ec4926a3cb835ec7013e90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:02:16.086265 25678 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c828d63e8ec4926a3cb835ec7013e90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:02:16.087605 26395 tablet_bootstrap.cc:492] T 5c828d63e8ec4926a3cb835ec7013e90 P cb90632f9b2b4d42a67a7279aa0f1ec0: Bootstrap starting.
I20260812 00:02:16.087628 26398 tablet_bootstrap.cc:492] T 5c828d63e8ec4926a3cb835ec7013e90 P f94a933b286f4427b9bf531107a94661: Bootstrap starting.
I20260812 00:02:16.087649 26182 tablet_service.cc:1467] Processing CreateTablet for tablet 5c828d63e8ec4926a3cb835ec7013e90 (DEFAULT_TABLE table=test-table [id=e62718eabd2942c19da248d70c90ebdb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:02:16.087766 26182 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c828d63e8ec4926a3cb835ec7013e90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:02:16.087939 26395 tablet_bootstrap.cc:654] T 5c828d63e8ec4926a3cb835ec7013e90 P cb90632f9b2b4d42a67a7279aa0f1ec0: Neither blocks nor log segments found. Creating new log.
I20260812 00:02:16.088088 26398 tablet_bootstrap.cc:654] T 5c828d63e8ec4926a3cb835ec7013e90 P f94a933b286f4427b9bf531107a94661: Neither blocks nor log segments found. Creating new log.
I20260812 00:02:16.088651 26395 tablet_bootstrap.cc:492] T 5c828d63e8ec4926a3cb835ec7013e90 P cb90632f9b2b4d42a67a7279aa0f1ec0: No bootstrap required, opened a new log
I20260812 00:02:16.088706 26395 ts_tablet_manager.cc:1397] T 5c828d63e8ec4926a3cb835ec7013e90 P cb90632f9b2b4d42a67a7279aa0f1ec0: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260812 00:02:16.088824 26395 raft_consensus.cc:348] T 5c828d63e8ec4926a3cb835ec7013e90 P cb90632f9b2b4d42a67a7279aa0f1ec0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 37549 } } peers { permanent_uuid: "f94a933b286f4427b9bf531107a94661" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37465 } } peers { permanent_uuid: "d9866a7f50b441a9a7c03f98515dd5b6" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 42795 } }
I20260812 00:02:16.088897 26395 raft_consensus.cc:374] T 5c828d63e8ec4926a3cb835ec7013e90 P cb90632f9b2b4d42a67a7279aa0f1ec0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:02:16.088917 26395 raft_consensus.cc:729] T 5c828d63e8ec4926a3cb835ec7013e90 P cb90632f9b2b4d42a67a7279aa0f1ec0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb90632f9b2b4d42a67a7279aa0f1ec0, State: Initialized, Role: FOLLOWER
I20260812 00:02:16.088961 26395 consensus_queue.cc:260] T 5c828d63e8ec4926a3cb835ec7013e90 P cb90632f9b2b4d42a67a7279aa0f1ec0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 37549 } } peers { permanent_uuid: "f94a933b286f4427b9bf531107a94661" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37465 } } peers { permanent_uuid: "d9866a7f50b441a9a7c03f98515dd5b6" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 42795 } }
I20260812 00:02:16.089058 26395 ts_tablet_manager.cc:1428] T 5c828d63e8ec4926a3cb835ec7013e90 P cb90632f9b2b4d42a67a7279aa0f1ec0: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:16.089133 26394 tablet_bootstrap.cc:492] T 5c828d63e8ec4926a3cb835ec7013e90 P d9866a7f50b441a9a7c03f98515dd5b6: Bootstrap starting.
I20260812 00:02:16.089632 26398 tablet_bootstrap.cc:492] T 5c828d63e8ec4926a3cb835ec7013e90 P f94a933b286f4427b9bf531107a94661: No bootstrap required, opened a new log
I20260812 00:02:16.089677 26398 ts_tablet_manager.cc:1397] T 5c828d63e8ec4926a3cb835ec7013e90 P f94a933b286f4427b9bf531107a94661: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.000s
I20260812 00:02:16.089821 26394 tablet_bootstrap.cc:654] T 5c828d63e8ec4926a3cb835ec7013e90 P d9866a7f50b441a9a7c03f98515dd5b6: Neither blocks nor log segments found. Creating new log.
I20260812 00:02:16.089844 26398 raft_consensus.cc:348] T 5c828d63e8ec4926a3cb835ec7013e90 P f94a933b286f4427b9bf531107a94661 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 37549 } } peers { permanent_uuid: "f94a933b286f4427b9bf531107a94661" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37465 } } peers { permanent_uuid: "d9866a7f50b441a9a7c03f98515dd5b6" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 42795 } }
I20260812 00:02:16.089912 26398 raft_consensus.cc:374] T 5c828d63e8ec4926a3cb835ec7013e90 P f94a933b286f4427b9bf531107a94661 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:02:16.089928 26398 raft_consensus.cc:729] T 5c828d63e8ec4926a3cb835ec7013e90 P f94a933b286f4427b9bf531107a94661 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f94a933b286f4427b9bf531107a94661, State: Initialized, Role: FOLLOWER
I20260812 00:02:16.089967 26398 consensus_queue.cc:260] T 5c828d63e8ec4926a3cb835ec7013e90 P f94a933b286f4427b9bf531107a94661 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 37549 } } peers { permanent_uuid: "f94a933b286f4427b9bf531107a94661" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37465 } } peers { permanent_uuid: "d9866a7f50b441a9a7c03f98515dd5b6" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 42795 } }
I20260812 00:02:16.090049 26398 ts_tablet_manager.cc:1428] T 5c828d63e8ec4926a3cb835ec7013e90 P f94a933b286f4427b9bf531107a94661: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:16.090646 26394 tablet_bootstrap.cc:492] T 5c828d63e8ec4926a3cb835ec7013e90 P d9866a7f50b441a9a7c03f98515dd5b6: No bootstrap required, opened a new log
I20260812 00:02:16.090698 26394 ts_tablet_manager.cc:1397] T 5c828d63e8ec4926a3cb835ec7013e90 P d9866a7f50b441a9a7c03f98515dd5b6: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 00:02:16.090801 26394 raft_consensus.cc:348] T 5c828d63e8ec4926a3cb835ec7013e90 P d9866a7f50b441a9a7c03f98515dd5b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 37549 } } peers { permanent_uuid: "f94a933b286f4427b9bf531107a94661" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37465 } } peers { permanent_uuid: "d9866a7f50b441a9a7c03f98515dd5b6" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 42795 } }
I20260812 00:02:16.090862 26394 raft_consensus.cc:374] T 5c828d63e8ec4926a3cb835ec7013e90 P d9866a7f50b441a9a7c03f98515dd5b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:02:16.090883 26394 raft_consensus.cc:729] T 5c828d63e8ec4926a3cb835ec7013e90 P d9866a7f50b441a9a7c03f98515dd5b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9866a7f50b441a9a7c03f98515dd5b6, State: Initialized, Role: FOLLOWER
I20260812 00:02:16.090921 26394 consensus_queue.cc:260] T 5c828d63e8ec4926a3cb835ec7013e90 P d9866a7f50b441a9a7c03f98515dd5b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 37549 } } peers { permanent_uuid: "f94a933b286f4427b9bf531107a94661" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37465 } } peers { permanent_uuid: "d9866a7f50b441a9a7c03f98515dd5b6" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 42795 } }
I20260812 00:02:16.091006 26394 ts_tablet_manager.cc:1428] T 5c828d63e8ec4926a3cb835ec7013e90 P d9866a7f50b441a9a7c03f98515dd5b6: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:16.092355 26446 raft_consensus.cc:482] T 5c828d63e8ec4926a3cb835ec7013e90 P cb90632f9b2b4d42a67a7279aa0f1ec0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:02:16.092432 26446 raft_consensus.cc:504] T 5c828d63e8ec4926a3cb835ec7013e90 P cb90632f9b2b4d42a67a7279aa0f1ec0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 37549 } } peers { permanent_uuid: "f94a933b286f4427b9bf531107a94661" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37465 } } peers { permanent_uuid: "d9866a7f50b441a9a7c03f98515dd5b6" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 42795 } }
I20260812 00:02:16.092576 26446 leader_election.cc:288] T 5c828d63e8ec4926a3cb835ec7013e90 P cb90632f9b2b4d42a67a7279aa0f1ec0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f94a933b286f4427b9bf531107a94661 (127.11.206.66:37465), d9866a7f50b441a9a7c03f98515dd5b6 (127.11.206.67:42795)
I20260812 00:02:16.092738 25980 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c828d63e8ec4926a3cb835ec7013e90" candidate_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f94a933b286f4427b9bf531107a94661" is_pre_election: true
I20260812 00:02:16.092752 26252 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c828d63e8ec4926a3cb835ec7013e90" candidate_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9866a7f50b441a9a7c03f98515dd5b6" is_pre_election: true
I20260812 00:02:16.092818 25980 raft_consensus.cc:2454] T 5c828d63e8ec4926a3cb835ec7013e90 P f94a933b286f4427b9bf531107a94661 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb90632f9b2b4d42a67a7279aa0f1ec0 in term 0.
I20260812 00:02:16.092826 26252 raft_consensus.cc:2454] T 5c828d63e8ec4926a3cb835ec7013e90 P d9866a7f50b441a9a7c03f98515dd5b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb90632f9b2b4d42a67a7279aa0f1ec0 in term 0.
I20260812 00:02:16.092957 25588 leader_election.cc:302] T 5c828d63e8ec4926a3cb835ec7013e90 P cb90632f9b2b4d42a67a7279aa0f1ec0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cb90632f9b2b4d42a67a7279aa0f1ec0, f94a933b286f4427b9bf531107a94661; no voters:
I20260812 00:02:16.093070 26446 raft_consensus.cc:2781] T 5c828d63e8ec4926a3cb835ec7013e90 P cb90632f9b2b4d42a67a7279aa0f1ec0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:02:16.093138 26446 raft_consensus.cc:482] T 5c828d63e8ec4926a3cb835ec7013e90 P cb90632f9b2b4d42a67a7279aa0f1ec0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:02:16.093163 26446 raft_consensus.cc:3037] T 5c828d63e8ec4926a3cb835ec7013e90 P cb90632f9b2b4d42a67a7279aa0f1ec0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:02:16.093918 26446 raft_consensus.cc:504] T 5c828d63e8ec4926a3cb835ec7013e90 P cb90632f9b2b4d42a67a7279aa0f1ec0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 37549 } } peers { permanent_uuid: "f94a933b286f4427b9bf531107a94661" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37465 } } peers { permanent_uuid: "d9866a7f50b441a9a7c03f98515dd5b6" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 42795 } }
I20260812 00:02:16.094048 26446 leader_election.cc:288] T 5c828d63e8ec4926a3cb835ec7013e90 P cb90632f9b2b4d42a67a7279aa0f1ec0 [CANDIDATE]: Term 1 election: Requested vote from peers f94a933b286f4427b9bf531107a94661 (127.11.206.66:37465), d9866a7f50b441a9a7c03f98515dd5b6 (127.11.206.67:42795)
I20260812 00:02:16.094197 26252 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c828d63e8ec4926a3cb835ec7013e90" candidate_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9866a7f50b441a9a7c03f98515dd5b6"
I20260812 00:02:16.094267 26252 raft_consensus.cc:3037] T 5c828d63e8ec4926a3cb835ec7013e90 P d9866a7f50b441a9a7c03f98515dd5b6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:02:16.094480 25980 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c828d63e8ec4926a3cb835ec7013e90" candidate_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f94a933b286f4427b9bf531107a94661"
I20260812 00:02:16.094563 25980 raft_consensus.cc:3037] T 5c828d63e8ec4926a3cb835ec7013e90 P f94a933b286f4427b9bf531107a94661 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:02:16.094959 26252 raft_consensus.cc:2454] T 5c828d63e8ec4926a3cb835ec7013e90 P d9866a7f50b441a9a7c03f98515dd5b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb90632f9b2b4d42a67a7279aa0f1ec0 in term 1.
I20260812 00:02:16.095134 25980 raft_consensus.cc:2454] T 5c828d63e8ec4926a3cb835ec7013e90 P f94a933b286f4427b9bf531107a94661 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb90632f9b2b4d42a67a7279aa0f1ec0 in term 1.
I20260812 00:02:16.095136 25588 leader_election.cc:302] T 5c828d63e8ec4926a3cb835ec7013e90 P cb90632f9b2b4d42a67a7279aa0f1ec0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cb90632f9b2b4d42a67a7279aa0f1ec0, d9866a7f50b441a9a7c03f98515dd5b6; no voters:
I20260812 00:02:16.095235 26446 raft_consensus.cc:2781] T 5c828d63e8ec4926a3cb835ec7013e90 P cb90632f9b2b4d42a67a7279aa0f1ec0 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:02:16.095299 26446 raft_consensus.cc:686] T 5c828d63e8ec4926a3cb835ec7013e90 P cb90632f9b2b4d42a67a7279aa0f1ec0 [term 1 LEADER]: Becoming Leader. State: Replica: cb90632f9b2b4d42a67a7279aa0f1ec0, State: Running, Role: LEADER
I20260812 00:02:16.095346 26446 consensus_queue.cc:237] T 5c828d63e8ec4926a3cb835ec7013e90 P cb90632f9b2b4d42a67a7279aa0f1ec0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 37549 } } peers { permanent_uuid: "f94a933b286f4427b9bf531107a94661" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37465 } } peers { permanent_uuid: "d9866a7f50b441a9a7c03f98515dd5b6" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 42795 } }
I20260812 00:02:16.095884 25410 catalog_manager.cc:5495] T 5c828d63e8ec4926a3cb835ec7013e90 P cb90632f9b2b4d42a67a7279aa0f1ec0 reported cstate change: term changed from 0 to 1, leader changed from <none> to cb90632f9b2b4d42a67a7279aa0f1ec0 (127.11.206.65). New cstate: current_term: 1 leader_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 37549 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f94a933b286f4427b9bf531107a94661" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9866a7f50b441a9a7c03f98515dd5b6" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260812 00:02:16.103825 26484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:16.101257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38932 (local address 127.11.206.65:37549)
0812 00:02:16.101304 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:16.101306 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:16.101397 (+ 91us) server_negotiation.cc:407] Connection header received
0812 00:02:16.101513 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:16.101514 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:16.101522 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:16.101557 (+ 35us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:02:16.101700 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:16.102172 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:16.103234 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:16.103411 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:16.103451 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:16.103621 (+ 170us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:02:16.103645 (+ 24us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:02:16.103676 (+ 31us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:16.103757 (+ 81us) server_negotiation.cc:299] Negotiation successful
0812 00:02:16.103770 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 00:02:16.104631 26252 raft_consensus.cc:1261] T 5c828d63e8ec4926a3cb835ec7013e90 P d9866a7f50b441a9a7c03f98515dd5b6 [term 1 FOLLOWER]: Refusing update from remote peer cb90632f9b2b4d42a67a7279aa0f1ec0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:02:16.104631 25980 raft_consensus.cc:1261] T 5c828d63e8ec4926a3cb835ec7013e90 P f94a933b286f4427b9bf531107a94661 [term 1 FOLLOWER]: Refusing update from remote peer cb90632f9b2b4d42a67a7279aa0f1ec0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:02:16.104841 26401 consensus_queue.cc:1035] T 5c828d63e8ec4926a3cb835ec7013e90 P cb90632f9b2b4d42a67a7279aa0f1ec0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f94a933b286f4427b9bf531107a94661" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:02:16.104981 26446 consensus_queue.cc:1035] T 5c828d63e8ec4926a3cb835ec7013e90 P cb90632f9b2b4d42a67a7279aa0f1ec0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9866a7f50b441a9a7c03f98515dd5b6" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:02:16.106225 26411 mvcc.cc:205] Tried to move back new op lower bound from 7317475066283102208 to 7317475066247032832. Current Snapshot: MvccSnapshot[applied={T|T < 7317475066283102208}]
I20260812 00:02:16.107460 25410 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60450:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:02:16.107542 25410 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60450:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:02:16.108204 25410 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9aff16bf5c77499a83c2e866ba8d27a9: Sending DeleteTablet for 3 replicas of tablet 5c828d63e8ec4926a3cb835ec7013e90
I20260812 00:02:16.108418 25678 tablet_service.cc:1514] Processing DeleteTablet for tablet 5c828d63e8ec4926a3cb835ec7013e90 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:02:16 UTC) from {username='oryx', principal='oryx/127.11.206.126@KRBTEST.COM'} at 127.0.0.1:38898
I20260812 00:02:16.108451 26182 tablet_service.cc:1514] Processing DeleteTablet for tablet 5c828d63e8ec4926a3cb835ec7013e90 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:02:16 UTC) from {username='oryx', principal='oryx/127.11.206.126@KRBTEST.COM'} at 127.0.0.1:41788
I20260812 00:02:16.108506 26213 tablet_service.cc:1514] Processing DeleteTablet for tablet 5c828d63e8ec4926a3cb835ec7013e90 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:02:16 UTC) from {username='oryx', principal='oryx/127.11.206.126@KRBTEST.COM'} at 127.0.0.1:41788
I20260812 00:02:16.108556 25945 tablet_service.cc:1514] Processing DeleteTablet for tablet 5c828d63e8ec4926a3cb835ec7013e90 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:02:16 UTC) from {username='oryx', principal='oryx/127.11.206.126@KRBTEST.COM'} at 127.0.0.1:34098
I20260812 00:02:16.108582 26496 tablet_replica.cc:330] T 5c828d63e8ec4926a3cb835ec7013e90 P cb90632f9b2b4d42a67a7279aa0f1ec0: stopping tablet replica
I20260812 00:02:16.108625 26498 tablet_replica.cc:330] T 5c828d63e8ec4926a3cb835ec7013e90 P f94a933b286f4427b9bf531107a94661: stopping tablet replica
I20260812 00:02:16.108631 26496 raft_consensus.cc:2229] T 5c828d63e8ec4926a3cb835ec7013e90 P cb90632f9b2b4d42a67a7279aa0f1ec0 [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:02:16.108664 26498 raft_consensus.cc:2229] T 5c828d63e8ec4926a3cb835ec7013e90 P f94a933b286f4427b9bf531107a94661 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:02:16.108682 26496 raft_consensus.cc:2258] T 5c828d63e8ec4926a3cb835ec7013e90 P cb90632f9b2b4d42a67a7279aa0f1ec0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:02:16.108695 26498 raft_consensus.cc:2258] T 5c828d63e8ec4926a3cb835ec7013e90 P f94a933b286f4427b9bf531107a94661 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:02:16.108526 26497 tablet_replica.cc:330] T 5c828d63e8ec4926a3cb835ec7013e90 P d9866a7f50b441a9a7c03f98515dd5b6: stopping tablet replica
I20260812 00:02:16.108863 26497 raft_consensus.cc:2229] T 5c828d63e8ec4926a3cb835ec7013e90 P d9866a7f50b441a9a7c03f98515dd5b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:02:16.108899 26497 raft_consensus.cc:2258] T 5c828d63e8ec4926a3cb835ec7013e90 P d9866a7f50b441a9a7c03f98515dd5b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:02:16.109210 26498 ts_tablet_manager.cc:1905] T 5c828d63e8ec4926a3cb835ec7013e90 P f94a933b286f4427b9bf531107a94661: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:02:16.109210 26496 ts_tablet_manager.cc:1905] T 5c828d63e8ec4926a3cb835ec7013e90 P cb90632f9b2b4d42a67a7279aa0f1ec0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:02:16.109490 25412 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60450:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:02:16.109642 25412 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:02:16.110744 26498 ts_tablet_manager.cc:1918] T 5c828d63e8ec4926a3cb835ec7013e90 P f94a933b286f4427b9bf531107a94661: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:02:16.110811 26498 log.cc:1196] T 5c828d63e8ec4926a3cb835ec7013e90 P f94a933b286f4427b9bf531107a94661: Deleting WAL directory at /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/minicluster-data/ts-1/wal/wals/5c828d63e8ec4926a3cb835ec7013e90
I20260812 00:02:16.110811 26496 ts_tablet_manager.cc:1918] T 5c828d63e8ec4926a3cb835ec7013e90 P cb90632f9b2b4d42a67a7279aa0f1ec0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:02:16.110862 26496 log.cc:1196] T 5c828d63e8ec4926a3cb835ec7013e90 P cb90632f9b2b4d42a67a7279aa0f1ec0: Deleting WAL directory at /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/minicluster-data/ts-0/wal/wals/5c828d63e8ec4926a3cb835ec7013e90
I20260812 00:02:16.111045 26498 ts_tablet_manager.cc:1939] T 5c828d63e8ec4926a3cb835ec7013e90 P f94a933b286f4427b9bf531107a94661: Deleting consensus metadata
I20260812 00:02:16.111071 26496 ts_tablet_manager.cc:1939] T 5c828d63e8ec4926a3cb835ec7013e90 P cb90632f9b2b4d42a67a7279aa0f1ec0: Deleting consensus metadata
I20260812 00:02:16.111222 26497 ts_tablet_manager.cc:1905] T 5c828d63e8ec4926a3cb835ec7013e90 P d9866a7f50b441a9a7c03f98515dd5b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:02:16.111366 25390 catalog_manager.cc:4841] TS f94a933b286f4427b9bf531107a94661 (127.11.206.66:37465): tablet 5c828d63e8ec4926a3cb835ec7013e90 (table test-table [id=e62718eabd2942c19da248d70c90ebdb]) successfully deleted
I20260812 00:02:16.111512 25389 catalog_manager.cc:4841] TS cb90632f9b2b4d42a67a7279aa0f1ec0 (127.11.206.65:37549): tablet 5c828d63e8ec4926a3cb835ec7013e90 (table test-table [id=e62718eabd2942c19da248d70c90ebdb]) successfully deleted
I20260812 00:02:16.112126 26213 tablet_service.cc:1467] Processing CreateTablet for tablet 757b77768690428e9d7a42fd86c27f1c (DEFAULT_TABLE table=test-table [id=2e7a0322640747e6ab3058ba7d13f4db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:02:16.112170 25945 tablet_service.cc:1467] Processing CreateTablet for tablet 757b77768690428e9d7a42fd86c27f1c (DEFAULT_TABLE table=test-table [id=2e7a0322640747e6ab3058ba7d13f4db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:02:16.112244 26213 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 757b77768690428e9d7a42fd86c27f1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:02:16.112278 25945 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 757b77768690428e9d7a42fd86c27f1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:02:16.112682 26497 ts_tablet_manager.cc:1918] T 5c828d63e8ec4926a3cb835ec7013e90 P d9866a7f50b441a9a7c03f98515dd5b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:02:16.112731 26497 log.cc:1196] T 5c828d63e8ec4926a3cb835ec7013e90 P d9866a7f50b441a9a7c03f98515dd5b6: Deleting WAL directory at /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/minicluster-data/ts-2/wal/wals/5c828d63e8ec4926a3cb835ec7013e90
I20260812 00:02:16.112923 26497 ts_tablet_manager.cc:1939] T 5c828d63e8ec4926a3cb835ec7013e90 P d9866a7f50b441a9a7c03f98515dd5b6: Deleting consensus metadata
I20260812 00:02:16.113335 25678 tablet_service.cc:1467] Processing CreateTablet for tablet 757b77768690428e9d7a42fd86c27f1c (DEFAULT_TABLE table=test-table [id=2e7a0322640747e6ab3058ba7d13f4db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:02:16.113476 25678 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 757b77768690428e9d7a42fd86c27f1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:02:16.113515 25390 catalog_manager.cc:4841] TS d9866a7f50b441a9a7c03f98515dd5b6 (127.11.206.67:42795): tablet 5c828d63e8ec4926a3cb835ec7013e90 (table test-table [id=e62718eabd2942c19da248d70c90ebdb]) successfully deleted
W20260812 00:02:16.113641 25390 catalog_manager.cc:4808] TS d9866a7f50b441a9a7c03f98515dd5b6 (127.11.206.67:42795): delete failed for tablet 5c828d63e8ec4926a3cb835ec7013e90 because the tablet was not found. No further retry: Not found: Tablet not found: 5c828d63e8ec4926a3cb835ec7013e90
I20260812 00:02:16.114508 26395 tablet_bootstrap.cc:492] T 757b77768690428e9d7a42fd86c27f1c P cb90632f9b2b4d42a67a7279aa0f1ec0: Bootstrap starting.
I20260812 00:02:16.114831 26395 tablet_bootstrap.cc:654] T 757b77768690428e9d7a42fd86c27f1c P cb90632f9b2b4d42a67a7279aa0f1ec0: Neither blocks nor log segments found. Creating new log.
I20260812 00:02:16.115274 26398 tablet_bootstrap.cc:492] T 757b77768690428e9d7a42fd86c27f1c P f94a933b286f4427b9bf531107a94661: Bootstrap starting.
I20260812 00:02:16.115272 26394 tablet_bootstrap.cc:492] T 757b77768690428e9d7a42fd86c27f1c P d9866a7f50b441a9a7c03f98515dd5b6: Bootstrap starting.
I20260812 00:02:16.115588 26394 tablet_bootstrap.cc:654] T 757b77768690428e9d7a42fd86c27f1c P d9866a7f50b441a9a7c03f98515dd5b6: Neither blocks nor log segments found. Creating new log.
I20260812 00:02:16.115667 26398 tablet_bootstrap.cc:654] T 757b77768690428e9d7a42fd86c27f1c P f94a933b286f4427b9bf531107a94661: Neither blocks nor log segments found. Creating new log.
I20260812 00:02:16.116032 26395 tablet_bootstrap.cc:492] T 757b77768690428e9d7a42fd86c27f1c P cb90632f9b2b4d42a67a7279aa0f1ec0: No bootstrap required, opened a new log
I20260812 00:02:16.116074 26395 ts_tablet_manager.cc:1397] T 757b77768690428e9d7a42fd86c27f1c P cb90632f9b2b4d42a67a7279aa0f1ec0: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260812 00:02:16.116178 26395 raft_consensus.cc:348] T 757b77768690428e9d7a42fd86c27f1c P cb90632f9b2b4d42a67a7279aa0f1ec0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 37549 } } peers { permanent_uuid: "f94a933b286f4427b9bf531107a94661" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37465 } } peers { permanent_uuid: "d9866a7f50b441a9a7c03f98515dd5b6" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 42795 } }
I20260812 00:02:16.116247 26395 raft_consensus.cc:374] T 757b77768690428e9d7a42fd86c27f1c P cb90632f9b2b4d42a67a7279aa0f1ec0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:02:16.116277 26395 raft_consensus.cc:729] T 757b77768690428e9d7a42fd86c27f1c P cb90632f9b2b4d42a67a7279aa0f1ec0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb90632f9b2b4d42a67a7279aa0f1ec0, State: Initialized, Role: FOLLOWER
I20260812 00:02:16.116320 26395 consensus_queue.cc:260] T 757b77768690428e9d7a42fd86c27f1c P cb90632f9b2b4d42a67a7279aa0f1ec0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 37549 } } peers { permanent_uuid: "f94a933b286f4427b9bf531107a94661" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37465 } } peers { permanent_uuid: "d9866a7f50b441a9a7c03f98515dd5b6" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 42795 } }
I20260812 00:02:16.116420 26395 ts_tablet_manager.cc:1428] T 757b77768690428e9d7a42fd86c27f1c P cb90632f9b2b4d42a67a7279aa0f1ec0: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:16.116632 26394 tablet_bootstrap.cc:492] T 757b77768690428e9d7a42fd86c27f1c P d9866a7f50b441a9a7c03f98515dd5b6: No bootstrap required, opened a new log
I20260812 00:02:16.116679 26394 ts_tablet_manager.cc:1397] T 757b77768690428e9d7a42fd86c27f1c P d9866a7f50b441a9a7c03f98515dd5b6: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 00:02:16.116784 26394 raft_consensus.cc:348] T 757b77768690428e9d7a42fd86c27f1c P d9866a7f50b441a9a7c03f98515dd5b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 37549 } } peers { permanent_uuid: "f94a933b286f4427b9bf531107a94661" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37465 } } peers { permanent_uuid: "d9866a7f50b441a9a7c03f98515dd5b6" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 42795 } }
I20260812 00:02:16.116850 26394 raft_consensus.cc:374] T 757b77768690428e9d7a42fd86c27f1c P d9866a7f50b441a9a7c03f98515dd5b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:02:16.116870 26394 raft_consensus.cc:729] T 757b77768690428e9d7a42fd86c27f1c P d9866a7f50b441a9a7c03f98515dd5b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9866a7f50b441a9a7c03f98515dd5b6, State: Initialized, Role: FOLLOWER
I20260812 00:02:16.116905 26394 consensus_queue.cc:260] T 757b77768690428e9d7a42fd86c27f1c P d9866a7f50b441a9a7c03f98515dd5b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 37549 } } peers { permanent_uuid: "f94a933b286f4427b9bf531107a94661" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37465 } } peers { permanent_uuid: "d9866a7f50b441a9a7c03f98515dd5b6" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 42795 } }
I20260812 00:02:16.117002 26394 ts_tablet_manager.cc:1428] T 757b77768690428e9d7a42fd86c27f1c P d9866a7f50b441a9a7c03f98515dd5b6: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:16.117513 26398 tablet_bootstrap.cc:492] T 757b77768690428e9d7a42fd86c27f1c P f94a933b286f4427b9bf531107a94661: No bootstrap required, opened a new log
I20260812 00:02:16.117558 26398 ts_tablet_manager.cc:1397] T 757b77768690428e9d7a42fd86c27f1c P f94a933b286f4427b9bf531107a94661: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260812 00:02:16.117691 26398 raft_consensus.cc:348] T 757b77768690428e9d7a42fd86c27f1c P f94a933b286f4427b9bf531107a94661 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 37549 } } peers { permanent_uuid: "f94a933b286f4427b9bf531107a94661" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37465 } } peers { permanent_uuid: "d9866a7f50b441a9a7c03f98515dd5b6" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 42795 } }
I20260812 00:02:16.117748 26398 raft_consensus.cc:374] T 757b77768690428e9d7a42fd86c27f1c P f94a933b286f4427b9bf531107a94661 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:02:16.117767 26398 raft_consensus.cc:729] T 757b77768690428e9d7a42fd86c27f1c P f94a933b286f4427b9bf531107a94661 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f94a933b286f4427b9bf531107a94661, State: Initialized, Role: FOLLOWER
I20260812 00:02:16.117813 26398 consensus_queue.cc:260] T 757b77768690428e9d7a42fd86c27f1c P f94a933b286f4427b9bf531107a94661 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 37549 } } peers { permanent_uuid: "f94a933b286f4427b9bf531107a94661" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37465 } } peers { permanent_uuid: "d9866a7f50b441a9a7c03f98515dd5b6" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 42795 } }
I20260812 00:02:16.117893 26398 ts_tablet_manager.cc:1428] T 757b77768690428e9d7a42fd86c27f1c P f94a933b286f4427b9bf531107a94661: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:16.250965 26494 raft_consensus.cc:482] T 757b77768690428e9d7a42fd86c27f1c P cb90632f9b2b4d42a67a7279aa0f1ec0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:02:16.251076 26494 raft_consensus.cc:504] T 757b77768690428e9d7a42fd86c27f1c P cb90632f9b2b4d42a67a7279aa0f1ec0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 37549 } } peers { permanent_uuid: "f94a933b286f4427b9bf531107a94661" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37465 } } peers { permanent_uuid: "d9866a7f50b441a9a7c03f98515dd5b6" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 42795 } }
I20260812 00:02:16.251209 26494 leader_election.cc:288] T 757b77768690428e9d7a42fd86c27f1c P cb90632f9b2b4d42a67a7279aa0f1ec0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f94a933b286f4427b9bf531107a94661 (127.11.206.66:37465), d9866a7f50b441a9a7c03f98515dd5b6 (127.11.206.67:42795)
I20260812 00:02:16.251514 26252 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "757b77768690428e9d7a42fd86c27f1c" candidate_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9866a7f50b441a9a7c03f98515dd5b6" is_pre_election: true
I20260812 00:02:16.251514 25980 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "757b77768690428e9d7a42fd86c27f1c" candidate_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f94a933b286f4427b9bf531107a94661" is_pre_election: true
I20260812 00:02:16.251632 26252 raft_consensus.cc:2454] T 757b77768690428e9d7a42fd86c27f1c P d9866a7f50b441a9a7c03f98515dd5b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb90632f9b2b4d42a67a7279aa0f1ec0 in term 0.
I20260812 00:02:16.251632 25980 raft_consensus.cc:2454] T 757b77768690428e9d7a42fd86c27f1c P f94a933b286f4427b9bf531107a94661 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb90632f9b2b4d42a67a7279aa0f1ec0 in term 0.
I20260812 00:02:16.251812 25588 leader_election.cc:302] T 757b77768690428e9d7a42fd86c27f1c P cb90632f9b2b4d42a67a7279aa0f1ec0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cb90632f9b2b4d42a67a7279aa0f1ec0, d9866a7f50b441a9a7c03f98515dd5b6; no voters:
I20260812 00:02:16.251921 26494 raft_consensus.cc:2781] T 757b77768690428e9d7a42fd86c27f1c P cb90632f9b2b4d42a67a7279aa0f1ec0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:02:16.251973 26494 raft_consensus.cc:482] T 757b77768690428e9d7a42fd86c27f1c P cb90632f9b2b4d42a67a7279aa0f1ec0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:02:16.251993 26494 raft_consensus.cc:3037] T 757b77768690428e9d7a42fd86c27f1c P cb90632f9b2b4d42a67a7279aa0f1ec0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:02:16.252720 26494 raft_consensus.cc:504] T 757b77768690428e9d7a42fd86c27f1c P cb90632f9b2b4d42a67a7279aa0f1ec0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 37549 } } peers { permanent_uuid: "f94a933b286f4427b9bf531107a94661" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37465 } } peers { permanent_uuid: "d9866a7f50b441a9a7c03f98515dd5b6" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 42795 } }
I20260812 00:02:16.252861 26494 leader_election.cc:288] T 757b77768690428e9d7a42fd86c27f1c P cb90632f9b2b4d42a67a7279aa0f1ec0 [CANDIDATE]: Term 1 election: Requested vote from peers f94a933b286f4427b9bf531107a94661 (127.11.206.66:37465), d9866a7f50b441a9a7c03f98515dd5b6 (127.11.206.67:42795)
I20260812 00:02:16.253008 25980 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "757b77768690428e9d7a42fd86c27f1c" candidate_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f94a933b286f4427b9bf531107a94661"
I20260812 00:02:16.253094 25980 raft_consensus.cc:3037] T 757b77768690428e9d7a42fd86c27f1c P f94a933b286f4427b9bf531107a94661 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:02:16.253069 26252 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "757b77768690428e9d7a42fd86c27f1c" candidate_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9866a7f50b441a9a7c03f98515dd5b6"
I20260812 00:02:16.253132 26252 raft_consensus.cc:3037] T 757b77768690428e9d7a42fd86c27f1c P d9866a7f50b441a9a7c03f98515dd5b6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:02:16.253922 26252 raft_consensus.cc:2454] T 757b77768690428e9d7a42fd86c27f1c P d9866a7f50b441a9a7c03f98515dd5b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb90632f9b2b4d42a67a7279aa0f1ec0 in term 1.
I20260812 00:02:16.253922 25980 raft_consensus.cc:2454] T 757b77768690428e9d7a42fd86c27f1c P f94a933b286f4427b9bf531107a94661 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb90632f9b2b4d42a67a7279aa0f1ec0 in term 1.
I20260812 00:02:16.254143 25588 leader_election.cc:302] T 757b77768690428e9d7a42fd86c27f1c P cb90632f9b2b4d42a67a7279aa0f1ec0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cb90632f9b2b4d42a67a7279aa0f1ec0, d9866a7f50b441a9a7c03f98515dd5b6; no voters:
I20260812 00:02:16.254237 26494 raft_consensus.cc:2781] T 757b77768690428e9d7a42fd86c27f1c P cb90632f9b2b4d42a67a7279aa0f1ec0 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:02:16.254302 26494 raft_consensus.cc:686] T 757b77768690428e9d7a42fd86c27f1c P cb90632f9b2b4d42a67a7279aa0f1ec0 [term 1 LEADER]: Becoming Leader. State: Replica: cb90632f9b2b4d42a67a7279aa0f1ec0, State: Running, Role: LEADER
I20260812 00:02:16.254357 26494 consensus_queue.cc:237] T 757b77768690428e9d7a42fd86c27f1c P cb90632f9b2b4d42a67a7279aa0f1ec0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 37549 } } peers { permanent_uuid: "f94a933b286f4427b9bf531107a94661" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37465 } } peers { permanent_uuid: "d9866a7f50b441a9a7c03f98515dd5b6" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 42795 } }
I20260812 00:02:16.254951 25412 catalog_manager.cc:5495] T 757b77768690428e9d7a42fd86c27f1c P cb90632f9b2b4d42a67a7279aa0f1ec0 reported cstate change: term changed from 0 to 1, leader changed from <none> to cb90632f9b2b4d42a67a7279aa0f1ec0 (127.11.206.65). New cstate: current_term: 1 leader_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb90632f9b2b4d42a67a7279aa0f1ec0" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 37549 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f94a933b286f4427b9bf531107a94661" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9866a7f50b441a9a7c03f98515dd5b6" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 42795 } health_report { overall_health: UNKNOWN } } }
I20260812 00:02:16.263410 26252 raft_consensus.cc:1261] T 757b77768690428e9d7a42fd86c27f1c P d9866a7f50b441a9a7c03f98515dd5b6 [term 1 FOLLOWER]: Refusing update from remote peer cb90632f9b2b4d42a67a7279aa0f1ec0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:02:16.263437 25980 raft_consensus.cc:1261] T 757b77768690428e9d7a42fd86c27f1c P f94a933b286f4427b9bf531107a94661 [term 1 FOLLOWER]: Refusing update from remote peer cb90632f9b2b4d42a67a7279aa0f1ec0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:02:16.263645 26401 consensus_queue.cc:1035] T 757b77768690428e9d7a42fd86c27f1c P cb90632f9b2b4d42a67a7279aa0f1ec0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9866a7f50b441a9a7c03f98515dd5b6" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:02:16.263769 26446 consensus_queue.cc:1035] T 757b77768690428e9d7a42fd86c27f1c P cb90632f9b2b4d42a67a7279aa0f1ec0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f94a933b286f4427b9bf531107a94661" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:02:16.273729 25412 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60450:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:02:16.273834 25412 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60450:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:02:16.274384 25412 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9aff16bf5c77499a83c2e866ba8d27a9: Sending DeleteTablet for 3 replicas of tablet 757b77768690428e9d7a42fd86c27f1c
I20260812 00:02:16.274652 25678 tablet_service.cc:1514] Processing DeleteTablet for tablet 757b77768690428e9d7a42fd86c27f1c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:02:16 UTC) from {username='oryx', principal='oryx/127.11.206.126@KRBTEST.COM'} at 127.0.0.1:38898
I20260812 00:02:16.274665 26213 tablet_service.cc:1514] Processing DeleteTablet for tablet 757b77768690428e9d7a42fd86c27f1c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:02:16 UTC) from {username='oryx', principal='oryx/127.11.206.126@KRBTEST.COM'} at 127.0.0.1:41788
I20260812 00:02:16.274732 25945 tablet_service.cc:1514] Processing DeleteTablet for tablet 757b77768690428e9d7a42fd86c27f1c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:02:16 UTC) from {username='oryx', principal='oryx/127.11.206.126@KRBTEST.COM'} at 127.0.0.1:34098
I20260812 00:02:16.274771 26496 tablet_replica.cc:330] T 757b77768690428e9d7a42fd86c27f1c P cb90632f9b2b4d42a67a7279aa0f1ec0: stopping tablet replica
I20260812 00:02:16.274820 26498 tablet_replica.cc:330] T 757b77768690428e9d7a42fd86c27f1c P f94a933b286f4427b9bf531107a94661: stopping tablet replica
I20260812 00:02:16.274827 26496 raft_consensus.cc:2229] T 757b77768690428e9d7a42fd86c27f1c P cb90632f9b2b4d42a67a7279aa0f1ec0 [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:02:16.274837 26497 tablet_replica.cc:330] T 757b77768690428e9d7a42fd86c27f1c P d9866a7f50b441a9a7c03f98515dd5b6: stopping tablet replica
I20260812 00:02:16.274870 26498 raft_consensus.cc:2229] T 757b77768690428e9d7a42fd86c27f1c P f94a933b286f4427b9bf531107a94661 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:02:16.274880 26496 raft_consensus.cc:2258] T 757b77768690428e9d7a42fd86c27f1c P cb90632f9b2b4d42a67a7279aa0f1ec0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:02:16.274902 26497 raft_consensus.cc:2229] T 757b77768690428e9d7a42fd86c27f1c P d9866a7f50b441a9a7c03f98515dd5b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:02:16.274911 26498 raft_consensus.cc:2258] T 757b77768690428e9d7a42fd86c27f1c P f94a933b286f4427b9bf531107a94661 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:02:16.274940 26497 raft_consensus.cc:2258] T 757b77768690428e9d7a42fd86c27f1c P d9866a7f50b441a9a7c03f98515dd5b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:02:16.275225 26498 ts_tablet_manager.cc:1905] T 757b77768690428e9d7a42fd86c27f1c P f94a933b286f4427b9bf531107a94661: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:02:16.275238 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 25548
I20260812 00:02:16.276225 26497 ts_tablet_manager.cc:1905] T 757b77768690428e9d7a42fd86c27f1c P d9866a7f50b441a9a7c03f98515dd5b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:02:16.276715 26498 ts_tablet_manager.cc:1918] T 757b77768690428e9d7a42fd86c27f1c P f94a933b286f4427b9bf531107a94661: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 00:02:16.276767 26498 log.cc:1196] T 757b77768690428e9d7a42fd86c27f1c P f94a933b286f4427b9bf531107a94661: Deleting WAL directory at /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/minicluster-data/ts-1/wal/wals/757b77768690428e9d7a42fd86c27f1c
I20260812 00:02:16.276963 26498 ts_tablet_manager.cc:1939] T 757b77768690428e9d7a42fd86c27f1c P f94a933b286f4427b9bf531107a94661: Deleting consensus metadata
I20260812 00:02:16.277331 25390 catalog_manager.cc:4841] TS f94a933b286f4427b9bf531107a94661 (127.11.206.66:37465): tablet 757b77768690428e9d7a42fd86c27f1c (table test-table [id=2e7a0322640747e6ab3058ba7d13f4db]) successfully deleted
I20260812 00:02:16.277838 26497 ts_tablet_manager.cc:1918] T 757b77768690428e9d7a42fd86c27f1c P d9866a7f50b441a9a7c03f98515dd5b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 00:02:16.277891 26497 log.cc:1196] T 757b77768690428e9d7a42fd86c27f1c P d9866a7f50b441a9a7c03f98515dd5b6: Deleting WAL directory at /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786492899949492-12089-0/minicluster-data/ts-2/wal/wals/757b77768690428e9d7a42fd86c27f1c
I20260812 00:02:16.278101 26497 ts_tablet_manager.cc:1939] T 757b77768690428e9d7a42fd86c27f1c P d9866a7f50b441a9a7c03f98515dd5b6: Deleting consensus metadata
I20260812 00:02:16.278420 25390 catalog_manager.cc:4841] TS d9866a7f50b441a9a7c03f98515dd5b6 (127.11.206.67:42795): tablet 757b77768690428e9d7a42fd86c27f1c (table test-table [id=2e7a0322640747e6ab3058ba7d13f4db]) successfully deleted
W20260812 00:02:16.290675 25389 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.206.65:37549 (error 108)
I20260812 00:02:16.290851 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 25821
I20260812 00:02:16.298604 26546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:16.297180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.65:37549 (local address 127.0.0.1:38948)
0812 00:02:16.298484 (+ 1304us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:16.298549 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.65:37549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1281,"thread_start_us":1238,"threads_started":1}
W20260812 00:02:16.298830 25389 catalog_manager.cc:4584] TS cb90632f9b2b4d42a67a7279aa0f1ec0 (127.11.206.65:37549): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 757b77768690428e9d7a42fd86c27f1c: Network error: Client connection negotiation failed: client connection to 127.11.206.65:37549: connect: Connection refused (error 111)
I20260812 00:02:16.302608 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 26080
I20260812 00:02:16.313097 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 25354
2026-08-12T00:02:16Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (2857 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786492899949492-12089-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:02:16 dist-test-slave-f0tn krb5kdc[26551](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:02:16 dist-test-slave-f0tn krb5kdc[26551](info): set up 2 sockets
Aug 12 00:02:16 dist-test-slave-f0tn krb5kdc[26551](info): commencing operation
krb5kdc: starting...
W20260812 00:02:17.540865 12089 mini_kdc.cc:121] Time spent starting KDC: real 1.203s user 0.003s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786492899949492-12089-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786492899949492-12089-0/krb5kdc/test-user.keytab.
Aug 12 00:02:17 dist-test-slave-f0tn krb5kdc[26551](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492937, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:02:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:02:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.206.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab.
Entry for principal kudu/127.11.206.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab.
I20260812 00:02:17.656241 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786492899949492-12089-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786492899949492-12089-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786492899949492-12089-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:36949
--webserver_interface=127.11.206.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab
--principal=kudu/127.11.206.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:32853
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.206.126:36949
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:02:17.737599 26572 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:02:17.737807 26572 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:02:17.737835 26572 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:02:17.738937 26572 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:02:17.738976 26572 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:02:17.738996 26572 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:02:17.739012 26572 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:02:17.739027 26572 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:02:17.740495 26572 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:32853
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786492899949492-12089-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786492899949492-12089-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.206.126:36949
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:36949
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.206.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26572
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786492899949492-12089-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:02:17.740756 26572 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:02:17.740973 26572 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 00:02:17.746019 26572 server_base.cc:1034] running on GCE node
W20260812 00:02:17.746001 26578 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:17.746096 26577 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:17.746003 26581 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:17.746398 26572 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:02:17.746713 26572 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:02:17.747870 26572 hybrid_clock.cc:648] HybridClock initialized: now 1786492937747854 us; error 28 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-12T00:02:17Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1436 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:02:17 dist-test-slave-f0tn krb5kdc[26591](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:02:17 dist-test-slave-f0tn krb5kdc[26591](info): set up 2 sockets
Aug 12 00:02:17 dist-test-slave-f0tn krb5kdc[26591](info): commencing operation
krb5kdc: starting...
W20260812 00:02:18.952901 12089 mini_kdc.cc:121] Time spent starting KDC: real 1.179s user 0.002s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/krb5kdc/test-user.keytab.
Aug 12 00:02:19 dist-test-slave-f0tn krb5kdc[26591](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492939, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:02:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:02:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.206.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab.
Entry for principal kudu/127.11.206.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab.
I20260812 00:02:19.067226 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:36869
--webserver_interface=127.11.206.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab
--principal=kudu/127.11.206.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:33375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.206.126:36869
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:02:19.147580 26612 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:02:19.147809 26612 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:02:19.147838 26612 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:02:19.148978 26612 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:02:19.149019 26612 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:02:19.149039 26612 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:02:19.149055 26612 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:02:19.149068 26612 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:02:19.150578 26612 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:33375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.206.126:36869
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab
--principal=kudu/127.11.206.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:36869
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.206.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26612
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:02:19.150842 26612 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:02:19.151070 26612 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:02:19.156042 26621 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:19.156042 26632 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:19.156070 26612 server_base.cc:1034] running on GCE node
W20260812 00:02:19.156081 26622 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:19.156540 26612 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:02:19.156840 26612 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:02:19.157986 26612 hybrid_clock.cc:648] HybridClock initialized: now 1786492939157969 us; error 36 us; skew 500 ppm
Aug 12 00:02:19 dist-test-slave-f0tn krb5kdc[26591](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492939, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:02:19.160390 26612 init.cc:377] Logged in from keytab as kudu/127.11.206.126@KRBTEST.COM (short username kudu)
I20260812 00:02:19.160853 26612 webserver.cc:460] Webserver started at http://127.11.206.126:36907/ using document root <none> and password file <none>
I20260812 00:02:19.161077 26612 fs_manager.cc:359] Metadata directory not provided
I20260812 00:02:19.161126 26612 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:02:19.161257 26612 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:02:19.162387 26612 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/master-0/data/instance:
uuid: "8b805d05ad6147e69944ea54ff12f507"
format_stamp: "Formatted at 2026-08-12 00:02:19 on dist-test-slave-f0tn"
server_key: "a4009b0c3879c3c9ae566a22c4577233"
server_key_iv: "06132e97742c1efb20ab6b3bfa7125f3"
server_key_version: "encryptionkey@0"
I20260812 00:02:19.162740 26612 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/master-0/wal/instance:
uuid: "8b805d05ad6147e69944ea54ff12f507"
format_stamp: "Formatted at 2026-08-12 00:02:19 on dist-test-slave-f0tn"
server_key: "a4009b0c3879c3c9ae566a22c4577233"
server_key_iv: "06132e97742c1efb20ab6b3bfa7125f3"
server_key_version: "encryptionkey@0"
I20260812 00:02:19.163982 26612 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 00:02:19.164641 26643 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:19.164816 26612 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:02:19.164901 26612 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/master-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/master-0/wal
uuid: "8b805d05ad6147e69944ea54ff12f507"
format_stamp: "Formatted at 2026-08-12 00:02:19 on dist-test-slave-f0tn"
server_key: "a4009b0c3879c3c9ae566a22c4577233"
server_key_iv: "06132e97742c1efb20ab6b3bfa7125f3"
server_key_version: "encryptionkey@0"
I20260812 00:02:19.164968 26612 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:02:19.185863 26612 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:02:19.187924 26612 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:02:19.188064 26612 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:02:19.192003 26612 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.126:36869
I20260812 00:02:19.192050 26746 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.126:36869 every 8 connection(s)
I20260812 00:02:19.192386 26612 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
I20260812 00:02:19.193239 26747 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:02:19.195549 26747 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b805d05ad6147e69944ea54ff12f507: Bootstrap starting.
I20260812 00:02:19.196118 26747 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8b805d05ad6147e69944ea54ff12f507: Neither blocks nor log segments found. Creating new log.
I20260812 00:02:19.196395 26747 log.cc:824] T 00000000000000000000000000000000 P 8b805d05ad6147e69944ea54ff12f507: Log is configured to *not* fsync() on all Append() calls
I20260812 00:02:19.197057 26747 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b805d05ad6147e69944ea54ff12f507: No bootstrap required, opened a new log
I20260812 00:02:19.198674 26747 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8b805d05ad6147e69944ea54ff12f507 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b805d05ad6147e69944ea54ff12f507" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 36869 } }
I20260812 00:02:19.198822 26747 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8b805d05ad6147e69944ea54ff12f507 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:02:19.198846 26747 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8b805d05ad6147e69944ea54ff12f507 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b805d05ad6147e69944ea54ff12f507, State: Initialized, Role: FOLLOWER
I20260812 00:02:19.198997 26747 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8b805d05ad6147e69944ea54ff12f507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b805d05ad6147e69944ea54ff12f507" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 36869 } }
I20260812 00:02:19.199067 26747 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8b805d05ad6147e69944ea54ff12f507 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:02:19.199100 26747 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8b805d05ad6147e69944ea54ff12f507 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:02:19.199142 26747 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8b805d05ad6147e69944ea54ff12f507 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:02:19.199676 26747 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8b805d05ad6147e69944ea54ff12f507 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b805d05ad6147e69944ea54ff12f507" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 36869 } }
I20260812 00:02:19.199774 26747 leader_election.cc:302] T 00000000000000000000000000000000 P 8b805d05ad6147e69944ea54ff12f507 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8b805d05ad6147e69944ea54ff12f507; no voters:
I20260812 00:02:19.199939 26747 leader_election.cc:288] T 00000000000000000000000000000000 P 8b805d05ad6147e69944ea54ff12f507 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:02:19.199992 26751 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8b805d05ad6147e69944ea54ff12f507 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:02:19.200165 26751 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8b805d05ad6147e69944ea54ff12f507 [term 1 LEADER]: Becoming Leader. State: Replica: 8b805d05ad6147e69944ea54ff12f507, State: Running, Role: LEADER
I20260812 00:02:19.200202 26747 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8b805d05ad6147e69944ea54ff12f507 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:02:19.200273 26751 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8b805d05ad6147e69944ea54ff12f507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b805d05ad6147e69944ea54ff12f507" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 36869 } }
I20260812 00:02:19.200647 26754 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b805d05ad6147e69944ea54ff12f507 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8b805d05ad6147e69944ea54ff12f507. Latest consensus state: current_term: 1 leader_uuid: "8b805d05ad6147e69944ea54ff12f507" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b805d05ad6147e69944ea54ff12f507" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 36869 } } }
I20260812 00:02:19.200798 26754 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b805d05ad6147e69944ea54ff12f507 [sys.catalog]: This master's current role is: LEADER
I20260812 00:02:19.200793 26753 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b805d05ad6147e69944ea54ff12f507 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8b805d05ad6147e69944ea54ff12f507" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b805d05ad6147e69944ea54ff12f507" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 36869 } } }
I20260812 00:02:19.201071 26753 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b805d05ad6147e69944ea54ff12f507 [sys.catalog]: This master's current role is: LEADER
I20260812 00:02:19.201205 26767 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:02:19.201749 26767 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:02:19.202059 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 26612
I20260812 00:02:19.202171 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/master-0/wal/instance
I20260812 00:02:19.202353 12089 external_mini_cluster.cc:1428] Setting key 8e2ab1261253e9e3847c4008ee7d5819
I20260812 00:02:19.203344 26767 catalog_manager.cc:1347] Generated new cluster ID: 1271e210357b4acdab554dc734a3f5ec
I20260812 00:02:19.203397 26767 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 00:02:19 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492939, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:02:19.211870 26767 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:02:19.212525 26767 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:02:19.213994 26785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:19.202818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43944 (local address 127.11.206.126:36869)
0812 00:02:19.203280 (+ 462us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:19.203290 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:19.203322 (+ 32us) server_negotiation.cc:407] Connection header received
0812 00:02:19.203438 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:19.203445 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:19.203499 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:19.203630 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:19.204330 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:19.205825 (+ 1495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:19.206834 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:19.207476 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:19.207587 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:19.210321 (+ 2734us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:19.210326 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:19.210326 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:19.210338 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:19.212348 (+ 2010us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:19.212754 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:19.212758 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:19.212759 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:19.212867 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:19.213066 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:19.213066 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:19.213066 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:19.213334 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:19.213506 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:19.213602 (+ 96us) server_negotiation.cc:299] Negotiation successful
0812 00:02:19.213752 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":418,"thread_start_us":72,"threads_started":1}
I20260812 00:02:19.222426 26767 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8b805d05ad6147e69944ea54ff12f507: Generated new TSK 0
I20260812 00:02:19.222625 26767 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.206.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.65.keytab.
Entry for principal kudu/127.11.206.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.65.keytab.
I20260812 00:02:19.253544 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.65:0
--local_ip_for_outbound_sockets=127.11.206.65
--webserver_interface=127.11.206.65
--webserver_port=0
--tserver_master_addrs=127.11.206.126:36869
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.65.keytab
--principal=kudu/127.11.206.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:33375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:02:19.333856 26790 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:02:19.334056 26790 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:02:19.334079 26790 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:02:19.335209 26790 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:02:19.335249 26790 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:02:19.335274 26790 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.65
I20260812 00:02:19.336683 26790 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:33375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.65.keytab
--principal=kudu/127.11.206.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.206.65
--webserver_port=0
--tserver_master_addrs=127.11.206.126:36869
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26790
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.65
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:02:19.336925 26790 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:02:19.337147 26790 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:02:19.342020 26803 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:19.342032 26801 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:19.342037 26807 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:19.342231 26790 server_base.cc:1034] running on GCE node
I20260812 00:02:19.342453 26790 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:02:19.342685 26790 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:02:19.343832 26790 hybrid_clock.cc:648] HybridClock initialized: now 1786492939343817 us; error 29 us; skew 500 ppm
Aug 12 00:02:19 dist-test-slave-f0tn krb5kdc[26591](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492939, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:02:19.346364 26790 init.cc:377] Logged in from keytab as kudu/127.11.206.65@KRBTEST.COM (short username kudu)
I20260812 00:02:19.346779 26790 webserver.cc:460] Webserver started at http://127.11.206.65:37085/ using document root <none> and password file <none>
I20260812 00:02:19.347008 26790 fs_manager.cc:359] Metadata directory not provided
I20260812 00:02:19.347057 26790 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:02:19.347182 26790 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:02:19.348218 26790 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-0/data/instance:
uuid: "efbb9d36fdee4f3bb53419aa05fde2cb"
format_stamp: "Formatted at 2026-08-12 00:02:19 on dist-test-slave-f0tn"
server_key: "71d51ca270da903ef4e8f8938355dac8"
server_key_iv: "baea05836e886aceb21bf1845a133564"
server_key_version: "encryptionkey@0"
I20260812 00:02:19.348568 26790 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-0/wal/instance:
uuid: "efbb9d36fdee4f3bb53419aa05fde2cb"
format_stamp: "Formatted at 2026-08-12 00:02:19 on dist-test-slave-f0tn"
server_key: "71d51ca270da903ef4e8f8938355dac8"
server_key_iv: "baea05836e886aceb21bf1845a133564"
server_key_version: "encryptionkey@0"
I20260812 00:02:19.349885 26790 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260812 00:02:19.350553 26817 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:19.350703 26790 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:19.350790 26790 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-0/wal
uuid: "efbb9d36fdee4f3bb53419aa05fde2cb"
format_stamp: "Formatted at 2026-08-12 00:02:19 on dist-test-slave-f0tn"
server_key: "71d51ca270da903ef4e8f8938355dac8"
server_key_iv: "baea05836e886aceb21bf1845a133564"
server_key_version: "encryptionkey@0"
I20260812 00:02:19.350853 26790 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:02:19.362901 26790 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:02:19.364553 26790 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:02:19.364684 26790 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:02:19.364885 26790 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:02:19.365165 26790 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:02:19.365198 26790 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:19.365226 26790 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:02:19.365250 26790 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:19.370707 26790 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.65:37013
I20260812 00:02:19.370769 27015 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.65:37013 every 8 connection(s)
I20260812 00:02:19.371045 26790 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
Aug 12 00:02:19 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492939, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.65@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:02:19.378304 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 26790
I20260812 00:02:19.378399 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-0/wal/instance
I20260812 00:02:19.378590 12089 external_mini_cluster.cc:1428] Setting key 5bff36885af0ba14dec2d2b9a97ff0e2
I20260812 00:02:19.379911 26785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:19.371684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.65:43657 (local address 127.11.206.126:36869)
0812 00:02:19.371745 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:19.371747 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:19.371915 (+ 168us) server_negotiation.cc:407] Connection header received
0812 00:02:19.372377 (+ 462us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:19.372377 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:19.372386 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:19.372441 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:19.373305 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:19.373888 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:19.374854 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:19.375042 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:19.375086 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:19.377025 (+ 1939us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:19.377026 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:19.377026 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:19.377031 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:19.378320 (+ 1289us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:19.378955 (+ 635us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:19.378957 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:19.378957 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:19.379015 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:19.379303 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:19.379304 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:19.379305 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:19.379425 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:19.379485 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:19.379732 (+ 247us) server_negotiation.cc:299] Negotiation successful
0812 00:02:19.379824 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260812 00:02:19.380072 27019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:19.371647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:36869 (local address 127.11.206.65:43657)
0812 00:02:19.371797 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:19.371837 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:19.372302 (+ 465us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:19.372493 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:19.372496 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:19.373047 (+ 551us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:19.373238 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:19.373242 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:19.373963 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:19.373964 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:19.374788 (+ 824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:19.374791 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:19.375096 (+ 305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:19.375097 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:19.375193 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:19.375643 (+ 450us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:19.375651 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:19.376944 (+ 1293us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:02:19.378412 (+ 1468us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:19.378420 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:19.378422 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:19.378696 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:19.379104 (+ 408us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:19.379105 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:19.379105 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:19.379236 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:19.379484 (+ 248us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:02:19.379491 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:02:19.379611 (+ 120us) client_negotiation.cc:769] Sending connection context
0812 00:02:19.379697 (+ 86us) client_negotiation.cc:240] Negotiation successful
0812 00:02:19.379863 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":81,"threads_started":1}
I20260812 00:02:19.380494 27016 heartbeater.cc:347] Connected to a master server at 127.11.206.126:36869
I20260812 00:02:19.380580 27016 heartbeater.cc:464] Registering TS with master...
I20260812 00:02:19.380782 27016 heartbeater.cc:511] Master 127.11.206.126:36869 requested a full tablet report, sending...
I20260812 00:02:19.381320 26674 ts_manager.cc:194] Registered new tserver with Master: efbb9d36fdee4f3bb53419aa05fde2cb (127.11.206.65:37013)
I20260812 00:02:19.381958 26674 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.206.65@KRBTEST.COM'} at 127.11.206.65:43657
WARNING: no policy specified for kudu/127.11.206.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.66.keytab.
Entry for principal kudu/127.11.206.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.66.keytab.
I20260812 00:02:19.401549 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.66:0
--local_ip_for_outbound_sockets=127.11.206.66
--webserver_interface=127.11.206.66
--webserver_port=0
--tserver_master_addrs=127.11.206.126:36869
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.66.keytab
--principal=kudu/127.11.206.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:33375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:02:19.483274 27026 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:02:19.483472 27026 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:02:19.483494 27026 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:02:19.484591 27026 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:02:19.484627 27026 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:02:19.484650 27026 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.66
I20260812 00:02:19.486070 27026 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:33375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.66.keytab
--principal=kudu/127.11.206.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.206.66
--webserver_port=0
--tserver_master_addrs=127.11.206.126:36869
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27026
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.66
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:02:19.486265 27026 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:02:19.486441 27026 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:02:19.491284 27039 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:19.491328 27034 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:19.491300 27036 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:19.491452 27026 server_base.cc:1034] running on GCE node
I20260812 00:02:19.491740 27026 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:02:19.491942 27026 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:02:19.493103 27026 hybrid_clock.cc:648] HybridClock initialized: now 1786492939493089 us; error 28 us; skew 500 ppm
Aug 12 00:02:19 dist-test-slave-f0tn krb5kdc[26591](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492939, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:02:19.495499 27026 init.cc:377] Logged in from keytab as kudu/127.11.206.66@KRBTEST.COM (short username kudu)
I20260812 00:02:19.495914 27026 webserver.cc:460] Webserver started at http://127.11.206.66:40979/ using document root <none> and password file <none>
I20260812 00:02:19.496093 27026 fs_manager.cc:359] Metadata directory not provided
I20260812 00:02:19.496130 27026 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:02:19.496235 27026 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:02:19.497321 27026 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-1/data/instance:
uuid: "a97c0207859c46538c505553136c645f"
format_stamp: "Formatted at 2026-08-12 00:02:19 on dist-test-slave-f0tn"
server_key: "5f0dcebc97b02236abe8544fd37c61a8"
server_key_iv: "b74f1e3ecb4a20cfb21172d58f1aab3b"
server_key_version: "encryptionkey@0"
I20260812 00:02:19.497681 27026 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-1/wal/instance:
uuid: "a97c0207859c46538c505553136c645f"
format_stamp: "Formatted at 2026-08-12 00:02:19 on dist-test-slave-f0tn"
server_key: "5f0dcebc97b02236abe8544fd37c61a8"
server_key_iv: "b74f1e3ecb4a20cfb21172d58f1aab3b"
server_key_version: "encryptionkey@0"
I20260812 00:02:19.498878 27026 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:02:19.499526 27051 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:19.499675 27026 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:02:19.499756 27026 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-1/wal
uuid: "a97c0207859c46538c505553136c645f"
format_stamp: "Formatted at 2026-08-12 00:02:19 on dist-test-slave-f0tn"
server_key: "5f0dcebc97b02236abe8544fd37c61a8"
server_key_iv: "b74f1e3ecb4a20cfb21172d58f1aab3b"
server_key_version: "encryptionkey@0"
I20260812 00:02:19.499818 27026 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:02:19.516083 27026 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:02:19.518000 27026 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:02:19.518142 27026 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:02:19.518381 27026 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:02:19.518689 27026 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:02:19.518723 27026 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:19.518752 27026 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:02:19.518769 27026 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:19.524214 27026 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.66:38151
I20260812 00:02:19.524289 27260 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.66:38151 every 8 connection(s)
I20260812 00:02:19.524566 27026 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
I20260812 00:02:19.526103 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 27026
I20260812 00:02:19.526211 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-1/wal/instance
I20260812 00:02:19.526398 12089 external_mini_cluster.cc:1428] Setting key 7527e496bd9a081c81c27e65f9564b82
Aug 12 00:02:19 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492939, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.66@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:02:19.534235 26785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:19.525277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.66:38209 (local address 127.11.206.126:36869)
0812 00:02:19.525336 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:19.525338 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:19.525546 (+ 208us) server_negotiation.cc:407] Connection header received
0812 00:02:19.526046 (+ 500us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:19.526048 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:19.526062 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:19.526138 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:19.527205 (+ 1067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:19.527864 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:19.528927 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:19.529138 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:19.529197 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:19.531493 (+ 2296us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:19.531494 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:19.531494 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:19.531501 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:19.532819 (+ 1318us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:19.533281 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:19.533282 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:19.533282 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:19.533335 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:19.533610 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:19.533611 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:19.533611 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:19.533716 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:19.533767 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:19.534105 (+ 338us) server_negotiation.cc:299] Negotiation successful
0812 00:02:19.534171 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260812 00:02:19.534462 27266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:19.525233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:36869 (local address 127.11.206.66:38209)
0812 00:02:19.525420 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:19.525462 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:19.525953 (+ 491us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:19.526207 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:19.526212 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:19.526882 (+ 670us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:19.527117 (+ 235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:19.527123 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:19.527976 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:19.527977 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:19.528822 (+ 845us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:19.528825 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:19.529215 (+ 390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:19.529216 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:19.529347 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:19.529870 (+ 523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:19.529879 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:19.531387 (+ 1508us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:02:19.532905 (+ 1518us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:19.532911 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:19.532914 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:19.533202 (+ 288us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:19.533412 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:19.533412 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:19.533413 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:19.533548 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:19.533779 (+ 231us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:02:19.533786 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:02:19.533949 (+ 163us) client_negotiation.cc:769] Sending connection context
0812 00:02:19.534061 (+ 112us) client_negotiation.cc:240] Negotiation successful
0812 00:02:19.534236 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":76,"threads_started":1}
I20260812 00:02:19.534893 27262 heartbeater.cc:347] Connected to a master server at 127.11.206.126:36869
WARNING: no policy specified for kudu/127.11.206.67@KRBTEST.COM; defaulting to no policy
I20260812 00:02:19.534981 27262 heartbeater.cc:464] Registering TS with master...
I20260812 00:02:19.535157 27262 heartbeater.cc:511] Master 127.11.206.126:36869 requested a full tablet report, sending...
I20260812 00:02:19.535502 26674 ts_manager.cc:194] Registered new tserver with Master: a97c0207859c46538c505553136c645f (127.11.206.66:38151)
I20260812 00:02:19.535959 26674 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.206.66@KRBTEST.COM'} at 127.11.206.66:38209
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.67.keytab.
Entry for principal kudu/127.11.206.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.67.keytab.
I20260812 00:02:19.550459 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.67:0
--local_ip_for_outbound_sockets=127.11.206.67
--webserver_interface=127.11.206.67
--webserver_port=0
--tserver_master_addrs=127.11.206.126:36869
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.67.keytab
--principal=kudu/127.11.206.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:33375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:02:19.631660 27273 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:02:19.631872 27273 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:02:19.631902 27273 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:02:19.633036 27273 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:02:19.633077 27273 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:02:19.633111 27273 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.67
I20260812 00:02:19.634545 27273 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:33375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.67.keytab
--principal=kudu/127.11.206.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.206.67
--webserver_port=0
--tserver_master_addrs=127.11.206.126:36869
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27273
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.67
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:02:19.634788 27273 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:02:19.634994 27273 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 00:02:19.639904 27273 server_base.cc:1034] running on GCE node
W20260812 00:02:19.639824 27284 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:19.639868 27283 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:19.639832 27286 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:19.640270 27273 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:02:19.640508 27273 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:02:19.641640 27273 hybrid_clock.cc:648] HybridClock initialized: now 1786492939641604 us; error 50 us; skew 500 ppm
Aug 12 00:02:19 dist-test-slave-f0tn krb5kdc[26591](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492939, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:02:19.644021 27273 init.cc:377] Logged in from keytab as kudu/127.11.206.67@KRBTEST.COM (short username kudu)
I20260812 00:02:19.644425 27273 webserver.cc:460] Webserver started at http://127.11.206.67:40691/ using document root <none> and password file <none>
I20260812 00:02:19.644647 27273 fs_manager.cc:359] Metadata directory not provided
I20260812 00:02:19.644695 27273 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:02:19.644821 27273 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:02:19.645843 27273 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-2/data/instance:
uuid: "79d8932d75be40afb37696f795012b94"
format_stamp: "Formatted at 2026-08-12 00:02:19 on dist-test-slave-f0tn"
server_key: "70194b1003ea78669be2d8b33348c7ad"
server_key_iv: "4e67bcc2cb9b76b755a7ac19bfc6ff49"
server_key_version: "encryptionkey@0"
I20260812 00:02:19.646170 27273 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-2/wal/instance:
uuid: "79d8932d75be40afb37696f795012b94"
format_stamp: "Formatted at 2026-08-12 00:02:19 on dist-test-slave-f0tn"
server_key: "70194b1003ea78669be2d8b33348c7ad"
server_key_iv: "4e67bcc2cb9b76b755a7ac19bfc6ff49"
server_key_version: "encryptionkey@0"
I20260812 00:02:19.647367 27273 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 00:02:19.648011 27298 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:19.648157 27273 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:02:19.648245 27273 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-2/wal
uuid: "79d8932d75be40afb37696f795012b94"
format_stamp: "Formatted at 2026-08-12 00:02:19 on dist-test-slave-f0tn"
server_key: "70194b1003ea78669be2d8b33348c7ad"
server_key_iv: "4e67bcc2cb9b76b755a7ac19bfc6ff49"
server_key_version: "encryptionkey@0"
I20260812 00:02:19.648300 27273 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:02:19.659790 27273 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:02:19.661536 27273 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:02:19.661674 27273 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:02:19.661906 27273 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:02:19.662210 27273 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:02:19.662250 27273 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:19.662281 27273 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:02:19.662298 27273 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:19.668028 27273 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.67:45587
I20260812 00:02:19.668085 27503 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.67:45587 every 8 connection(s)
I20260812 00:02:19.668430 27273 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
Aug 12 00:02:19 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492939, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.67@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:02:19.675339 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 27273
I20260812 00:02:19.675453 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-2/wal/instance
I20260812 00:02:19.675683 12089 external_mini_cluster.cc:1428] Setting key 5a33613a29c0524cb1c8f2991962ed87
I20260812 00:02:19.677358 26785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:19.669160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.67:60613 (local address 127.11.206.126:36869)
0812 00:02:19.669224 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:19.669226 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:19.669426 (+ 200us) server_negotiation.cc:407] Connection header received
0812 00:02:19.669898 (+ 472us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:19.669899 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:19.669909 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:19.669965 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:19.670864 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:19.671348 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:19.672366 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:19.672558 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:19.672610 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:19.674672 (+ 2062us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:19.674674 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:19.674674 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:19.674682 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:19.676164 (+ 1482us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:19.676571 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:19.676572 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:19.676572 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:19.676638 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:19.676860 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:19.676861 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:19.676861 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:19.676966 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:19.677013 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:19.677230 (+ 217us) server_negotiation.cc:299] Negotiation successful
0812 00:02:19.677295 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260812 00:02:19.677567 27508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:19.669129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:36869 (local address 127.11.206.67:60613)
0812 00:02:19.669289 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:19.669331 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:19.669817 (+ 486us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:19.670022 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:19.670025 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:19.670590 (+ 565us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:19.670793 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:19.670798 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:19.671431 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:19.671432 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:19.672283 (+ 851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:19.672286 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:19.672623 (+ 337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:19.672624 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:19.672721 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:19.673156 (+ 435us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:19.673164 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:19.674576 (+ 1412us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:02:19.676243 (+ 1667us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:19.676251 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:19.676253 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:19.676507 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:19.676698 (+ 191us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:19.676699 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:19.676699 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:19.676811 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:19.677011 (+ 200us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:02:19.677014 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:02:19.677130 (+ 116us) client_negotiation.cc:769] Sending connection context
0812 00:02:19.677207 (+ 77us) client_negotiation.cc:240] Negotiation successful
0812 00:02:19.677332 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":81,"threads_started":1}
I20260812 00:02:19.677964 27504 heartbeater.cc:347] Connected to a master server at 127.11.206.126:36869
I20260812 00:02:19.678045 27504 heartbeater.cc:464] Registering TS with master...
I20260812 00:02:19.678216 27504 heartbeater.cc:511] Master 127.11.206.126:36869 requested a full tablet report, sending...
I20260812 00:02:19.678575 26674 ts_manager.cc:194] Registered new tserver with Master: 79d8932d75be40afb37696f795012b94 (127.11.206.67:45587)
I20260812 00:02:19.678946 26674 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.206.67@KRBTEST.COM'} at 127.11.206.67:60613
I20260812 00:02:19.687502 12089 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.11.206.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.206.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.206.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/krb5kdc/oryx_127.11.206.65.keytab.
Entry for principal oryx/127.11.206.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/krb5kdc/oryx_127.11.206.65.keytab.
WARNING: no policy specified for oryx/127.11.206.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.206.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.206.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/krb5kdc/oryx_127.11.206.66.keytab.
Entry for principal oryx/127.11.206.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/krb5kdc/oryx_127.11.206.66.keytab.
WARNING: no policy specified for oryx/127.11.206.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.206.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.206.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/krb5kdc/oryx_127.11.206.67.keytab.
Entry for principal oryx/127.11.206.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/krb5kdc/oryx_127.11.206.67.keytab.
I20260812 00:02:19.749191 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 26790
I20260812 00:02:19.758966 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 27026
I20260812 00:02:19.775512 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 27273
I20260812 00:02:19.785542 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 26612
I20260812 00:02:19.793821 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:36869
--webserver_interface=127.11.206.126
--webserver_port=36907
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab
--principal=kudu/127.11.206.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:33375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.206.126:36869
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:02:19.875160 27520 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:02:19.875361 27520 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:02:19.875382 27520 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:02:19.876504 27520 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:02:19.876547 27520 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:02:19.876560 27520 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:02:19.876583 27520 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:02:19.876600 27520 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:02:19.878119 27520 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:33375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.206.126:36869
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab
--principal=kudu/127.11.206.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:36869
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.206.126
--webserver_port=36907
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27520
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:02:19.878355 27520 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:02:19.878574 27520 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:02:19.883350 27535 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:19.883347 27538 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:19.884697 27540 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:19.885304 27520 server_base.cc:1034] running on GCE node
I20260812 00:02:19.885583 27520 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:02:19.885874 27520 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:02:19.887018 27520 hybrid_clock.cc:648] HybridClock initialized: now 1786492939886999 us; error 34 us; skew 500 ppm
Aug 12 00:02:19 dist-test-slave-f0tn krb5kdc[26591](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492939, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:02:19.889482 27520 init.cc:377] Logged in from keytab as kudu/127.11.206.126@KRBTEST.COM (short username kudu)
I20260812 00:02:19.889896 27520 webserver.cc:460] Webserver started at http://127.11.206.126:36907/ using document root <none> and password file <none>
I20260812 00:02:19.890136 27520 fs_manager.cc:359] Metadata directory not provided
I20260812 00:02:19.890199 27520 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:02:19.891839 27520 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.001s
I20260812 00:02:19.892494 27549 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:19.892661 27520 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:19.892746 27520 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/master-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/master-0/wal
uuid: "8b805d05ad6147e69944ea54ff12f507"
format_stamp: "Formatted at 2026-08-12 00:02:19 on dist-test-slave-f0tn"
server_key: "a4009b0c3879c3c9ae566a22c4577233"
server_key_iv: "06132e97742c1efb20ab6b3bfa7125f3"
server_key_version: "encryptionkey@0"
I20260812 00:02:19.893083 27520 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:02:19.903486 27520 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:02:19.905102 27520 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:02:19.905234 27520 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:02:19.908915 27520 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.126:36869
I20260812 00:02:19.908955 27650 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.126:36869 every 8 connection(s)
I20260812 00:02:19.909307 27520 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
I20260812 00:02:19.910758 27652 sys_catalog.cc:263] Verifying existing consensus state
I20260812 00:02:19.911406 27652 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b805d05ad6147e69944ea54ff12f507: Bootstrap starting.
I20260812 00:02:19.918677 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 27520
I20260812 00:02:19.919027 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.65:37013
--local_ip_for_outbound_sockets=127.11.206.65
--tserver_master_addrs=127.11.206.126:36869
--webserver_port=37085
--webserver_interface=127.11.206.65
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.65.keytab
--principal=kudu/127.11.206.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:33375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.11.206.65
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/krb5kdc/oryx_127.11.206.65.keytab with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:02:19.919286 27652 log.cc:824] T 00000000000000000000000000000000 P 8b805d05ad6147e69944ea54ff12f507: Log is configured to *not* fsync() on all Append() calls
I20260812 00:02:19.921275 27652 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b805d05ad6147e69944ea54ff12f507: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 00:02:19.921555 27652 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b805d05ad6147e69944ea54ff12f507: Bootstrap complete.
I20260812 00:02:19.923715 27652 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8b805d05ad6147e69944ea54ff12f507 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b805d05ad6147e69944ea54ff12f507" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 36869 } }
I20260812 00:02:19.923936 27652 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8b805d05ad6147e69944ea54ff12f507 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b805d05ad6147e69944ea54ff12f507, State: Initialized, Role: FOLLOWER
I20260812 00:02:19.924074 27652 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8b805d05ad6147e69944ea54ff12f507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b805d05ad6147e69944ea54ff12f507" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 36869 } }
I20260812 00:02:19.924142 27652 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8b805d05ad6147e69944ea54ff12f507 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:02:19.924185 27652 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8b805d05ad6147e69944ea54ff12f507 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:02:19.924237 27652 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8b805d05ad6147e69944ea54ff12f507 [term 1 FOLLOWER]: Advancing to term 2
I20260812 00:02:19.925170 27652 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8b805d05ad6147e69944ea54ff12f507 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b805d05ad6147e69944ea54ff12f507" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 36869 } }
I20260812 00:02:19.925266 27652 leader_election.cc:302] T 00000000000000000000000000000000 P 8b805d05ad6147e69944ea54ff12f507 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8b805d05ad6147e69944ea54ff12f507; no voters:
I20260812 00:02:19.925441 27652 leader_election.cc:288] T 00000000000000000000000000000000 P 8b805d05ad6147e69944ea54ff12f507 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260812 00:02:19.925477 27658 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8b805d05ad6147e69944ea54ff12f507 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 00:02:19.925582 27658 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8b805d05ad6147e69944ea54ff12f507 [term 2 LEADER]: Becoming Leader. State: Replica: 8b805d05ad6147e69944ea54ff12f507, State: Running, Role: LEADER
I20260812 00:02:19.925664 27658 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8b805d05ad6147e69944ea54ff12f507 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b805d05ad6147e69944ea54ff12f507" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 36869 } }
I20260812 00:02:19.925709 27652 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8b805d05ad6147e69944ea54ff12f507 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:02:19.925937 27658 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b805d05ad6147e69944ea54ff12f507 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "8b805d05ad6147e69944ea54ff12f507" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b805d05ad6147e69944ea54ff12f507" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 36869 } } }
I20260812 00:02:19.926090 27658 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b805d05ad6147e69944ea54ff12f507 [sys.catalog]: This master's current role is: LEADER
I20260812 00:02:19.926255 27658 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b805d05ad6147e69944ea54ff12f507 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8b805d05ad6147e69944ea54ff12f507. Latest consensus state: current_term: 2 leader_uuid: "8b805d05ad6147e69944ea54ff12f507" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b805d05ad6147e69944ea54ff12f507" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 36869 } } }
I20260812 00:02:19.926373 27658 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b805d05ad6147e69944ea54ff12f507 [sys.catalog]: This master's current role is: LEADER
I20260812 00:02:19.926707 27669 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:02:19.927253 27669 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:02:19.927421 27669 catalog_manager.cc:1259] Loaded cluster ID: 1271e210357b4acdab554dc734a3f5ec
I20260812 00:02:19.927628 27669 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:02:19.928758 27669 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:02:19.928972 27669 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 8b805d05ad6147e69944ea54ff12f507: Loaded TSK: 0
I20260812 00:02:19.929204 27669 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 00:02:20.000660 27656 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:02:20.000876 27656 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:02:20.000898 27656 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:02:20.002113 27656 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:02:20.002161 27656 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:02:20.002185 27656 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.65
I20260812 00:02:20.003641 27656 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:33375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/krb5kdc/oryx_127.11.206.65.keytab
--principal=oryx/127.11.206.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.65:37013
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.206.65
--webserver_port=37085
--tserver_master_addrs=127.11.206.126:36869
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27656
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.65
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:02:20.003891 27656 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:02:20.004132 27656 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:02:20.009232 27695 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:20.009227 27697 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:20.009229 27699 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:20.009651 27656 server_base.cc:1034] running on GCE node
I20260812 00:02:20.009858 27656 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:02:20.010083 27656 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:02:20.011236 27656 hybrid_clock.cc:648] HybridClock initialized: now 1786492940011220 us; error 32 us; skew 500 ppm
Aug 12 00:02:20 dist-test-slave-f0tn krb5kdc[26591](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492940, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.206.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:02:20.013816 27656 init.cc:377] Logged in from keytab as oryx/127.11.206.65@KRBTEST.COM (short username oryx)
I20260812 00:02:20.014264 27656 webserver.cc:460] Webserver started at http://127.11.206.65:37085/ using document root <none> and password file <none>
I20260812 00:02:20.014493 27656 fs_manager.cc:359] Metadata directory not provided
I20260812 00:02:20.014557 27656 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:02:20.015866 27656 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:02:20.016430 27711 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:20.016613 27656 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:20.016716 27656 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-0/wal
uuid: "efbb9d36fdee4f3bb53419aa05fde2cb"
format_stamp: "Formatted at 2026-08-12 00:02:19 on dist-test-slave-f0tn"
server_key: "71d51ca270da903ef4e8f8938355dac8"
server_key_iv: "baea05836e886aceb21bf1845a133564"
server_key_version: "encryptionkey@0"
I20260812 00:02:20.017168 27656 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:02:20.037627 27656 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:02:20.040060 27656 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:02:20.040215 27656 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:02:20.040472 27656 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:02:20.040875 27656 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:02:20.040920 27656 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:20.040948 27656 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:02:20.040964 27656 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:20.047880 27656 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.65:37013
I20260812 00:02:20.047920 27919 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.65:37013 every 8 connection(s)
I20260812 00:02:20.048372 27656 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
I20260812 00:02:20.054751 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 27656
I20260812 00:02:20.055079 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.66:38151
--local_ip_for_outbound_sockets=127.11.206.66
--tserver_master_addrs=127.11.206.126:36869
--webserver_port=40979
--webserver_interface=127.11.206.66
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.66.keytab
--principal=kudu/127.11.206.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:33375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.11.206.66
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/krb5kdc/oryx_127.11.206.66.keytab with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 00:02:20 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.65@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:02:20 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.65@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:02:20.058130 27929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:20.049126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:36869 (local address 127.11.206.65:36131)
0812 00:02:20.049329 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:20.049399 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:20.050048 (+ 649us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:20.050532 (+ 484us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:20.050537 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:20.051348 (+ 811us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:20.051642 (+ 294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:20.051650 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:20.052717 (+ 1067us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:20.052718 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:20.054009 (+ 1291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:20.054012 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:20.054598 (+ 586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:20.054599 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:20.054732 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:20.055356 (+ 624us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:20.055366 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:20.057931 (+ 2565us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.206.126:36869: Server oryx/127.11.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":103,"threads_started":1}
W20260812 00:02:20.058250 27930 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:02:20.049217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.65:36131 (local address 127.11.206.126:36869)
0812 00:02:20.049431 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:20.049449 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:20.049489 (+ 40us) server_negotiation.cc:407] Connection header received
0812 00:02:20.050275 (+ 786us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:20.050282 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:20.050329 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:20.050449 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:20.051746 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:20.052614 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:20.054102 (+ 1488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:20.054506 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:20.054636 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:20.058082 (+ 3446us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.206.65:36131: BlockingRecv error: recv got EOF from 127.11.206.65:36131 (error 108)
Metrics: {"server-negotiator.queue_time_us":169,"thread_start_us":78,"threads_started":1}
W20260812 00:02:20.058650 27921 heartbeater.cc:644] Failed to heartbeat to 127.11.206.126:36869 (0 consecutive failures): Not authorized: Failed to ping master at 127.11.206.126:36869: Client connection negotiation failed: client connection to 127.11.206.126:36869: Server oryx/127.11.206.126@KRBTEST.COM not found in Kerberos database
Aug 12 00:02:20 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.65@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:02:20 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.65@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:02:20.063544 27929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:20.058870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:36869 (local address 127.11.206.65:50595)
0812 00:02:20.058913 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:20.058923 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:20.058959 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:20.059097 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:20.059098 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:20.059242 (+ 144us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:20.059298 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:20.059300 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:20.060175 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:20.060177 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:20.060956 (+ 779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:20.060959 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:20.061327 (+ 368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:20.061328 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:20.061418 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:20.061832 (+ 414us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:20.061837 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:20.063492 (+ 1655us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.206.126:36869: Server oryx/127.11.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":27}
W20260812 00:02:20.063786 27930 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:02:20.058911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.65:50595 (local address 127.11.206.126:36869)
0812 00:02:20.058944 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:20.058946 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:20.058955 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:02:20.059009 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:20.059009 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:20.059021 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:20.059078 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:20.059369 (+ 291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:20.060088 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:20.061051 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:20.061252 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:20.061307 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:20.063722 (+ 2415us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.206.65:50595: BlockingRecv error: recv got EOF from 127.11.206.65:50595 (error 108)
Metrics: {"server-negotiator.queue_time_us":15}
Aug 12 00:02:20 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.65@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:02:20 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.65@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:02:20.067981 27929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:20.063809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:36869 (local address 127.11.206.65:60429)
0812 00:02:20.063868 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:20.063877 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:20.063906 (+ 29us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:20.064106 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:20.064107 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:20.064207 (+ 100us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:20.064233 (+ 26us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:20.064234 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:20.065081 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:20.065082 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:20.065625 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:20.065627 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:20.066049 (+ 422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:20.066049 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:20.066082 (+ 33us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:20.066432 (+ 350us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:20.066435 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:20.067915 (+ 1480us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.206.126:36869: Server oryx/127.11.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":44}
W20260812 00:02:20.068084 27930 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:02:20.063874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.65:60429 (local address 127.11.206.126:36869)
0812 00:02:20.063991 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:20.063993 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:20.064002 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:02:20.064021 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:20.064022 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:20.064032 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:20.064094 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:20.064303 (+ 209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:20.064994 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:20.065700 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:20.065974 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:20.066040 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:20.067992 (+ 1952us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.206.65:60429: BlockingRecv error: recv got EOF from 127.11.206.65:60429 (error 108)
Metrics: {"server-negotiator.queue_time_us":103,"thread_start_us":96,"threads_started":1}
W20260812 00:02:20.068086 27921 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 00:02:20.138769 27932 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:02:20.138964 27932 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:02:20.138985 27932 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:02:20.140065 27932 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:02:20.140136 27932 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:02:20.140169 27932 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.66
I20260812 00:02:20.141608 27932 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:33375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/krb5kdc/oryx_127.11.206.66.keytab
--principal=oryx/127.11.206.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.66:38151
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.206.66
--webserver_port=40979
--tserver_master_addrs=127.11.206.126:36869
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27932
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.66
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:02:20.141822 27932 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:02:20.142011 27932 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:02:20.146778 27940 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:20.146778 27941 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:20.146806 27943 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:20.146919 27932 server_base.cc:1034] running on GCE node
I20260812 00:02:20.147194 27932 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:02:20.147410 27932 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:02:20.148573 27932 hybrid_clock.cc:648] HybridClock initialized: now 1786492940148560 us; error 30 us; skew 500 ppm
Aug 12 00:02:20 dist-test-slave-f0tn krb5kdc[26591](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492940, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.206.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:02:20.153647 27932 init.cc:377] Logged in from keytab as oryx/127.11.206.66@KRBTEST.COM (short username oryx)
I20260812 00:02:20.154088 27932 webserver.cc:460] Webserver started at http://127.11.206.66:40979/ using document root <none> and password file <none>
I20260812 00:02:20.154328 27932 fs_manager.cc:359] Metadata directory not provided
I20260812 00:02:20.154392 27932 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:02:20.155736 27932 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:02:20.156365 27956 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:20.156533 27932 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:02:20.156623 27932 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-1/wal
uuid: "a97c0207859c46538c505553136c645f"
format_stamp: "Formatted at 2026-08-12 00:02:19 on dist-test-slave-f0tn"
server_key: "5f0dcebc97b02236abe8544fd37c61a8"
server_key_iv: "b74f1e3ecb4a20cfb21172d58f1aab3b"
server_key_version: "encryptionkey@0"
I20260812 00:02:20.156971 27932 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:02:20.178586 27932 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:02:20.180477 27932 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:02:20.180622 27932 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:02:20.180853 27932 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:02:20.181159 27932 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:02:20.181193 27932 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:20.181224 27932 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:02:20.181242 27932 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:20.186774 27932 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.66:38151
I20260812 00:02:20.186852 28168 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.66:38151 every 8 connection(s)
I20260812 00:02:20.187165 27932 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
I20260812 00:02:20.191104 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 27932
I20260812 00:02:20.191378 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.67:45587
--local_ip_for_outbound_sockets=127.11.206.67
--tserver_master_addrs=127.11.206.126:36869
--webserver_port=40691
--webserver_interface=127.11.206.67
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.67.keytab
--principal=kudu/127.11.206.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:33375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.11.206.67
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/krb5kdc/oryx_127.11.206.67.keytab with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 00:02:20 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.66@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:02:20 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.66@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
W20260812 00:02:20.194403 27930 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:02:20.187866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.66:33131 (local address 127.11.206.126:36869)
0812 00:02:20.187946 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:20.187948 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:20.188132 (+ 184us) server_negotiation.cc:407] Connection header received
0812 00:02:20.188621 (+ 489us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:20.188622 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:20.188639 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:20.188687 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:20.189658 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:20.190150 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:20.191243 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:20.191478 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:20.191547 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:20.194349 (+ 2802us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.206.66:33131: BlockingRecv error: recv got EOF from 127.11.206.66:33131 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
I20260812 00:02:20.194432 28172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:20.187844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:36869 (local address 127.11.206.66:33131)
0812 00:02:20.188005 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:20.188041 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:20.188520 (+ 479us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:20.188775 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:20.188778 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:20.189336 (+ 558us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:20.189568 (+ 232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:20.189574 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:20.190237 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:20.190238 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:20.191133 (+ 895us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:20.191136 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:20.191584 (+ 448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:20.191585 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:20.191708 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:20.192176 (+ 468us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:20.192184 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:20.194235 (+ 2051us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.206.126:36869: Server oryx/127.11.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":87,"threads_started":1}
W20260812 00:02:20.194694 28169 heartbeater.cc:644] Failed to heartbeat to 127.11.206.126:36869 (0 consecutive failures): Not authorized: Failed to ping master at 127.11.206.126:36869: Client connection negotiation failed: client connection to 127.11.206.126:36869: Server oryx/127.11.206.126@KRBTEST.COM not found in Kerberos database
Aug 12 00:02:20 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.66@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:02:20 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.66@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:02:20.198904 28172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:20.194912 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:36869 (local address 127.11.206.66:54597)
0812 00:02:20.194955 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:20.194966 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:20.194999 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:20.195123 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:20.195124 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:20.195242 (+ 118us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:20.195297 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:20.195298 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:20.195944 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:20.195945 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:20.196437 (+ 492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:20.196439 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:20.196770 (+ 331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:20.196771 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:20.196835 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:20.197208 (+ 373us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:20.197211 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:20.198843 (+ 1632us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.206.126:36869: Server oryx/127.11.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":29}
W20260812 00:02:20.198985 27930 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:02:20.194971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.66:54597 (local address 127.11.206.126:36869)
0812 00:02:20.195030 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:20.195032 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:20.195039 (+ 7us) server_negotiation.cc:407] Connection header received
0812 00:02:20.195060 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:20.195061 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:20.195070 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:20.195113 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:20.195366 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:20.195877 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:20.196510 (+ 633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:20.196700 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:20.196750 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:20.198932 (+ 2182us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.206.66:54597: BlockingRecv error: recv got EOF from 127.11.206.66:54597 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
Aug 12 00:02:20 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.66@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:02:20 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.66@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:02:20.203114 28172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:20.199249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:36869 (local address 127.11.206.66:47545)
0812 00:02:20.199350 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:20.199360 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:20.199406 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:20.199517 (+ 111us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:20.199517 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:20.199634 (+ 117us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:20.199659 (+ 25us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:20.199661 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:20.200235 (+ 574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:20.200236 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:20.200716 (+ 480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:20.200717 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:20.201023 (+ 306us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:20.201024 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:20.201073 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:20.201530 (+ 457us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:20.201534 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:20.203055 (+ 1521us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.206.126:36869: Server oryx/127.11.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":86}
W20260812 00:02:20.203249 27930 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:02:20.199313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.66:47545 (local address 127.11.206.126:36869)
0812 00:02:20.199356 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:20.199358 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:20.199392 (+ 34us) server_negotiation.cc:407] Connection header received
0812 00:02:20.199462 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:20.199463 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:20.199472 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:20.199515 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:20.199722 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:20.200168 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:20.200791 (+ 623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:20.200965 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:20.201016 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:20.203146 (+ 2130us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.206.66:47545: BlockingRecv error: recv got EOF from 127.11.206.66:47545 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
W20260812 00:02:20.203233 28169 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 00:02:20.273929 28174 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:02:20.274149 28174 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:02:20.274174 28174 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:02:20.275375 28174 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:02:20.275427 28174 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:02:20.275453 28174 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.67
I20260812 00:02:20.277033 28174 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:33375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/krb5kdc/oryx_127.11.206.67.keytab
--principal=oryx/127.11.206.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.67:45587
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.206.67
--webserver_port=40691
--tserver_master_addrs=127.11.206.126:36869
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28174
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.67
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:02:20.277273 28174 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:02:20.277544 28174 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:02:20.282554 28185 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:20.282560 28182 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:20.282560 28181 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:20.282619 28174 server_base.cc:1034] running on GCE node
I20260812 00:02:20.282928 28174 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:02:20.283170 28174 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:02:20.284307 28174 hybrid_clock.cc:648] HybridClock initialized: now 1786492940284292 us; error 30 us; skew 500 ppm
Aug 12 00:02:20 dist-test-slave-f0tn krb5kdc[26591](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492940, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.206.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:02:20.286837 28174 init.cc:377] Logged in from keytab as oryx/127.11.206.67@KRBTEST.COM (short username oryx)
I20260812 00:02:20.287268 28174 webserver.cc:460] Webserver started at http://127.11.206.67:40691/ using document root <none> and password file <none>
I20260812 00:02:20.287451 28174 fs_manager.cc:359] Metadata directory not provided
I20260812 00:02:20.287498 28174 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:02:20.288756 28174 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:02:20.289253 28197 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:20.289428 28174 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:02:20.289511 28174 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-2/wal
uuid: "79d8932d75be40afb37696f795012b94"
format_stamp: "Formatted at 2026-08-12 00:02:19 on dist-test-slave-f0tn"
server_key: "70194b1003ea78669be2d8b33348c7ad"
server_key_iv: "4e67bcc2cb9b76b755a7ac19bfc6ff49"
server_key_version: "encryptionkey@0"
I20260812 00:02:20.289845 28174 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:02:20.296868 28174 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:02:20.298920 28174 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:02:20.299029 28174 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:02:20.299191 28174 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:02:20.299506 28174 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:02:20.299539 28174 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:20.299559 28174 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:02:20.299573 28174 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:20.304881 28174 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.67:45587
I20260812 00:02:20.304947 28412 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.67:45587 every 8 connection(s)
I20260812 00:02:20.305228 28174 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
I20260812 00:02:20.306596 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 28174
Aug 12 00:02:20 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.67@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:02:20 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.67@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
W20260812 00:02:20.313320 27930 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:02:20.305897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.67:38273 (local address 127.11.206.126:36869)
0812 00:02:20.305957 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:20.305959 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:20.306147 (+ 188us) server_negotiation.cc:407] Connection header received
0812 00:02:20.306730 (+ 583us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:20.306731 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:20.306745 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:20.306813 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:20.307976 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:20.308711 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:20.310030 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:20.310264 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:20.310307 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:20.313274 (+ 2967us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.206.67:38273: BlockingRecv error: recv got EOF from 127.11.206.67:38273 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
I20260812 00:02:20.313448 28416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:20.305870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:36869 (local address 127.11.206.67:38273)
0812 00:02:20.306038 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:20.306073 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:20.306612 (+ 539us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:20.306887 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:20.306890 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:20.307595 (+ 705us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:20.307889 (+ 294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:20.307896 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:20.308794 (+ 898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:20.308795 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:20.309969 (+ 1174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:20.309972 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:20.310341 (+ 369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:20.310342 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:20.310466 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:20.310802 (+ 336us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:20.310811 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:20.313197 (+ 2386us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.206.126:36869: Server oryx/127.11.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":90,"threads_started":1}
W20260812 00:02:20.313732 28414 heartbeater.cc:644] Failed to heartbeat to 127.11.206.126:36869 (0 consecutive failures): Not authorized: Failed to ping master at 127.11.206.126:36869: Client connection negotiation failed: client connection to 127.11.206.126:36869: Server oryx/127.11.206.126@KRBTEST.COM not found in Kerberos database
I20260812 00:02:20.314628 27934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:20.307108 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43950 (local address 127.11.206.126:36869)
0812 00:02:20.307160 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:20.307161 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:20.307305 (+ 144us) server_negotiation.cc:407] Connection header received
0812 00:02:20.307373 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:20.307374 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:20.307383 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:20.307437 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:20.308101 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:20.308784 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:20.309868 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:20.310096 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:20.310157 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:20.311447 (+ 1290us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:20.311451 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:20.311451 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:20.311461 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:20.313088 (+ 1627us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:20.313527 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:20.313531 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:20.313531 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:20.313652 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:20.313886 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:20.313887 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:20.313887 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:20.314217 (+ 330us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:20.314365 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:20.314465 (+ 100us) server_negotiation.cc:299] Negotiation successful
0812 00:02:20.314552 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
Aug 12 00:02:20 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.67@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:02:20 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.67@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:02:20.317867 28416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:20.313938 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:36869 (local address 127.11.206.67:54237)
0812 00:02:20.313979 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:20.313988 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:20.314022 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:20.314123 (+ 101us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:20.314123 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:20.314265 (+ 142us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:20.314316 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:20.314318 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:20.315093 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:20.315093 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:20.315602 (+ 509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:20.315604 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:20.316007 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:20.316008 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:20.316059 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:20.316385 (+ 326us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:20.316390 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:20.317826 (+ 1436us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.206.126:36869: Server oryx/127.11.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":28}
W20260812 00:02:20.317967 27930 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:02:20.313983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.67:54237 (local address 127.11.206.126:36869)
0812 00:02:20.314016 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:20.314018 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:20.314025 (+ 7us) server_negotiation.cc:407] Connection header received
0812 00:02:20.314065 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:20.314065 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:20.314072 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:20.314108 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:20.314380 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:20.315027 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:20.315675 (+ 648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:20.315946 (+ 271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:20.315996 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:20.317904 (+ 1908us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.206.67:54237: BlockingRecv error: recv got EOF from 127.11.206.67:54237 (error 108)
Metrics: {"server-negotiator.queue_time_us":15}
Aug 12 00:02:20 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.67@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:02:20 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.67@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:02:20.321370 28416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:20.318110 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:36869 (local address 127.11.206.67:45807)
0812 00:02:20.318149 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:20.318158 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:20.318189 (+ 31us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:20.318282 (+ 93us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:20.318282 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:20.318376 (+ 94us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:20.318399 (+ 23us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:20.318400 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:20.318916 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:20.318916 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:20.319386 (+ 470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:20.319387 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:20.319641 (+ 254us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:20.319641 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:20.319672 (+ 31us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:20.319995 (+ 323us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:20.319999 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:20.321329 (+ 1330us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.206.126:36869: Server oryx/127.11.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":24}
W20260812 00:02:20.321494 27930 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:02:20.318150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.67:45807 (local address 127.11.206.126:36869)
0812 00:02:20.318180 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:20.318181 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:20.318189 (+ 8us) server_negotiation.cc:407] Connection header received
0812 00:02:20.318236 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:20.318237 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:20.318244 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:20.318280 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:20.318444 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:20.318869 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:20.319438 (+ 569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:20.319597 (+ 159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:20.319637 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:20.321436 (+ 1799us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.206.67:45807: BlockingRecv error: recv got EOF from 127.11.206.67:45807 (error 108)
Metrics: {"server-negotiator.queue_time_us":14}
W20260812 00:02:20.321508 28414 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 12 00:02:21 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.65@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:02:21 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.65@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:02:21.072763 28420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:21.068457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:36869 (local address 127.11.206.65:33831)
0812 00:02:21.068590 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:21.068600 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:21.068651 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:21.068788 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:21.068789 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:21.068953 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:21.069002 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:21.069004 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:21.069664 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:21.069664 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:21.070210 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:21.070212 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:21.070523 (+ 311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:21.070524 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:21.070562 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:21.071015 (+ 453us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:21.071019 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:21.072685 (+ 1666us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.206.126:36869: Server oryx/127.11.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":62,"threads_started":1}
W20260812 00:02:21.072932 28423 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:02:21.068525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.65:33831 (local address 127.11.206.126:36869)
0812 00:02:21.068636 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:21.068638 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:21.068648 (+ 10us) server_negotiation.cc:407] Connection header received
0812 00:02:21.068696 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:21.068697 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:21.068706 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:21.068778 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:21.069056 (+ 278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:21.069607 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:21.070287 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:21.070472 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:21.070516 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:21.072858 (+ 2342us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.206.65:33831: BlockingRecv error: recv got EOF from 127.11.206.65:33831 (error 108)
Metrics: {"server-negotiator.queue_time_us":94,"thread_start_us":57,"threads_started":1}
Aug 12 00:02:21 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.66@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:02:21 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.66@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:02:21.208328 28425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:21.203715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:36869 (local address 127.11.206.66:51967)
0812 00:02:21.203872 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:21.203883 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:21.203948 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:21.204094 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:21.204095 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:21.204269 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:21.204318 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:21.204320 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:21.204992 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:21.204993 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:21.205633 (+ 640us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:21.205636 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:21.206002 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:21.206002 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:21.206037 (+ 35us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:21.206492 (+ 455us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:21.206496 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:21.208258 (+ 1762us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.206.126:36869: Server oryx/127.11.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":73,"threads_started":1}
W20260812 00:02:21.208421 28423 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:02:21.203837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.66:51967 (local address 127.11.206.126:36869)
0812 00:02:21.203905 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:21.203907 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:21.203933 (+ 26us) server_negotiation.cc:407] Connection header received
0812 00:02:21.204004 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:21.204005 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:21.204019 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:21.204084 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:21.204392 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:21.204914 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:21.205723 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:21.205938 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:21.206000 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:21.208357 (+ 2357us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.206.66:51967: BlockingRecv error: recv got EOF from 127.11.206.66:51967 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
Aug 12 00:02:21 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.67@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:02:21 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.67@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:02:21.326581 28427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:21.321889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:36869 (local address 127.11.206.67:52199)
0812 00:02:21.322041 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:21.322051 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:21.322115 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:21.322240 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:21.322241 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:21.322418 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:21.322488 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:21.322490 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:21.323111 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:21.323111 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:21.323712 (+ 601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:21.323715 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:21.324039 (+ 324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:21.324040 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:21.324079 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:21.324531 (+ 452us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:21.324536 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:21.326486 (+ 1950us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.206.126:36869: Server oryx/127.11.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":88,"threads_started":1}
W20260812 00:02:21.326617 28423 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:02:21.321988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.67:52199 (local address 127.11.206.126:36869)
0812 00:02:21.322049 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:21.322051 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:21.322109 (+ 58us) server_negotiation.cc:407] Connection header received
0812 00:02:21.322159 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:21.322160 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:21.322172 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:21.322227 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:21.322546 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:21.323051 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:21.323788 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:21.323981 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:21.324033 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:21.326562 (+ 2529us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.206.67:52199: BlockingRecv error: recv got EOF from 127.11.206.67:52199 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
Aug 12 00:02:22 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.65@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:02:22 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.65@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:02:22.077603 28428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:22.073217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:36869 (local address 127.11.206.65:47821)
0812 00:02:22.073365 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:22.073396 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:22.073455 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:22.073591 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:22.073591 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:22.073783 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:22.073835 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:22.073837 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:22.074459 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:22.074460 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:22.075018 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:22.075020 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:22.075321 (+ 301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:22.075321 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:22.075358 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:22.075784 (+ 426us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:22.075788 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:22.077521 (+ 1733us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.206.126:36869: Server oryx/127.11.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":69,"threads_started":1}
W20260812 00:02:22.077683 28429 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:02:22.073294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.65:47821 (local address 127.11.206.126:36869)
0812 00:02:22.073452 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:22.073454 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:22.073464 (+ 10us) server_negotiation.cc:407] Connection header received
0812 00:02:22.073505 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:22.073506 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:22.073517 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:22.073565 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:22.073897 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:22.074395 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:22.075080 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:22.075268 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:22.075313 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:22.077620 (+ 2307us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.206.65:47821: BlockingRecv error: recv got EOF from 127.11.206.65:47821 (error 108)
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":73,"threads_started":1}
Aug 12 00:02:22 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.66@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:02:22 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.66@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:02:22.213201 28430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:22.208802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:36869 (local address 127.11.206.66:51499)
0812 00:02:22.208931 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:22.208943 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:22.209007 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:22.209128 (+ 121us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:22.209129 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:22.209297 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:22.209348 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:22.209350 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:22.210008 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:22.210009 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:22.210546 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:22.210547 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:22.210909 (+ 362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:22.210910 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:22.210949 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:22.211385 (+ 436us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:22.211390 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:22.213136 (+ 1746us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.206.126:36869: Server oryx/127.11.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":60,"threads_started":1}
W20260812 00:02:22.213341 28429 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:02:22.208883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.66:51499 (local address 127.11.206.126:36869)
0812 00:02:22.208929 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:22.208931 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:22.208992 (+ 61us) server_negotiation.cc:407] Connection header received
0812 00:02:22.209057 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:22.209057 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:22.209068 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:22.209103 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:22.209442 (+ 339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:22.209949 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:22.210635 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:22.210846 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:22.210905 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:22.213273 (+ 2368us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.206.66:51499: BlockingRecv error: recv got EOF from 127.11.206.66:51499 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
Aug 12 00:02:22 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.67@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:02:22 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.67@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:02:22.331183 28433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:22.327016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:36869 (local address 127.11.206.67:42039)
0812 00:02:22.327144 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:22.327154 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:22.327204 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:22.327343 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:22.327344 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:22.327516 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:22.327567 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:22.327568 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:22.328160 (+ 592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:22.328160 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:22.328696 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:22.328697 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:22.328982 (+ 285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:22.328982 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:22.329018 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:22.329465 (+ 447us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:22.329469 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:22.331123 (+ 1654us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.206.126:36869: Server oryx/127.11.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":59,"threads_started":1}
W20260812 00:02:22.331300 28429 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:02:22.327150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.67:42039 (local address 127.11.206.126:36869)
0812 00:02:22.327203 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:22.327205 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:22.327213 (+ 8us) server_negotiation.cc:407] Connection header received
0812 00:02:22.327270 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:22.327271 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:22.327282 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:22.327328 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:22.327619 (+ 291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:22.328106 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:22.328757 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:22.328931 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:22.328975 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:22.331217 (+ 2242us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.206.67:42039: BlockingRecv error: recv got EOF from 127.11.206.67:42039 (error 108)
Metrics: {"server-negotiator.queue_time_us":31}
Aug 12 00:02:23 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.65@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:02:23 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.65@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:02:23.082561 28436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:23.078138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:36869 (local address 127.11.206.65:52657)
0812 00:02:23.078297 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:23.078311 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:23.078384 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:23.078533 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:23.078534 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:23.078728 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:23.078786 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:23.078788 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:23.079420 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:23.079420 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:23.079948 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:23.079950 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:23.080239 (+ 289us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:23.080240 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:23.080284 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:23.080687 (+ 403us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:23.080691 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:23.082472 (+ 1781us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.206.126:36869: Server oryx/127.11.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":97,"threads_started":1}
W20260812 00:02:23.082641 28437 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:02:23.078185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.65:52657 (local address 127.11.206.126:36869)
0812 00:02:23.078330 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:23.078332 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:23.078368 (+ 36us) server_negotiation.cc:407] Connection header received
0812 00:02:23.078435 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:23.078435 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:23.078448 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:23.078513 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:23.078856 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:23.079363 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:23.080007 (+ 644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:23.080188 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:23.080231 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:23.082578 (+ 2347us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.206.65:52657: BlockingRecv error: recv got EOF from 127.11.206.65:52657 (error 108)
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":68,"threads_started":1}
Aug 12 00:02:23 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.66@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:02:23 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.66@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:02:23.218501 28438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:23.213773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:36869 (local address 127.11.206.66:50285)
0812 00:02:23.213923 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:23.213935 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:23.214002 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:23.214129 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:23.214130 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:23.214331 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:23.214382 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:23.214384 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:23.215052 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:23.215053 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:23.215587 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:23.215589 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:23.215938 (+ 349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:23.215940 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:23.215997 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:23.216452 (+ 455us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:23.216456 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:23.218414 (+ 1958us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.206.126:36869: Server oryx/127.11.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":65,"threads_started":1}
W20260812 00:02:23.218583 28437 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:02:23.213873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.66:50285 (local address 127.11.206.126:36869)
0812 00:02:23.213928 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:23.213930 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:23.214001 (+ 71us) server_negotiation.cc:407] Connection header received
0812 00:02:23.214063 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:23.214064 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:23.214077 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:23.214124 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:23.214458 (+ 334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:23.214971 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:23.215668 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:23.215870 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:23.215926 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:23.218523 (+ 2597us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.206.66:50285: BlockingRecv error: recv got EOF from 127.11.206.66:50285 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
Aug 12 00:02:23 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.67@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:02:23 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.67@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:02:23.336182 28439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:23.331704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:36869 (local address 127.11.206.67:36065)
0812 00:02:23.331868 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:23.331879 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:23.331944 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:23.332076 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:23.332077 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:23.332242 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:23.332292 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:23.332294 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:23.332894 (+ 600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:23.332895 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:23.333489 (+ 594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:23.333492 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:23.333818 (+ 326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:23.333819 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:23.333859 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:23.334337 (+ 478us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:23.334341 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:23.336112 (+ 1771us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.206.126:36869: Server oryx/127.11.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":86,"threads_started":1}
W20260812 00:02:23.336277 28437 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:02:23.331783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.67:36065 (local address 127.11.206.126:36869)
0812 00:02:23.331839 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:23.331841 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:23.331934 (+ 93us) server_negotiation.cc:407] Connection header received
0812 00:02:23.332004 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:23.332005 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:23.332016 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:23.332057 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:23.332342 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:23.332837 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:23.333559 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:23.333758 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:23.333811 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:23.336214 (+ 2403us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.206.67:36065: BlockingRecv error: recv got EOF from 127.11.206.67:36065 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
Aug 12 00:02:24 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.65@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:02:24 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.65@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:02:24.087393 28440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:24.083038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:36869 (local address 127.11.206.65:50645)
0812 00:02:24.083161 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:24.083172 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:24.083228 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:24.083354 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:24.083354 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:24.083514 (+ 160us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:24.083576 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:24.083578 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:24.084210 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:24.084211 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:24.084743 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:24.084744 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:24.085026 (+ 282us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:24.085027 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:24.085063 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:24.085551 (+ 488us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:24.085556 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:24.087334 (+ 1778us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.206.126:36869: Server oryx/127.11.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":70,"threads_started":1}
W20260812 00:02:24.087497 28442 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:02:24.083106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.65:50645 (local address 127.11.206.126:36869)
0812 00:02:24.083230 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:24.083232 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:24.083270 (+ 38us) server_negotiation.cc:407] Connection header received
0812 00:02:24.083290 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:24.083291 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:24.083301 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:24.083348 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:24.083653 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:24.084151 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:24.084800 (+ 649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:24.084979 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:24.085022 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:24.087429 (+ 2407us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.206.65:50645: BlockingRecv error: recv got EOF from 127.11.206.65:50645 (error 108)
Metrics: {"server-negotiator.queue_time_us":102,"thread_start_us":61,"threads_started":1}
Aug 12 00:02:24 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.66@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:02:24 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.66@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:02:24.223625 28443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:24.219043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:36869 (local address 127.11.206.66:33361)
0812 00:02:24.219166 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:24.219177 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:24.219248 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:24.219405 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:24.219406 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:24.219573 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:24.219624 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:24.219626 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:24.220249 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:24.220250 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:24.220772 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:24.220773 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:24.221247 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:24.221248 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:24.221304 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:24.221748 (+ 444us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:24.221752 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:24.223565 (+ 1813us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.206.126:36869: Server oryx/127.11.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":72,"threads_started":1}
W20260812 00:02:24.223767 28442 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:02:24.219149 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.66:33361 (local address 127.11.206.126:36869)
0812 00:02:24.219228 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:24.219230 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:24.219242 (+ 12us) server_negotiation.cc:407] Connection header received
0812 00:02:24.219307 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:24.219308 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:24.219320 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:24.219401 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:24.219677 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:24.220178 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:24.220841 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:24.221133 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:24.221201 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:24.223703 (+ 2502us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.206.66:33361: BlockingRecv error: recv got EOF from 127.11.206.66:33361 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 12 00:02:24 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.67@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:02:24 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.67@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:02:24.341156 28445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:24.336681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:36869 (local address 127.11.206.67:46505)
0812 00:02:24.336830 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:24.336840 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:24.336901 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:24.337033 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:24.337034 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:24.337199 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:24.337252 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:24.337253 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:24.337888 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:24.337888 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:24.338412 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:24.338413 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:24.338683 (+ 270us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:24.338684 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:24.338720 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:24.339185 (+ 465us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:24.339191 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:24.341064 (+ 1873us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.206.126:36869: Server oryx/127.11.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":89,"threads_started":1}
W20260812 00:02:24.341235 28442 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:02:24.336766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.67:46505 (local address 127.11.206.126:36869)
0812 00:02:24.336837 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:24.336840 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:24.336896 (+ 56us) server_negotiation.cc:407] Connection header received
0812 00:02:24.336963 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:24.336964 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:24.336977 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:24.337018 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:24.337307 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:24.337834 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:24.338468 (+ 634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:24.338637 (+ 169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:24.338678 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:24.341183 (+ 2505us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.206.67:46505: BlockingRecv error: recv got EOF from 127.11.206.67:46505 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Aug 12 00:02:25 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.65@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:02:25 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.65@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:02:25.092239 28446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:25.087851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:36869 (local address 127.11.206.65:33159)
0812 00:02:25.087987 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:25.087998 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:25.088054 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:25.088174 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:25.088175 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:25.088351 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:25.088401 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:25.088403 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:25.089019 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:25.089020 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:25.089622 (+ 602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:25.089624 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:25.089935 (+ 311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:25.089935 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:25.089971 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:25.090402 (+ 431us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:25.090406 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:25.092160 (+ 1754us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.206.126:36869: Server oryx/127.11.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":71,"threads_started":1}
W20260812 00:02:25.092338 28447 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:02:25.087929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.65:33159 (local address 127.11.206.126:36869)
0812 00:02:25.088044 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:25.088046 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:25.088057 (+ 11us) server_negotiation.cc:407] Connection header received
0812 00:02:25.088097 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:25.088098 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:25.088109 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:25.088164 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:25.088456 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:25.088961 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:25.089688 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:25.089880 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:25.089930 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:25.092275 (+ 2345us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.206.65:33159: BlockingRecv error: recv got EOF from 127.11.206.65:33159 (error 108)
Metrics: {"server-negotiator.queue_time_us":93,"thread_start_us":54,"threads_started":1}
Aug 12 00:02:25 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.66@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:02:25 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.66@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:02:25.231478 28449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:25.224133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:36869 (local address 127.11.206.66:46023)
0812 00:02:25.224286 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:25.224298 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:25.224358 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:25.224472 (+ 114us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:25.224473 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:25.224640 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:25.224690 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:25.224692 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:25.225360 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:25.225361 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:25.225910 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:25.225911 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:25.226265 (+ 354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:25.226266 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:25.226313 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:25.229605 (+ 3292us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:25.229611 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:25.231417 (+ 1806us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.206.126:36869: Server oryx/127.11.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":70,"threads_started":1}
W20260812 00:02:25.231602 28447 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:02:25.224215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.66:46023 (local address 127.11.206.126:36869)
0812 00:02:25.224267 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:25.224269 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:25.224352 (+ 83us) server_negotiation.cc:407] Connection header received
0812 00:02:25.224401 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:25.224402 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:25.224412 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:25.224462 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:25.224737 (+ 275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:25.225287 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:25.225966 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:25.226206 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:25.226269 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:25.231529 (+ 5260us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.206.66:46023: BlockingRecv error: recv got EOF from 127.11.206.66:46023 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
Aug 12 00:02:25 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.67@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:02:25 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.67@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:02:25.346217 28450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:25.341712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:36869 (local address 127.11.206.67:48433)
0812 00:02:25.341869 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:25.341882 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:25.341951 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:25.342092 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:25.342093 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:25.342323 (+ 230us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:25.342389 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:25.342392 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:25.343033 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:25.343034 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:25.343577 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:25.343578 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:25.343905 (+ 327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:25.343906 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:25.343962 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:25.344376 (+ 414us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:25.344380 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:25.346154 (+ 1774us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.206.126:36869: Server oryx/127.11.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":95,"threads_started":1}
W20260812 00:02:25.346328 28447 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:02:25.341816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.67:48433 (local address 127.11.206.126:36869)
0812 00:02:25.341891 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:25.341893 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:25.341935 (+ 42us) server_negotiation.cc:407] Connection header received
0812 00:02:25.342008 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:25.342008 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:25.342020 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:25.342078 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:25.342459 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:25.342958 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:25.343654 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:25.343845 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:25.343899 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:25.346267 (+ 2368us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.206.67:48433: BlockingRecv error: recv got EOF from 127.11.206.67:48433 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 12 00:02:26 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.65@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:02:26 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.65@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:02:26.097409 28452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:26.092690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:36869 (local address 127.11.206.65:59139)
0812 00:02:26.092863 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:26.092876 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:26.092941 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:26.093099 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:26.093099 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:26.093265 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:26.093316 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:26.093318 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:26.093996 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:26.093997 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:26.094565 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:26.094571 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:26.094909 (+ 338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:26.094910 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:26.094956 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:26.095484 (+ 528us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:26.095489 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:26.097320 (+ 1831us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.206.126:36869: Server oryx/127.11.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":90,"threads_started":1}
W20260812 00:02:26.097579 28453 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:02:26.092769 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.65:59139 (local address 127.11.206.126:36869)
0812 00:02:26.092907 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:26.092909 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:26.092921 (+ 12us) server_negotiation.cc:407] Connection header received
0812 00:02:26.092992 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:26.092993 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:26.093004 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:26.093059 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:26.093368 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:26.093923 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:26.094644 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:26.094852 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:26.094897 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:26.097489 (+ 2592us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.206.65:59139: BlockingRecv error: recv got EOF from 127.11.206.65:59139 (error 108)
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":90,"threads_started":1}
Aug 12 00:02:26 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.66@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:02:26 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.66@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:02:26.236454 28456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:26.232016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:36869 (local address 127.11.206.66:37791)
0812 00:02:26.232154 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:26.232166 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:26.232234 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:26.232403 (+ 169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:26.232404 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:26.232584 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:26.232636 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:26.232637 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:26.233270 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:26.233271 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:26.233862 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:26.233865 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:26.234153 (+ 288us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:26.234154 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:26.234198 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:26.234611 (+ 413us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:26.234615 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:26.236395 (+ 1780us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.206.126:36869: Server oryx/127.11.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":68,"threads_started":1}
W20260812 00:02:26.236549 28453 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:02:26.232107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.66:37791 (local address 127.11.206.126:36869)
0812 00:02:26.232154 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:26.232156 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:26.232228 (+ 72us) server_negotiation.cc:407] Connection header received
0812 00:02:26.232305 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:26.232305 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:26.232316 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:26.232362 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:26.232695 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:26.233191 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:26.233927 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:26.234105 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:26.234146 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:26.236488 (+ 2342us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.206.66:37791: BlockingRecv error: recv got EOF from 127.11.206.66:37791 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
Aug 12 00:02:26 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.67@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:02:26 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.67@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:02:26.351338 28457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:26.346724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:36869 (local address 127.11.206.67:40647)
0812 00:02:26.346858 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:26.346868 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:26.346926 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:26.347051 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:26.347051 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:26.347214 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:26.347264 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:26.347266 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:26.347869 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:26.347870 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:26.348418 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:26.348420 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:26.348785 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:26.348786 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:26.348839 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:26.349284 (+ 445us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:26.349289 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:26.351276 (+ 1987us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.206.126:36869: Server oryx/127.11.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":64,"threads_started":1}
W20260812 00:02:26.351423 28453 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:02:26.346815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.67:40647 (local address 127.11.206.126:36869)
0812 00:02:26.346871 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:26.346874 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:26.346914 (+ 40us) server_negotiation.cc:407] Connection header received
0812 00:02:26.346983 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:26.346984 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:26.346995 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:26.347037 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:26.347314 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:26.347814 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:26.348496 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:26.348694 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:26.348749 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:26.351365 (+ 2616us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.206.67:40647: BlockingRecv error: recv got EOF from 127.11.206.67:40647 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
Aug 12 00:02:27 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.65@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:02:27 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.65@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:02:27.102533 28459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:27.097875 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:36869 (local address 127.11.206.65:35699)
0812 00:02:27.098008 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:27.098021 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:27.098084 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:27.098212 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:27.098212 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:27.098377 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:27.098428 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:27.098430 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:27.099161 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:27.099162 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:27.099703 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:27.099705 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:27.100091 (+ 386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:27.100091 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:27.100133 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:27.100551 (+ 418us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:27.100555 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:27.102444 (+ 1889us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.206.126:36869: Server oryx/127.11.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":65,"threads_started":1}
W20260812 00:02:27.102613 28461 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:02:27.097950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.65:35699 (local address 127.11.206.126:36869)
0812 00:02:27.098076 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:27.098078 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:27.098098 (+ 20us) server_negotiation.cc:407] Connection header received
0812 00:02:27.098124 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:27.098125 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:27.098136 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:27.098193 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:27.098517 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:27.099079 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:27.099793 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:27.099994 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:27.100088 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:27.102548 (+ 2460us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.206.65:35699: BlockingRecv error: recv got EOF from 127.11.206.65:35699 (error 108)
Metrics: {"server-negotiator.queue_time_us":106,"thread_start_us":67,"threads_started":1}
Aug 12 00:02:27 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.66@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:02:27 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.66@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:02:27.241425 28462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:27.236916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:36869 (local address 127.11.206.66:44887)
0812 00:02:27.237045 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:27.237056 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:27.237118 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:27.237303 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:27.237304 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:27.237520 (+ 216us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:27.237572 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:27.237575 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:27.238216 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:27.238217 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:27.238757 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:27.238759 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:27.239068 (+ 309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:27.239069 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:27.239118 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:27.239565 (+ 447us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:27.239569 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:27.241319 (+ 1750us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.206.126:36869: Server oryx/127.11.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":67,"threads_started":1}
W20260812 00:02:27.241508 28461 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:02:27.236978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.66:44887 (local address 127.11.206.126:36869)
0812 00:02:27.237042 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:27.237044 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:27.237110 (+ 66us) server_negotiation.cc:407] Connection header received
0812 00:02:27.237191 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:27.237192 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:27.237206 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:27.237271 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:27.237634 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:27.238151 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:27.238817 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:27.239001 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:27.239046 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:27.241455 (+ 2409us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.206.66:44887: BlockingRecv error: recv got EOF from 127.11.206.66:44887 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Aug 12 00:02:27 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.67@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:02:27 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.67@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:02:27.356177 28464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:27.351813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:36869 (local address 127.11.206.67:56377)
0812 00:02:27.351941 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:27.351951 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:27.352009 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:27.352124 (+ 115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:27.352124 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:27.352288 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:27.352337 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:27.352339 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:27.352934 (+ 595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:27.352935 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:27.353518 (+ 583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:27.353520 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:27.353856 (+ 336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:27.353857 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:27.353925 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:27.354398 (+ 473us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:27.354404 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:27.356099 (+ 1695us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.206.126:36869: Server oryx/127.11.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":61,"threads_started":1}
W20260812 00:02:27.356273 28461 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:02:27.351909 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.67:56377 (local address 127.11.206.126:36869)
0812 00:02:27.351964 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:27.351966 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:27.351997 (+ 31us) server_negotiation.cc:407] Connection header received
0812 00:02:27.352051 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:27.352052 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:27.352064 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:27.352118 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:27.352384 (+ 266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:27.352875 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:27.353579 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:27.353768 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:27.353832 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:27.356198 (+ 2366us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.206.67:56377: BlockingRecv error: recv got EOF from 127.11.206.67:56377 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
Aug 12 00:02:28 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.65@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:02:28 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.65@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:02:28.107568 28466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:28.103071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:36869 (local address 127.11.206.65:38705)
0812 00:02:28.103209 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:28.103223 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:28.103315 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:28.103438 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:28.103438 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:28.103603 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:28.103657 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:28.103658 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:28.104300 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:28.104300 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:28.104819 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:28.104821 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:28.105164 (+ 343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:28.105165 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:28.105200 (+ 35us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:28.105702 (+ 502us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:28.105706 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:28.107477 (+ 1771us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.206.126:36869: Server oryx/127.11.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":79,"threads_started":1}
W20260812 00:02:28.107656 28468 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:02:28.103186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.65:38705 (local address 127.11.206.126:36869)
0812 00:02:28.103318 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:28.103320 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:28.103346 (+ 26us) server_negotiation.cc:407] Connection header received
0812 00:02:28.103367 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:28.103368 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:28.103378 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:28.103423 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:28.103708 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:28.104238 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:28.104898 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:28.105105 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:28.105163 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:28.107587 (+ 2424us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.206.65:38705: BlockingRecv error: recv got EOF from 127.11.206.65:38705 (error 108)
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":69,"threads_started":1}
Aug 12 00:02:28 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.66@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:02:28 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.66@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:02:28.246657 28471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:28.242008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:36869 (local address 127.11.206.66:42379)
0812 00:02:28.242186 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:28.242197 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:28.242265 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:28.242407 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:28.242408 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:28.242591 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:28.242645 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:28.242647 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:28.243612 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:28.243614 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:28.244165 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:28.244168 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:28.244460 (+ 292us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:28.244461 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:28.244499 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:28.244901 (+ 402us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:28.244905 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:28.246596 (+ 1691us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.206.126:36869: Server oryx/127.11.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":70,"threads_started":1}
W20260812 00:02:28.246747 28468 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:02:28.242093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.66:42379 (local address 127.11.206.126:36869)
0812 00:02:28.242170 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:28.242172 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:28.242259 (+ 87us) server_negotiation.cc:407] Connection header received
0812 00:02:28.242318 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:28.242319 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:28.242330 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:28.242390 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:28.242721 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:28.243524 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:28.244231 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:28.244413 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:28.244456 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:28.246688 (+ 2232us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.206.66:42379: BlockingRecv error: recv got EOF from 127.11.206.66:42379 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 12 00:02:28 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.67@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:02:28 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.67@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:02:28.361752 28472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:28.356738 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:36869 (local address 127.11.206.67:49575)
0812 00:02:28.356883 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:28.356895 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:28.356955 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:28.357189 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:28.357191 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:28.357424 (+ 233us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:28.357474 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:28.357477 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:28.358230 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:28.358231 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:28.358780 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:28.358782 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:28.359181 (+ 399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:28.359181 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:28.359231 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:28.359654 (+ 423us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:28.359659 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:28.361658 (+ 1999us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.206.126:36869: Server oryx/127.11.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":89,"threads_started":1}
W20260812 00:02:28.361883 28468 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:02:28.356830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.67:49575 (local address 127.11.206.126:36869)
0812 00:02:28.356909 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:28.356911 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:28.357002 (+ 91us) server_negotiation.cc:407] Connection header received
0812 00:02:28.357048 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:28.357049 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:28.357069 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:28.357144 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:28.357554 (+ 410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:28.358152 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:28.358867 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:28.359119 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:28.359175 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:28.361813 (+ 2638us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.206.67:49575: BlockingRecv error: recv got EOF from 127.11.206.67:49575 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 12 00:02:29 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.65@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:02:29 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.65@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:02:29.112619 28473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:29.108125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:36869 (local address 127.11.206.65:38483)
0812 00:02:29.108248 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:29.108266 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:29.108331 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:29.108454 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:29.108455 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:29.108623 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:29.108676 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:29.108677 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:29.109296 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:29.109297 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:29.109847 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:29.109849 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:29.110242 (+ 393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:29.110243 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:29.110286 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:29.110709 (+ 423us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:29.110714 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:29.112547 (+ 1833us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.206.126:36869: Server oryx/127.11.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":62,"threads_started":1}
W20260812 00:02:29.112708 28476 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:02:29.108199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.65:38483 (local address 127.11.206.126:36869)
0812 00:02:29.108332 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:29.108334 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:29.108342 (+ 8us) server_negotiation.cc:407] Connection header received
0812 00:02:29.108368 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:29.108368 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:29.108378 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:29.108432 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:29.108735 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:29.109226 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:29.109943 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:29.110175 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:29.110234 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:29.112637 (+ 2403us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.206.65:38483: BlockingRecv error: recv got EOF from 127.11.206.65:38483 (error 108)
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":69,"threads_started":1}
Aug 12 00:02:29 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.66@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:02:29 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.66@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:02:29.251500 28477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:29.247124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:36869 (local address 127.11.206.66:34599)
0812 00:02:29.247240 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:29.247253 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:29.247328 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:29.247462 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:29.247462 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:29.247642 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:29.247685 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:29.247687 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:29.248328 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:29.248329 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:29.248853 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:29.248854 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:29.249163 (+ 309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:29.249164 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:29.249218 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:29.249658 (+ 440us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:29.249662 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:29.251415 (+ 1753us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.206.126:36869: Server oryx/127.11.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":95,"thread_start_us":62,"threads_started":1}
W20260812 00:02:29.251647 28476 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:02:29.247224 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.66:34599 (local address 127.11.206.126:36869)
0812 00:02:29.247301 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:29.247303 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:29.247312 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:02:29.247383 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:29.247384 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:29.247398 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:29.247445 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:29.247750 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:29.248257 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:29.248921 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:29.249107 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:29.249159 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:29.251587 (+ 2428us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.206.66:34599: BlockingRecv error: recv got EOF from 127.11.206.66:34599 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 12 00:02:29 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.67@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:02:29 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.67@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:02:29.366611 28479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:29.362231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:36869 (local address 127.11.206.67:56711)
0812 00:02:29.362408 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:29.362419 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:29.362495 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:29.362661 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:29.362662 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:29.362886 (+ 224us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:29.362949 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:29.362952 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:29.363597 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:29.363598 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:29.364130 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:29.364132 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:29.364414 (+ 282us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:29.364414 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:29.364450 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:29.364855 (+ 405us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:29.364859 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:29.366549 (+ 1690us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.206.126:36869: Server oryx/127.11.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":78,"threads_started":1}
W20260812 00:02:29.366694 28476 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:02:29.362337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.67:56711 (local address 127.11.206.126:36869)
0812 00:02:29.362428 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:29.362431 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:29.362485 (+ 54us) server_negotiation.cc:407] Connection header received
0812 00:02:29.362554 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:29.362555 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:29.362570 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:29.362639 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:29.363032 (+ 393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:29.363536 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:29.364188 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:29.364368 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:29.364411 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:29.366635 (+ 2224us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.206.67:56711: BlockingRecv error: recv got EOF from 127.11.206.67:56711 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Aug 12 00:02:30 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.65@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:02:30 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.65@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:02:30.117781 28482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:30.113160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:36869 (local address 127.11.206.65:35677)
0812 00:02:30.113308 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:30.113323 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:30.113418 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:30.113585 (+ 167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:30.113585 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:30.113767 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:30.113821 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:30.113823 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:30.114515 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:30.114516 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:30.115043 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:30.115045 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:30.115406 (+ 361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:30.115407 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:30.115442 (+ 35us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:30.115894 (+ 452us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:30.115899 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:30.117711 (+ 1812us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.206.126:36869: Server oryx/127.11.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":69,"threads_started":1}
W20260812 00:02:30.117921 28483 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:02:30.113276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.65:35677 (local address 127.11.206.126:36869)
0812 00:02:30.113457 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:30.113459 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:30.113468 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:02:30.113493 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:30.113493 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:30.113505 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:30.113568 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:30.113891 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:30.114451 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:30.115132 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:30.115347 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:30.115404 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:30.117839 (+ 2435us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.206.65:35677: BlockingRecv error: recv got EOF from 127.11.206.65:35677 (error 108)
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":74,"threads_started":1}
Aug 12 00:02:30 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.66@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:02:30 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.66@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:02:30.259596 28484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:30.251974 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:36869 (local address 127.11.206.66:58795)
0812 00:02:30.252146 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:30.252157 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:30.252247 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:30.252371 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:30.252372 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:30.252556 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:30.252603 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:30.252605 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:30.253255 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:30.253256 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:30.253846 (+ 590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:30.253848 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:30.254170 (+ 322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:30.254172 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:30.254225 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:30.257544 (+ 3319us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:30.257550 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:30.259537 (+ 1987us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.206.126:36869: Server oryx/127.11.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":91,"threads_started":1}
W20260812 00:02:30.259728 28483 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:02:30.252073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.66:58795 (local address 127.11.206.126:36869)
0812 00:02:30.252140 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:30.252142 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:30.252207 (+ 65us) server_negotiation.cc:407] Connection header received
0812 00:02:30.252309 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:30.252310 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:30.252324 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:30.252366 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:30.252675 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:30.253177 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:30.253922 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:30.254114 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:30.254167 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:30.259647 (+ 5480us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.206.66:58795: BlockingRecv error: recv got EOF from 127.11.206.66:58795 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
Aug 12 00:02:30 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.67@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:02:30 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.67@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:02:30.371788 28485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:30.367046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:36869 (local address 127.11.206.67:45179)
0812 00:02:30.367187 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:30.367199 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:30.367255 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:30.367378 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:30.367379 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:30.367558 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:30.367616 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:30.367617 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:30.368227 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:30.368228 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:30.368780 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:30.368782 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:30.369137 (+ 355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:30.369139 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:30.369202 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:30.369684 (+ 482us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:30.369688 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:30.371702 (+ 2014us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.206.126:36869: Server oryx/127.11.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":62,"threads_started":1}
W20260812 00:02:30.371884 28483 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:02:30.367218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.67:45179 (local address 127.11.206.126:36869)
0812 00:02:30.367279 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:30.367280 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:30.367288 (+ 8us) server_negotiation.cc:407] Connection header received
0812 00:02:30.367312 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:30.367312 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:30.367322 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:30.367368 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:30.367669 (+ 301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:30.368155 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:30.368860 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:30.369048 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:30.369099 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:30.371809 (+ 2710us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.206.67:45179: BlockingRecv error: recv got EOF from 127.11.206.67:45179 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Aug 12 00:02:31 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.65@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:02:31 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.65@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:02:31.122658 28487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:31.118258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:36869 (local address 127.11.206.65:42217)
0812 00:02:31.118389 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:31.118402 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:31.118516 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:31.118657 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:31.118658 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:31.118830 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:31.118876 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:31.118878 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:31.119491 (+ 613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:31.119491 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:31.120036 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:31.120038 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:31.120324 (+ 286us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:31.120325 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:31.120360 (+ 35us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:31.120771 (+ 411us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:31.120775 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:31.122586 (+ 1811us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.206.126:36869: Server oryx/127.11.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":73,"threads_started":1}
W20260812 00:02:31.122736 28488 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:02:31.118294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.65:42217 (local address 127.11.206.126:36869)
0812 00:02:31.118440 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:31.118442 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:31.118450 (+ 8us) server_negotiation.cc:407] Connection header received
0812 00:02:31.118584 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:31.118584 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:31.118597 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:31.118647 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:31.118933 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:31.119433 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:31.120092 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:31.120277 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:31.120321 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:31.122675 (+ 2354us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.206.65:42217: BlockingRecv error: recv got EOF from 127.11.206.65:42217 (error 108)
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":88,"threads_started":1}
Aug 12 00:02:31 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.66@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:02:31 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.66@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:02:31.264227 28489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:31.260002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:36869 (local address 127.11.206.66:49603)
0812 00:02:31.260172 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:31.260182 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:31.260241 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:31.260394 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:31.260395 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:31.260562 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:31.260611 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:31.260613 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:31.261198 (+ 585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:31.261199 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:31.261804 (+ 605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:31.261806 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:31.262100 (+ 294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:31.262100 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:31.262135 (+ 35us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:31.262558 (+ 423us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:31.262562 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:31.264158 (+ 1596us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.206.126:36869: Server oryx/127.11.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":103,"threads_started":1}
W20260812 00:02:31.264331 28488 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:02:31.260077 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.66:49603 (local address 127.11.206.126:36869)
0812 00:02:31.260131 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:31.260133 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:31.260231 (+ 98us) server_negotiation.cc:407] Connection header received
0812 00:02:31.260301 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:31.260303 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:31.260347 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:31.260385 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:31.260660 (+ 275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:31.261147 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:31.261862 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:31.262050 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:31.262096 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:31.264273 (+ 2177us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.206.66:49603: BlockingRecv error: recv got EOF from 127.11.206.66:49603 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
Aug 12 00:02:31 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.67@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:02:31 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.67@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:02:31.376828 28490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:31.372366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:36869 (local address 127.11.206.67:37275)
0812 00:02:31.372514 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:31.372523 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:31.372580 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:31.372698 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:31.372698 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:31.372871 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:31.372917 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:31.372918 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:31.373566 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:31.373566 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:31.374129 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:31.374131 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:31.374416 (+ 285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:31.374416 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:31.374452 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:31.374906 (+ 454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:31.374910 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:31.376759 (+ 1849us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.206.126:36869: Server oryx/127.11.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":80,"threads_started":1}
W20260812 00:02:31.376904 28488 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:02:31.372460 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.67:37275 (local address 127.11.206.126:36869)
0812 00:02:31.372516 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:31.372518 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:31.372567 (+ 49us) server_negotiation.cc:407] Connection header received
0812 00:02:31.372622 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:31.372623 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:31.372634 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:31.372687 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:31.372968 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:31.373509 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:31.374184 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:31.374369 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:31.374414 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:31.376843 (+ 2429us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.206.67:37275: BlockingRecv error: recv got EOF from 127.11.206.67:37275 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
Aug 12 00:02:32 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.65@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:02:32 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.65@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:02:32.127710 28491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:32.123130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:36869 (local address 127.11.206.65:33823)
0812 00:02:32.123266 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:32.123276 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:32.123328 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:32.123484 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:32.123485 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:32.123654 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:32.123700 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:32.123702 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:32.124323 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:32.124324 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:32.124876 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:32.124878 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:32.125208 (+ 330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:32.125208 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:32.125247 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:32.125701 (+ 454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:32.125706 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:32.127636 (+ 1930us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.206.126:36869: Server oryx/127.11.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":66,"threads_started":1}
W20260812 00:02:32.127820 28492 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:02:32.123225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.65:33823 (local address 127.11.206.126:36869)
0812 00:02:32.123373 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:32.123374 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:32.123382 (+ 8us) server_negotiation.cc:407] Connection header received
0812 00:02:32.123404 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:32.123404 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:32.123415 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:32.123474 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:32.123760 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:32.124268 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:32.124934 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:32.125157 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:32.125206 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:32.127750 (+ 2544us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.206.65:33823: BlockingRecv error: recv got EOF from 127.11.206.65:33823 (error 108)
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":88,"threads_started":1}
Aug 12 00:02:32 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.66@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:02:32 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.66@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:02:32.268946 28493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:32.264693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:36869 (local address 127.11.206.66:49135)
0812 00:02:32.264847 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:32.264857 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:32.264918 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:32.265029 (+ 111us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:32.265029 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:32.265203 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:32.265253 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:32.265255 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:32.265922 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:32.265924 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:32.266478 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:32.266480 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:32.266792 (+ 312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:32.266793 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:32.266832 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:32.267243 (+ 411us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:32.267247 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:32.268884 (+ 1637us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.206.126:36869: Server oryx/127.11.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":92,"threads_started":1}
W20260812 00:02:32.269034 28492 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:02:32.264783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.66:49135 (local address 127.11.206.126:36869)
0812 00:02:32.264850 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:32.264852 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:32.264912 (+ 60us) server_negotiation.cc:407] Connection header received
0812 00:02:32.264964 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:32.264964 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:32.264975 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:32.265023 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:32.265302 (+ 279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:32.265839 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:32.266547 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:32.266732 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:32.266784 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:32.268969 (+ 2185us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.206.66:49135: BlockingRecv error: recv got EOF from 127.11.206.66:49135 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 12 00:02:32 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.67@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:02:32 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.67@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:02:32.381886 28496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:32.377276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:36869 (local address 127.11.206.67:34781)
0812 00:02:32.377457 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:32.377469 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:32.377543 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:32.377670 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:32.377671 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:32.377846 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:32.377894 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:32.377896 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:32.378516 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:32.378517 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:32.379073 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:32.379075 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:32.379397 (+ 322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:32.379398 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:32.379450 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:32.379947 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:32.379953 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:32.381814 (+ 1861us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.206.126:36869: Server oryx/127.11.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":63,"threads_started":1}
W20260812 00:02:32.381954 28492 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:02:32.377427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.67:34781 (local address 127.11.206.126:36869)
0812 00:02:32.377482 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:32.377484 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:32.377525 (+ 41us) server_negotiation.cc:407] Connection header received
0812 00:02:32.377598 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:32.377599 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:32.377610 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:32.377655 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:32.377946 (+ 291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:32.378441 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:32.379164 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:32.379348 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:32.379390 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:32.381902 (+ 2512us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.206.67:34781: BlockingRecv error: recv got EOF from 127.11.206.67:34781 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
Aug 12 00:02:33 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.65@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:02:33 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.65@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:02:33.132736 28499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:33.128193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:36869 (local address 127.11.206.65:42069)
0812 00:02:33.128336 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:33.128348 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:33.128405 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:33.128544 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:33.128544 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:33.128718 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:33.128772 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:33.128773 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:33.129454 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:33.129454 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:33.129990 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:33.129992 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:33.130311 (+ 319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:33.130312 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:33.130353 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:33.130780 (+ 427us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:33.130785 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:33.132674 (+ 1889us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.206.126:36869: Server oryx/127.11.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":77,"threads_started":1}
W20260812 00:02:33.132984 28501 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:02:33.128269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.65:42069 (local address 127.11.206.126:36869)
0812 00:02:33.128386 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:33.128388 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:33.128398 (+ 10us) server_negotiation.cc:407] Connection header received
0812 00:02:33.128461 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:33.128462 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:33.128473 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:33.128531 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:33.128827 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:33.129340 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:33.130053 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:33.130258 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:33.130304 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:33.132793 (+ 2489us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.206.65:42069: BlockingRecv error: recv got EOF from 127.11.206.65:42069 (error 108)
Metrics: {"server-negotiator.queue_time_us":97,"thread_start_us":52,"threads_started":1}
Aug 12 00:02:33 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.66@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:02:33 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.66@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:02:33.273800 28504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:33.269452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:36869 (local address 127.11.206.66:48631)
0812 00:02:33.269629 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:33.269643 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:33.269693 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:33.269816 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:33.269816 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:33.269983 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:33.270031 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:33.270033 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:33.270689 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:33.270689 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:33.271216 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:33.271217 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:33.271502 (+ 285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:33.271502 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:33.271538 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:33.271950 (+ 412us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:33.271955 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:33.273709 (+ 1754us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.206.126:36869: Server oryx/127.11.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":91,"threads_started":1}
W20260812 00:02:33.273855 28501 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:02:33.269609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.66:48631 (local address 127.11.206.126:36869)
0812 00:02:33.269671 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:33.269673 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:33.269696 (+ 23us) server_negotiation.cc:407] Connection header received
0812 00:02:33.269743 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:33.269744 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:33.269770 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:33.269809 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:33.270080 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:33.270629 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:33.271275 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:33.271455 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:33.271499 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:33.273802 (+ 2303us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.206.66:48631: BlockingRecv error: recv got EOF from 127.11.206.66:48631 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Aug 12 00:02:33 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.67@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:02:33 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.67@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:02:33.386674 28506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:33.382320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:36869 (local address 127.11.206.67:45463)
0812 00:02:33.382462 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:33.382475 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:33.382546 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:33.382679 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:33.382680 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:33.382859 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:33.382904 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:33.382907 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:33.383550 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:33.383551 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:33.384082 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:33.384084 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:33.384421 (+ 337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:33.384422 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:33.384478 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:33.384909 (+ 431us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:33.384913 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:33.386593 (+ 1680us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.206.126:36869: Server oryx/127.11.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":61,"threads_started":1}
W20260812 00:02:33.386754 28501 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:02:33.382421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.67:45463 (local address 127.11.206.126:36869)
0812 00:02:33.382487 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:33.382489 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:33.382527 (+ 38us) server_negotiation.cc:407] Connection header received
0812 00:02:33.382604 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:33.382605 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:33.382618 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:33.382664 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:33.382979 (+ 315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:33.383472 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:33.384167 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:33.384356 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:33.384413 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:33.386694 (+ 2281us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.206.67:45463: BlockingRecv error: recv got EOF from 127.11.206.67:45463 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
Aug 12 00:02:34 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.65@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:02:34 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.65@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:02:34.137642 28508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:34.133183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:36869 (local address 127.11.206.65:47593)
0812 00:02:34.133330 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:34.133340 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:34.133409 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:34.133553 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:34.133554 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:34.133728 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:34.133780 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:34.133782 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:34.134390 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:34.134390 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:34.134920 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:34.134922 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:34.135232 (+ 310us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:34.135233 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:34.135283 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:34.135742 (+ 459us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:34.135746 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:34.137563 (+ 1817us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.206.126:36869: Server oryx/127.11.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":74,"threads_started":1}
W20260812 00:02:34.137737 28509 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:02:34.133271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.65:47593 (local address 127.11.206.126:36869)
0812 00:02:34.133418 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:34.133420 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:34.133430 (+ 10us) server_negotiation.cc:407] Connection header received
0812 00:02:34.133474 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:34.133474 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:34.133484 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:34.133540 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:34.133835 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:34.134334 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:34.134980 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:34.135167 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:34.135212 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:34.137665 (+ 2453us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.206.65:47593: BlockingRecv error: recv got EOF from 127.11.206.65:47593 (error 108)
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":59,"threads_started":1}
Aug 12 00:02:34 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.66@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:02:34 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.66@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:02:34.279158 28510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:34.274376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:36869 (local address 127.11.206.66:59973)
0812 00:02:34.274504 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:34.274515 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:34.274573 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:34.274702 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:34.274703 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:34.274886 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:34.274946 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:34.274949 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:34.275600 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:34.275601 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:34.276204 (+ 603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:34.276207 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:34.276630 (+ 423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:34.276631 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:34.276687 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:34.277169 (+ 482us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:34.277173 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:34.279060 (+ 1887us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.206.126:36869: Server oryx/127.11.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":68,"threads_started":1}
W20260812 00:02:34.279230 28509 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:02:34.274502 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.66:59973 (local address 127.11.206.126:36869)
0812 00:02:34.274551 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:34.274553 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:34.274564 (+ 11us) server_negotiation.cc:407] Connection header received
0812 00:02:34.274626 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:34.274627 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:34.274637 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:34.274685 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:34.275005 (+ 320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:34.275515 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:34.276314 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:34.276538 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:34.276599 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:34.279174 (+ 2575us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.206.66:59973: BlockingRecv error: recv got EOF from 127.11.206.66:59973 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
Aug 12 00:02:34 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.67@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:02:34 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.67@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:02:34.391644 28512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:34.387200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:36869 (local address 127.11.206.67:57879)
0812 00:02:34.387327 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:34.387340 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:34.387390 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:34.387506 (+ 116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:34.387507 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:34.387681 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:34.387728 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:34.387730 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:34.388390 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:34.388391 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:34.388928 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:34.388930 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:34.389305 (+ 375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:34.389306 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:34.389361 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:34.389843 (+ 482us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:34.389848 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:34.391565 (+ 1717us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.206.126:36869: Server oryx/127.11.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":76,"threads_started":1}
W20260812 00:02:34.391753 28509 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:02:34.387305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.67:57879 (local address 127.11.206.126:36869)
0812 00:02:34.387386 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:34.387388 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:34.387400 (+ 12us) server_negotiation.cc:407] Connection header received
0812 00:02:34.387426 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:34.387427 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:34.387441 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:34.387502 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:34.387789 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:34.388295 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:34.389011 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:34.389211 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:34.389278 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:34.391658 (+ 2380us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.206.67:57879: BlockingRecv error: recv got EOF from 127.11.206.67:57879 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 12 00:02:35 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.65@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:02:35 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.65@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:02:35.142678 28513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:35.138145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:36869 (local address 127.11.206.65:49103)
0812 00:02:35.138313 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:35.138324 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:35.138381 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:35.138499 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:35.138499 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:35.138663 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:35.138714 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:35.138715 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:35.139342 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:35.139343 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:35.139895 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:35.139897 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:35.140210 (+ 313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:35.140211 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:35.140247 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:35.140724 (+ 477us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:35.140728 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:35.142587 (+ 1859us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.206.126:36869: Server oryx/127.11.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":91,"threads_started":1}
W20260812 00:02:35.142759 28515 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:02:35.138196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.65:49103 (local address 127.11.206.126:36869)
0812 00:02:35.138317 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:35.138319 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:35.138365 (+ 46us) server_negotiation.cc:407] Connection header received
0812 00:02:35.138420 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:35.138421 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:35.138431 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:35.138488 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:35.138765 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:35.139277 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:35.139963 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:35.140161 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:35.140206 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:35.142695 (+ 2489us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.206.65:49103: BlockingRecv error: recv got EOF from 127.11.206.65:49103 (error 108)
Metrics: {"server-negotiator.queue_time_us":97,"thread_start_us":57,"threads_started":1}
Aug 12 00:02:35 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.66@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:02:35 dist-test-slave-f0tn krb5kdc[26591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.206.66@KRBTEST.COM for oryx/127.11.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:02:35.287226 28516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:35.279737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:36869 (local address 127.11.206.66:40075)
0812 00:02:35.279902 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:35.279912 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:35.279977 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:35.280105 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:35.280106 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:35.280275 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:35.280326 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:35.280328 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:35.281056 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:35.281057 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:35.281636 (+ 579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:35.281638 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:35.281994 (+ 356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:35.281994 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:35.282032 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:35.285276 (+ 3244us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:35.285281 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:35.287161 (+ 1880us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.206.126:36869: Server oryx/127.11.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":89,"threads_started":1}
W20260812 00:02:35.287350 28515 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:02:35.279815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.66:40075 (local address 127.11.206.126:36869)
0812 00:02:35.279864 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:35.279866 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:35.279959 (+ 93us) server_negotiation.cc:407] Connection header received
0812 00:02:35.280022 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:35.280022 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:35.280034 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:35.280080 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:35.280417 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:35.280958 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:35.281711 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:35.281932 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:35.281991 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:35.287276 (+ 5285us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.206.66:40075: BlockingRecv error: recv got EOF from 127.11.206.66:40075 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 00:02:35.309502 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 27656
I20260812 00:02:35.339798 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 27932
I20260812 00:02:35.354275 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 28174
I20260812 00:02:35.365742 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 27520
2026-08-12T00:02:35Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (17627 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-12T00:02:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:02:35Z Disabled control of system clock
I20260812 00:02:35.409900 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492899949492-12089-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492899949492-12089-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492899949492-12089-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:35213
--webserver_interface=127.11.206.126
--webserver_port=0
--builtin_ntp_servers=127.11.206.84:46725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.206.126:35213
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260812 00:02:35.490774 28526 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:02:35.490986 28526 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:02:35.491005 28526 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:02:35.492125 28526 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:02:35.492162 28526 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:02:35.492173 28526 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:02:35.492184 28526 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:02:35.492195 28526 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:02:35.493527 28526 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:46725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492899949492-12089-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492899949492-12089-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.206.126:35213
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:35213
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.206.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28526
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492899949492-12089-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:02:35.493782 28526 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:02:35.494064 28526 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:02:35.499073 28533 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:35.499085 28535 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:35.499085 28538 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:35.499320 28526 server_base.cc:1034] running on GCE node
I20260812 00:02:35.499545 28526 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:02:35.499828 28526 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:02:35.500970 28526 hybrid_clock.cc:648] HybridClock initialized: now 1786492955500956 us; error 30 us; skew 500 ppm
I20260812 00:02:35.502282 28526 webserver.cc:460] Webserver started at http://127.11.206.126:34517/ using document root <none> and password file <none>
I20260812 00:02:35.502525 28526 fs_manager.cc:359] Metadata directory not provided
I20260812 00:02:35.502576 28526 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:02:35.502703 28526 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:02:35.503988 28526 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492899949492-12089-0/minicluster-data/master-0/data/instance:
uuid: "2ed4a78cad8b4869916fd266b11b5751"
format_stamp: "Formatted at 2026-08-12 00:02:35 on dist-test-slave-f0tn"
server_key: "1e235cd480b5d645c5739897b7650838"
server_key_iv: "b34497ee7a1e83ce2f26a2960a3d252d"
server_key_version: "encryptionkey@0"
I20260812 00:02:35.504370 28526 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492899949492-12089-0/minicluster-data/master-0/wal/instance:
uuid: "2ed4a78cad8b4869916fd266b11b5751"
format_stamp: "Formatted at 2026-08-12 00:02:35 on dist-test-slave-f0tn"
server_key: "1e235cd480b5d645c5739897b7650838"
server_key_iv: "b34497ee7a1e83ce2f26a2960a3d252d"
server_key_version: "encryptionkey@0"
I20260812 00:02:35.505694 28526 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:02:35.506448 28548 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:35.506605 28526 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:02:35.506691 28526 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492899949492-12089-0/minicluster-data/master-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492899949492-12089-0/minicluster-data/master-0/wal
uuid: "2ed4a78cad8b4869916fd266b11b5751"
format_stamp: "Formatted at 2026-08-12 00:02:35 on dist-test-slave-f0tn"
server_key: "1e235cd480b5d645c5739897b7650838"
server_key_iv: "b34497ee7a1e83ce2f26a2960a3d252d"
server_key_version: "encryptionkey@0"
I20260812 00:02:35.506754 28526 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492899949492-12089-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492899949492-12089-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492899949492-12089-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:02:35.532063 28526 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:02:35.532409 28526 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:02:35.532546 28526 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:02:35.536365 28526 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.126:35213
I20260812 00:02:35.536397 28640 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.126:35213 every 8 connection(s)
I20260812 00:02:35.536731 28526 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
I20260812 00:02:35.537438 28643 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:02:35.540019 28643 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2ed4a78cad8b4869916fd266b11b5751: Bootstrap starting.
I20260812 00:02:35.540611 28643 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2ed4a78cad8b4869916fd266b11b5751: Neither blocks nor log segments found. Creating new log.
I20260812 00:02:35.540877 28643 log.cc:824] T 00000000000000000000000000000000 P 2ed4a78cad8b4869916fd266b11b5751: Log is configured to *not* fsync() on all Append() calls
I20260812 00:02:35.541543 28643 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2ed4a78cad8b4869916fd266b11b5751: No bootstrap required, opened a new log
I20260812 00:02:35.543071 28643 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2ed4a78cad8b4869916fd266b11b5751 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ed4a78cad8b4869916fd266b11b5751" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 35213 } }
I20260812 00:02:35.543210 28643 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2ed4a78cad8b4869916fd266b11b5751 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:02:35.543242 28643 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2ed4a78cad8b4869916fd266b11b5751 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ed4a78cad8b4869916fd266b11b5751, State: Initialized, Role: FOLLOWER
I20260812 00:02:35.543394 28643 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2ed4a78cad8b4869916fd266b11b5751 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ed4a78cad8b4869916fd266b11b5751" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 35213 } }
I20260812 00:02:35.543457 28643 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2ed4a78cad8b4869916fd266b11b5751 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:02:35.543478 28643 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2ed4a78cad8b4869916fd266b11b5751 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:02:35.543524 28643 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2ed4a78cad8b4869916fd266b11b5751 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:02:35.544024 28643 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2ed4a78cad8b4869916fd266b11b5751 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ed4a78cad8b4869916fd266b11b5751" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 35213 } }
I20260812 00:02:35.544116 28643 leader_election.cc:302] T 00000000000000000000000000000000 P 2ed4a78cad8b4869916fd266b11b5751 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2ed4a78cad8b4869916fd266b11b5751; no voters:
I20260812 00:02:35.544291 28643 leader_election.cc:288] T 00000000000000000000000000000000 P 2ed4a78cad8b4869916fd266b11b5751 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:02:35.544358 28649 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2ed4a78cad8b4869916fd266b11b5751 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:02:35.544409 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 28526
I20260812 00:02:35.544493 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492899949492-12089-0/minicluster-data/master-0/wal/instance
I20260812 00:02:35.544534 28649 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2ed4a78cad8b4869916fd266b11b5751 [term 1 LEADER]: Becoming Leader. State: Replica: 2ed4a78cad8b4869916fd266b11b5751, State: Running, Role: LEADER
I20260812 00:02:35.544567 28643 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2ed4a78cad8b4869916fd266b11b5751 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:02:35.544631 28649 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2ed4a78cad8b4869916fd266b11b5751 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ed4a78cad8b4869916fd266b11b5751" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 35213 } }
I20260812 00:02:35.544708 12089 external_mini_cluster.cc:1428] Setting key 340976feaa9ffc6fef59b2bd9d4f2212
I20260812 00:02:35.544924 28649 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ed4a78cad8b4869916fd266b11b5751 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2ed4a78cad8b4869916fd266b11b5751" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ed4a78cad8b4869916fd266b11b5751" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 35213 } } }
I20260812 00:02:35.545076 28649 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ed4a78cad8b4869916fd266b11b5751 [sys.catalog]: This master's current role is: LEADER
I20260812 00:02:35.545274 28649 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ed4a78cad8b4869916fd266b11b5751 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2ed4a78cad8b4869916fd266b11b5751. Latest consensus state: current_term: 1 leader_uuid: "2ed4a78cad8b4869916fd266b11b5751" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ed4a78cad8b4869916fd266b11b5751" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 35213 } } }
I20260812 00:02:35.545410 28649 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ed4a78cad8b4869916fd266b11b5751 [sys.catalog]: This master's current role is: LEADER
I20260812 00:02:35.545666 28674 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:02:35.546211 28674 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:02:35.547667 28674 catalog_manager.cc:1347] Generated new cluster ID: 88ea64cb09534adead5855c60a123529
I20260812 00:02:35.547714 28674 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:02:35.551304 28675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:35.545342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38604 (local address 127.11.206.126:35213)
0812 00:02:35.546033 (+ 691us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:35.546042 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:35.546073 (+ 31us) server_negotiation.cc:407] Connection header received
0812 00:02:35.546197 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:35.546205 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:35.546280 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:35.546426 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:35.546754 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:35.548069 (+ 1315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:35.549161 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:35.549810 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:35.549939 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:35.550583 (+ 644us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:35.550588 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:35.550588 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:02:35.550799 (+ 211us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:35.550844 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:02:35.550861 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:35.550932 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:35.550993 (+ 61us) server_negotiation.cc:299] Negotiation successful
0812 00:02:35.551075 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":617,"thread_start_us":104,"threads_started":1}
I20260812 00:02:35.557590 28674 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:02:35.558085 28674 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:02:35.561705 28674 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2ed4a78cad8b4869916fd266b11b5751: Generated new TSK 0
I20260812 00:02:35.561899 28674 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:02:35.563762 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.65:0
--local_ip_for_outbound_sockets=127.11.206.65
--webserver_interface=127.11.206.65
--webserver_port=0
--tserver_master_addrs=127.11.206.126:35213
--builtin_ntp_servers=127.11.206.84:46725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260812 00:02:35.646064 28693 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:02:35.646287 28693 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:02:35.646308 28693 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:02:35.647488 28693 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:02:35.647534 28693 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:02:35.647559 28693 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.65
I20260812 00:02:35.648972 28693 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:46725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.65:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.206.65
--webserver_port=0
--tserver_master_addrs=127.11.206.126:35213
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28693
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.65
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:02:35.649204 28693 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:02:35.649539 28693 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:02:35.655462 28705 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:35.655556 28704 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:35.655606 28709 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:35.655992 28693 server_base.cc:1034] running on GCE node
I20260812 00:02:35.656193 28693 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:02:35.656421 28693 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:02:35.657567 28693 hybrid_clock.cc:648] HybridClock initialized: now 1786492955657555 us; error 29 us; skew 500 ppm
I20260812 00:02:35.658800 28693 webserver.cc:460] Webserver started at http://127.11.206.65:40149/ using document root <none> and password file <none>
I20260812 00:02:35.659017 28693 fs_manager.cc:359] Metadata directory not provided
I20260812 00:02:35.659067 28693 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:02:35.659194 28693 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:02:35.660245 28693 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-0/data/instance:
uuid: "879b9e4991d246d59b400b8f95bbf2f0"
format_stamp: "Formatted at 2026-08-12 00:02:35 on dist-test-slave-f0tn"
server_key: "4bd47ce27f002e084404ef066aff1ab3"
server_key_iv: "2e39bc7cfc8adbdf1943256be0d4a4db"
server_key_version: "encryptionkey@0"
I20260812 00:02:35.660569 28693 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-0/wal/instance:
uuid: "879b9e4991d246d59b400b8f95bbf2f0"
format_stamp: "Formatted at 2026-08-12 00:02:35 on dist-test-slave-f0tn"
server_key: "4bd47ce27f002e084404ef066aff1ab3"
server_key_iv: "2e39bc7cfc8adbdf1943256be0d4a4db"
server_key_version: "encryptionkey@0"
I20260812 00:02:35.661864 28693 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:02:35.662578 28727 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:35.662760 28693 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:02:35.662870 28693 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-0/wal
uuid: "879b9e4991d246d59b400b8f95bbf2f0"
format_stamp: "Formatted at 2026-08-12 00:02:35 on dist-test-slave-f0tn"
server_key: "4bd47ce27f002e084404ef066aff1ab3"
server_key_iv: "2e39bc7cfc8adbdf1943256be0d4a4db"
server_key_version: "encryptionkey@0"
I20260812 00:02:35.662950 28693 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:02:35.685015 28693 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:02:35.685317 28693 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:02:35.685477 28693 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:02:35.685706 28693 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:02:35.686000 28693 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:02:35.686031 28693 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:35.686056 28693 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:02:35.686072 28693 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:35.691637 28693 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.65:37473
I20260812 00:02:35.691699 28950 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.65:37473 every 8 connection(s)
I20260812 00:02:35.692013 28693 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
I20260812 00:02:35.696970 28675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:35.692766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.65:44535 (local address 127.11.206.126:35213)
0812 00:02:35.692834 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:35.692836 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:35.693107 (+ 271us) server_negotiation.cc:407] Connection header received
0812 00:02:35.693647 (+ 540us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:35.693648 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:35.693660 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:35.693708 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:35.694355 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:35.694859 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:35.695818 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:35.696010 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:35.696063 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:35.696762 (+ 699us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:35.696763 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:35.696763 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:02:35.696767 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:35.696780 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:02:35.696783 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:35.696820 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:35.696880 (+ 60us) server_negotiation.cc:299] Negotiation successful
0812 00:02:35.696910 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260812 00:02:35.697160 28955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:35.692746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:35213 (local address 127.11.206.65:44535)
0812 00:02:35.692965 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:35.693002 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:35.693553 (+ 551us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:35.693776 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:35.693779 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:35.693788 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:35.694274 (+ 486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:35.694279 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:35.694931 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:35.694932 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:35.695740 (+ 808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:35.695743 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:35.696072 (+ 329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:35.696072 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:35.696177 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:35.696643 (+ 466us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:02:35.696643 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:35.696672 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:02:35.696694 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:02:35.696825 (+ 131us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:02:35.696828 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:02:35.696830 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 00:02:35.696875 (+ 45us) client_negotiation.cc:240] Negotiation successful
0812 00:02:35.696955 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":89,"threads_started":1}
I20260812 00:02:35.697650 28952 heartbeater.cc:347] Connected to a master server at 127.11.206.126:35213
I20260812 00:02:35.697741 28952 heartbeater.cc:464] Registering TS with master...
I20260812 00:02:35.697922 28952 heartbeater.cc:511] Master 127.11.206.126:35213 requested a full tablet report, sending...
I20260812 00:02:35.698436 28576 ts_manager.cc:194] Registered new tserver with Master: 879b9e4991d246d59b400b8f95bbf2f0 (127.11.206.65:37473)
I20260812 00:02:35.698977 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 28693
I20260812 00:02:35.699025 28576 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.206.65:44535
I20260812 00:02:35.699054 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-0/wal/instance
I20260812 00:02:35.699218 12089 external_mini_cluster.cc:1428] Setting key 61fe56c8552a04226e2ec52c40d53099
I20260812 00:02:35.700191 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.66:0
--local_ip_for_outbound_sockets=127.11.206.66
--webserver_interface=127.11.206.66
--webserver_port=0
--tserver_master_addrs=127.11.206.126:35213
--builtin_ntp_servers=127.11.206.84:46725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260812 00:02:35.782742 28956 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:02:35.782969 28956 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:02:35.783001 28956 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:02:35.784238 28956 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:02:35.784281 28956 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:02:35.784315 28956 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.66
I20260812 00:02:35.785686 28956 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:46725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.66:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.206.66
--webserver_port=0
--tserver_master_addrs=127.11.206.126:35213
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28956
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.66
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:02:35.785917 28956 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:02:35.786195 28956 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:02:35.790998 28971 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:35.790992 28962 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:35.791177 28956 server_base.cc:1034] running on GCE node
W20260812 00:02:35.790970 28966 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:35.791441 28956 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:02:35.791676 28956 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:02:35.792814 28956 hybrid_clock.cc:648] HybridClock initialized: now 1786492955792799 us; error 33 us; skew 500 ppm
I20260812 00:02:35.794025 28956 webserver.cc:460] Webserver started at http://127.11.206.66:41905/ using document root <none> and password file <none>
I20260812 00:02:35.794251 28956 fs_manager.cc:359] Metadata directory not provided
I20260812 00:02:35.794301 28956 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:02:35.794428 28956 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:02:35.795457 28956 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-1/data/instance:
uuid: "d45cd2b89fa440a7902955553ba08073"
format_stamp: "Formatted at 2026-08-12 00:02:35 on dist-test-slave-f0tn"
server_key: "3f5d4a30c91d769c1f3d85f8f0bee506"
server_key_iv: "88b6dc14afa1cec63879f49c5e7829b1"
server_key_version: "encryptionkey@0"
I20260812 00:02:35.795805 28956 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-1/wal/instance:
uuid: "d45cd2b89fa440a7902955553ba08073"
format_stamp: "Formatted at 2026-08-12 00:02:35 on dist-test-slave-f0tn"
server_key: "3f5d4a30c91d769c1f3d85f8f0bee506"
server_key_iv: "88b6dc14afa1cec63879f49c5e7829b1"
server_key_version: "encryptionkey@0"
I20260812 00:02:35.796988 28956 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:02:35.797637 28981 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:35.797778 28956 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:02:35.797850 28956 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-1/wal
uuid: "d45cd2b89fa440a7902955553ba08073"
format_stamp: "Formatted at 2026-08-12 00:02:35 on dist-test-slave-f0tn"
server_key: "3f5d4a30c91d769c1f3d85f8f0bee506"
server_key_iv: "88b6dc14afa1cec63879f49c5e7829b1"
server_key_version: "encryptionkey@0"
I20260812 00:02:35.797910 28956 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:02:35.814821 28956 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:02:35.815099 28956 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:02:35.815219 28956 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:02:35.815428 28956 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:02:35.815738 28956 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:02:35.815771 28956 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:35.815799 28956 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:02:35.815824 28956 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:35.821237 28956 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.66:45749
I20260812 00:02:35.821300 29191 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.66:45749 every 8 connection(s)
I20260812 00:02:35.821625 28956 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
I20260812 00:02:35.825440 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 28956
I20260812 00:02:35.825541 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-1/wal/instance
I20260812 00:02:35.825730 12089 external_mini_cluster.cc:1428] Setting key 1577601ae3375cb63517afd2da94cf2c
I20260812 00:02:35.826663 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.67:0
--local_ip_for_outbound_sockets=127.11.206.67
--webserver_interface=127.11.206.67
--webserver_port=0
--tserver_master_addrs=127.11.206.126:35213
--builtin_ntp_servers=127.11.206.84:46725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260812 00:02:35.827037 28675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:35.822318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.66:53213 (local address 127.11.206.126:35213)
0812 00:02:35.822370 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:35.822372 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:35.822579 (+ 207us) server_negotiation.cc:407] Connection header received
0812 00:02:35.823110 (+ 531us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:35.823111 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:35.823126 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:35.823181 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:35.823892 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:35.824416 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:35.825506 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:35.825746 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:35.825814 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:35.826708 (+ 894us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:35.826710 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:35.826711 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:02:35.826715 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:35.826748 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:02:35.826754 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:35.826810 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:35.826951 (+ 141us) server_negotiation.cc:299] Negotiation successful
0812 00:02:35.826978 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260812 00:02:35.827260 29199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:35.822301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:35213 (local address 127.11.206.66:53213)
0812 00:02:35.822466 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:35.822500 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:35.823008 (+ 508us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:35.823265 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:35.823269 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:35.823280 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:35.823791 (+ 511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:35.823797 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:35.824505 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:35.824506 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:35.825410 (+ 904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:35.825414 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:35.825841 (+ 427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:35.825842 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:35.826000 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:35.826571 (+ 571us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:02:35.826572 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:35.826603 (+ 31us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:02:35.826626 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:02:35.826840 (+ 214us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:02:35.826847 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:02:35.826850 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:02:35.826920 (+ 70us) client_negotiation.cc:240] Negotiation successful
0812 00:02:35.827032 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":65,"threads_started":1}
I20260812 00:02:35.828399 29192 heartbeater.cc:347] Connected to a master server at 127.11.206.126:35213
I20260812 00:02:35.828509 29192 heartbeater.cc:464] Registering TS with master...
I20260812 00:02:35.828713 29192 heartbeater.cc:511] Master 127.11.206.126:35213 requested a full tablet report, sending...
I20260812 00:02:35.829072 28576 ts_manager.cc:194] Registered new tserver with Master: d45cd2b89fa440a7902955553ba08073 (127.11.206.66:45749)
I20260812 00:02:35.829466 28576 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.206.66:53213
W20260812 00:02:35.909521 29205 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:02:35.909756 29205 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:02:35.909778 29205 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:02:35.910964 29205 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:02:35.911003 29205 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:02:35.911026 29205 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.67
I20260812 00:02:35.912352 29205 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:46725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.67:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.206.67
--webserver_port=0
--tserver_master_addrs=127.11.206.126:35213
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29205
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.67
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:02:35.912598 29205 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:02:35.912889 29205 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:02:35.917848 29219 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:35.917922 29205 server_base.cc:1034] running on GCE node
W20260812 00:02:35.917868 29216 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:35.917846 29221 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:35.918248 29205 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:02:35.918496 29205 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:02:35.919638 29205 hybrid_clock.cc:648] HybridClock initialized: now 1786492955919623 us; error 29 us; skew 500 ppm
I20260812 00:02:35.922509 29205 webserver.cc:460] Webserver started at http://127.11.206.67:40197/ using document root <none> and password file <none>
I20260812 00:02:35.922721 29205 fs_manager.cc:359] Metadata directory not provided
I20260812 00:02:35.922770 29205 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:02:35.922863 29205 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:02:35.923877 29205 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-2/data/instance:
uuid: "c8de3ee358114c34aa4bf34039c54535"
format_stamp: "Formatted at 2026-08-12 00:02:35 on dist-test-slave-f0tn"
server_key: "78a902e5c62a0c3e0f1c3e15ec6d1a73"
server_key_iv: "f39684266c0fe538251a64e726b9297a"
server_key_version: "encryptionkey@0"
I20260812 00:02:35.924172 29205 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-2/wal/instance:
uuid: "c8de3ee358114c34aa4bf34039c54535"
format_stamp: "Formatted at 2026-08-12 00:02:35 on dist-test-slave-f0tn"
server_key: "78a902e5c62a0c3e0f1c3e15ec6d1a73"
server_key_iv: "f39684266c0fe538251a64e726b9297a"
server_key_version: "encryptionkey@0"
I20260812 00:02:35.925328 29205 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260812 00:02:35.926018 29233 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:35.926173 29205 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:02:35.926256 29205 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-2/wal
uuid: "c8de3ee358114c34aa4bf34039c54535"
format_stamp: "Formatted at 2026-08-12 00:02:35 on dist-test-slave-f0tn"
server_key: "78a902e5c62a0c3e0f1c3e15ec6d1a73"
server_key_iv: "f39684266c0fe538251a64e726b9297a"
server_key_version: "encryptionkey@0"
I20260812 00:02:35.926317 29205 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:02:35.955796 29205 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:02:35.956128 29205 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:02:35.956274 29205 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:02:35.956507 29205 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:02:35.956845 29205 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:02:35.956881 29205 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:35.956911 29205 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:02:35.956934 29205 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:35.962287 29205 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.67:40287
I20260812 00:02:35.962330 29424 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.67:40287 every 8 connection(s)
I20260812 00:02:35.962658 29205 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
I20260812 00:02:35.962877 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 29205
I20260812 00:02:35.962966 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-2/wal/instance
I20260812 00:02:35.963174 12089 external_mini_cluster.cc:1428] Setting key 528328cfec0026142536143fc6473059
I20260812 00:02:35.968036 28675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:35.963466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.67:48473 (local address 127.11.206.126:35213)
0812 00:02:35.963530 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:35.963533 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:35.963774 (+ 241us) server_negotiation.cc:407] Connection header received
0812 00:02:35.964293 (+ 519us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:35.964294 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:35.964307 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:35.964358 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:35.965069 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:35.965642 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:35.966667 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:35.966867 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:35.966924 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:35.967767 (+ 843us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:35.967768 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:35.967768 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:02:35.967773 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:35.967791 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:02:35.967795 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:35.967840 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:35.967919 (+ 79us) server_negotiation.cc:299] Negotiation successful
0812 00:02:35.967954 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260812 00:02:35.968243 29427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:35.963459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:35213 (local address 127.11.206.67:48473)
0812 00:02:35.963646 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:35.963687 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:35.964189 (+ 502us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:35.964435 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:35.964439 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:35.964460 (+ 21us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:35.964973 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:35.964978 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:35.965733 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:35.965734 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:35.966588 (+ 854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:35.966591 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:35.966936 (+ 345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:35.966937 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:35.967086 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:35.967628 (+ 542us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:02:35.967628 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:35.967659 (+ 31us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:02:35.967684 (+ 25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:02:35.967846 (+ 162us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:02:35.967851 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:02:35.967855 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:02:35.967918 (+ 63us) client_negotiation.cc:240] Negotiation successful
0812 00:02:35.968026 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":88,"threads_started":1}
I20260812 00:02:35.968670 29425 heartbeater.cc:347] Connected to a master server at 127.11.206.126:35213
I20260812 00:02:35.968789 29425 heartbeater.cc:464] Registering TS with master...
I20260812 00:02:35.968974 29425 heartbeater.cc:511] Master 127.11.206.126:35213 requested a full tablet report, sending...
I20260812 00:02:35.969349 28576 ts_manager.cc:194] Registered new tserver with Master: c8de3ee358114c34aa4bf34039c54535 (127.11.206.67:40287)
I20260812 00:02:35.969724 28576 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.206.67:48473
I20260812 00:02:35.974792 12089 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260812 00:02:35.976565 28675 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:02:35.976054 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38610 (local address 127.11.206.126:35213)
0812 00:02:35.976127 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:35.976129 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:35.976241 (+ 112us) server_negotiation.cc:407] Connection header received
0812 00:02:35.976304 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:35.976305 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:35.976317 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:35.976359 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:35.976497 (+ 138us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38610: BlockingRecv error: recv got EOF from 127.0.0.1:38610 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
I20260812 00:02:35.976614 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 28693
I20260812 00:02:35.998317 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 28956
I20260812 00:02:36.014101 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 29205
I20260812 00:02:36.030128 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 28526
2026-08-12T00:02:36Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (657 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-12T00:02:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:02:36Z Disabled control of system clock
I20260812 00:02:36.066532 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492899949492-12089-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492899949492-12089-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492899949492-12089-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:38089
--webserver_interface=127.11.206.126
--webserver_port=0
--builtin_ntp_servers=127.11.206.84:44267
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.206.126:38089
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260812 00:02:36.147420 29446 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:02:36.147637 29446 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:02:36.147656 29446 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:02:36.148769 29446 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:02:36.148808 29446 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:02:36.148819 29446 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:02:36.148830 29446 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:02:36.148841 29446 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:02:36.150277 29446 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:44267
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492899949492-12089-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492899949492-12089-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.206.126:38089
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:38089
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.206.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29446
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492899949492-12089-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:02:36.150499 29446 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:02:36.150770 29446 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:02:36.155640 29459 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:36.155658 29446 server_base.cc:1034] running on GCE node
W20260812 00:02:36.155599 29462 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:36.155618 29465 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:36.156204 29446 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:02:36.156476 29446 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:02:36.157611 29446 hybrid_clock.cc:648] HybridClock initialized: now 1786492956157597 us; error 28 us; skew 500 ppm
I20260812 00:02:36.158869 29446 webserver.cc:460] Webserver started at http://127.11.206.126:43801/ using document root <none> and password file <none>
I20260812 00:02:36.159099 29446 fs_manager.cc:359] Metadata directory not provided
I20260812 00:02:36.159148 29446 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:02:36.159307 29446 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:02:36.160382 29446 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492899949492-12089-0/minicluster-data/master-0/data/instance:
uuid: "778e97734e704ad5ab97b3955d4d57a5"
format_stamp: "Formatted at 2026-08-12 00:02:36 on dist-test-slave-f0tn"
server_key: "4d98198c43524d556868f8d5812952ca"
server_key_iv: "b1a2b82279790e3b6ba037d6a3c46701"
server_key_version: "encryptionkey@0"
I20260812 00:02:36.160717 29446 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492899949492-12089-0/minicluster-data/master-0/wal/instance:
uuid: "778e97734e704ad5ab97b3955d4d57a5"
format_stamp: "Formatted at 2026-08-12 00:02:36 on dist-test-slave-f0tn"
server_key: "4d98198c43524d556868f8d5812952ca"
server_key_iv: "b1a2b82279790e3b6ba037d6a3c46701"
server_key_version: "encryptionkey@0"
I20260812 00:02:36.162088 29446 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 00:02:36.162812 29473 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:36.162976 29446 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 00:02:36.163066 29446 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492899949492-12089-0/minicluster-data/master-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492899949492-12089-0/minicluster-data/master-0/wal
uuid: "778e97734e704ad5ab97b3955d4d57a5"
format_stamp: "Formatted at 2026-08-12 00:02:36 on dist-test-slave-f0tn"
server_key: "4d98198c43524d556868f8d5812952ca"
server_key_iv: "b1a2b82279790e3b6ba037d6a3c46701"
server_key_version: "encryptionkey@0"
I20260812 00:02:36.163129 29446 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492899949492-12089-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492899949492-12089-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492899949492-12089-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:02:36.166440 29446 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:02:36.166677 29446 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:02:36.166795 29446 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:02:36.170368 29446 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.126:38089
I20260812 00:02:36.170404 29560 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.126:38089 every 8 connection(s)
I20260812 00:02:36.170703 29446 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
I20260812 00:02:36.171334 29563 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:02:36.174041 29563 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 778e97734e704ad5ab97b3955d4d57a5: Bootstrap starting.
I20260812 00:02:36.174559 29563 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 778e97734e704ad5ab97b3955d4d57a5: Neither blocks nor log segments found. Creating new log.
I20260812 00:02:36.174800 29563 log.cc:824] T 00000000000000000000000000000000 P 778e97734e704ad5ab97b3955d4d57a5: Log is configured to *not* fsync() on all Append() calls
I20260812 00:02:36.175392 29563 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 778e97734e704ad5ab97b3955d4d57a5: No bootstrap required, opened a new log
I20260812 00:02:36.176888 29563 raft_consensus.cc:348] T 00000000000000000000000000000000 P 778e97734e704ad5ab97b3955d4d57a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "778e97734e704ad5ab97b3955d4d57a5" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 38089 } }
I20260812 00:02:36.177022 29563 raft_consensus.cc:374] T 00000000000000000000000000000000 P 778e97734e704ad5ab97b3955d4d57a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:02:36.177043 29563 raft_consensus.cc:729] T 00000000000000000000000000000000 P 778e97734e704ad5ab97b3955d4d57a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 778e97734e704ad5ab97b3955d4d57a5, State: Initialized, Role: FOLLOWER
I20260812 00:02:36.177145 29563 consensus_queue.cc:260] T 00000000000000000000000000000000 P 778e97734e704ad5ab97b3955d4d57a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "778e97734e704ad5ab97b3955d4d57a5" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 38089 } }
I20260812 00:02:36.177193 29563 raft_consensus.cc:388] T 00000000000000000000000000000000 P 778e97734e704ad5ab97b3955d4d57a5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:02:36.177215 29563 raft_consensus.cc:482] T 00000000000000000000000000000000 P 778e97734e704ad5ab97b3955d4d57a5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:02:36.177244 29563 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 778e97734e704ad5ab97b3955d4d57a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:02:36.177771 29563 raft_consensus.cc:504] T 00000000000000000000000000000000 P 778e97734e704ad5ab97b3955d4d57a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "778e97734e704ad5ab97b3955d4d57a5" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 38089 } }
I20260812 00:02:36.177860 29563 leader_election.cc:302] T 00000000000000000000000000000000 P 778e97734e704ad5ab97b3955d4d57a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 778e97734e704ad5ab97b3955d4d57a5; no voters:
I20260812 00:02:36.177991 29563 leader_election.cc:288] T 00000000000000000000000000000000 P 778e97734e704ad5ab97b3955d4d57a5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:02:36.178047 29570 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 778e97734e704ad5ab97b3955d4d57a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:02:36.178221 29563 sys_catalog.cc:564] T 00000000000000000000000000000000 P 778e97734e704ad5ab97b3955d4d57a5 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:02:36.178207 29570 raft_consensus.cc:686] T 00000000000000000000000000000000 P 778e97734e704ad5ab97b3955d4d57a5 [term 1 LEADER]: Becoming Leader. State: Replica: 778e97734e704ad5ab97b3955d4d57a5, State: Running, Role: LEADER
I20260812 00:02:36.178354 29570 consensus_queue.cc:237] T 00000000000000000000000000000000 P 778e97734e704ad5ab97b3955d4d57a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "778e97734e704ad5ab97b3955d4d57a5" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 38089 } }
I20260812 00:02:36.178762 29571 sys_catalog.cc:455] T 00000000000000000000000000000000 P 778e97734e704ad5ab97b3955d4d57a5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "778e97734e704ad5ab97b3955d4d57a5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "778e97734e704ad5ab97b3955d4d57a5" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 38089 } } }
I20260812 00:02:36.178912 29571 sys_catalog.cc:458] T 00000000000000000000000000000000 P 778e97734e704ad5ab97b3955d4d57a5 [sys.catalog]: This master's current role is: LEADER
I20260812 00:02:36.178946 29572 sys_catalog.cc:455] T 00000000000000000000000000000000 P 778e97734e704ad5ab97b3955d4d57a5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 778e97734e704ad5ab97b3955d4d57a5. Latest consensus state: current_term: 1 leader_uuid: "778e97734e704ad5ab97b3955d4d57a5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "778e97734e704ad5ab97b3955d4d57a5" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 38089 } } }
I20260812 00:02:36.179070 29572 sys_catalog.cc:458] T 00000000000000000000000000000000 P 778e97734e704ad5ab97b3955d4d57a5 [sys.catalog]: This master's current role is: LEADER
I20260812 00:02:36.179488 29591 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:02:36.179987 29591 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:02:36.180716 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 29446
I20260812 00:02:36.180807 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492899949492-12089-0/minicluster-data/master-0/wal/instance
I20260812 00:02:36.180974 12089 external_mini_cluster.cc:1428] Setting key 67b233a66978677f4242d2ffab0378e0
I20260812 00:02:36.181768 29591 catalog_manager.cc:1347] Generated new cluster ID: 9e4848bdc1704ab28fe4f1f77e246af3
I20260812 00:02:36.181828 29591 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:02:36.187578 29591 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:02:36.187773 29591 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:02:36.188691 29608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:36.181622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44412 (local address 127.11.206.126:38089)
0812 00:02:36.187160 (+ 5538us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:36.187167 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:36.187193 (+ 26us) server_negotiation.cc:407] Connection header received
0812 00:02:36.187312 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:36.187320 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:36.187367 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:36.187528 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:36.188251 (+ 723us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:36.188263 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:36.188263 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:02:36.188267 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:36.188315 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:02:36.188328 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:36.188379 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:36.188459 (+ 80us) server_negotiation.cc:299] Negotiation successful
0812 00:02:36.188514 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5479,"thread_start_us":74,"threads_started":1}
I20260812 00:02:36.192102 29591 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 778e97734e704ad5ab97b3955d4d57a5: Generated new TSK 0
I20260812 00:02:36.192265 29591 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:02:36.197211 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.65:0
--local_ip_for_outbound_sockets=127.11.206.65
--webserver_interface=127.11.206.65
--webserver_port=0
--tserver_master_addrs=127.11.206.126:38089
--builtin_ntp_servers=127.11.206.84:44267
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260812 00:02:36.299652 29609 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:02:36.299870 29609 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:02:36.299893 29609 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:02:36.301074 29609 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:02:36.301113 29609 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:02:36.301138 29609 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.65
I20260812 00:02:36.302521 29609 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:44267
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.206.65
--webserver_port=0
--tserver_master_addrs=127.11.206.126:38089
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29609
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.65
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:02:36.302764 29609 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:02:36.303062 29609 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:02:36.307987 29626 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:36.308001 29618 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:36.307987 29621 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:36.308456 29609 server_base.cc:1034] running on GCE node
I20260812 00:02:36.308681 29609 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:02:36.308956 29609 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:02:36.310130 29609 hybrid_clock.cc:648] HybridClock initialized: now 1786492956310114 us; error 38 us; skew 500 ppm
I20260812 00:02:36.311625 29609 webserver.cc:460] Webserver started at http://127.11.206.65:42809/ using document root <none> and password file <none>
I20260812 00:02:36.311926 29609 fs_manager.cc:359] Metadata directory not provided
I20260812 00:02:36.312000 29609 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:02:36.312143 29609 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:02:36.313578 29609 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-0/data/instance:
uuid: "df8748b2032942eebd705d9c55442343"
format_stamp: "Formatted at 2026-08-12 00:02:36 on dist-test-slave-f0tn"
server_key: "bb022be6744f52ccd70f4e13151428de"
server_key_iv: "2236c3d5f4b818542e1b12bc5f1d3476"
server_key_version: "encryptionkey@0"
I20260812 00:02:36.314014 29609 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-0/wal/instance:
uuid: "df8748b2032942eebd705d9c55442343"
format_stamp: "Formatted at 2026-08-12 00:02:36 on dist-test-slave-f0tn"
server_key: "bb022be6744f52ccd70f4e13151428de"
server_key_iv: "2236c3d5f4b818542e1b12bc5f1d3476"
server_key_version: "encryptionkey@0"
I20260812 00:02:36.315657 29609 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260812 00:02:36.316449 29640 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:36.316605 29609 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:02:36.316691 29609 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-0/wal
uuid: "df8748b2032942eebd705d9c55442343"
format_stamp: "Formatted at 2026-08-12 00:02:36 on dist-test-slave-f0tn"
server_key: "bb022be6744f52ccd70f4e13151428de"
server_key_iv: "2236c3d5f4b818542e1b12bc5f1d3476"
server_key_version: "encryptionkey@0"
I20260812 00:02:36.316757 29609 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:02:36.321331 29609 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:02:36.321671 29609 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:02:36.321817 29609 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:02:36.322036 29609 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:02:36.322379 29609 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:02:36.322420 29609 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:36.322455 29609 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:02:36.322476 29609 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:36.329660 29609 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.65:45781
I20260812 00:02:36.329697 29856 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.65:45781 every 8 connection(s)
I20260812 00:02:36.330068 29609 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
I20260812 00:02:36.333050 29608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:36.330809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.65:45123 (local address 127.11.206.126:38089)
0812 00:02:36.330858 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:36.330860 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:36.331100 (+ 240us) server_negotiation.cc:407] Connection header received
0812 00:02:36.331595 (+ 495us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:36.331597 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:36.331605 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:36.331659 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:36.332798 (+ 1139us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:36.332800 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:36.332800 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:02:36.332804 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:36.332821 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:02:36.332826 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:36.332874 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:36.332950 (+ 76us) server_negotiation.cc:299] Negotiation successful
0812 00:02:36.332967 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 00:02:36.333171 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 29609
I20260812 00:02:36.333264 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-0/wal/instance
I20260812 00:02:36.333489 12089 external_mini_cluster.cc:1428] Setting key 912801cc5e6578e6fd2564393f3e02f4
I20260812 00:02:36.333894 29862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:36.330809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:38089 (local address 127.11.206.65:45123)
0812 00:02:36.330975 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:36.331009 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:36.331499 (+ 490us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:36.331728 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:36.331731 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:36.331740 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:36.332629 (+ 889us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:02:36.332629 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:36.332660 (+ 31us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:02:36.332690 (+ 30us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:02:36.332880 (+ 190us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:02:36.332886 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:02:36.332889 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:02:36.332958 (+ 69us) client_negotiation.cc:240] Negotiation successful
0812 00:02:36.333686 (+ 728us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":78,"threads_started":1}
I20260812 00:02:36.334350 29857 heartbeater.cc:347] Connected to a master server at 127.11.206.126:38089
I20260812 00:02:36.334456 29857 heartbeater.cc:464] Registering TS with master...
I20260812 00:02:36.334609 29857 heartbeater.cc:511] Master 127.11.206.126:38089 requested a full tablet report, sending...
I20260812 00:02:36.334607 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.66:0
--local_ip_for_outbound_sockets=127.11.206.66
--webserver_interface=127.11.206.66
--webserver_port=0
--tserver_master_addrs=127.11.206.126:38089
--builtin_ntp_servers=127.11.206.84:44267
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260812 00:02:36.335101 29501 ts_manager.cc:194] Registered new tserver with Master: df8748b2032942eebd705d9c55442343 (127.11.206.65:45781)
W20260812 00:02:36.416482 29868 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:02:36.416698 29868 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:02:36.416728 29868 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:02:36.417924 29868 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:02:36.417964 29868 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:02:36.417999 29868 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.66
I20260812 00:02:36.419332 29868 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:44267
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.206.66
--webserver_port=0
--tserver_master_addrs=127.11.206.126:38089
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29868
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.66
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:02:36.419574 29868 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:02:36.419871 29868 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:02:36.424979 29879 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:36.425118 29883 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:36.425158 29876 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:36.425204 29868 server_base.cc:1034] running on GCE node
I20260812 00:02:36.425499 29868 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:02:36.425760 29868 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:02:36.426927 29868 hybrid_clock.cc:648] HybridClock initialized: now 1786492956426910 us; error 29 us; skew 500 ppm
I20260812 00:02:36.428227 29868 webserver.cc:460] Webserver started at http://127.11.206.66:38567/ using document root <none> and password file <none>
I20260812 00:02:36.428457 29868 fs_manager.cc:359] Metadata directory not provided
I20260812 00:02:36.428507 29868 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:02:36.428642 29868 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:02:36.429782 29868 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-1/data/instance:
uuid: "5b22d0792ac341249e40926820be5f07"
format_stamp: "Formatted at 2026-08-12 00:02:36 on dist-test-slave-f0tn"
server_key: "0d2798d161d9f173474576a92e691b7c"
server_key_iv: "be36f96562a995e7031b987d5928b0b8"
server_key_version: "encryptionkey@0"
I20260812 00:02:36.430130 29868 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-1/wal/instance:
uuid: "5b22d0792ac341249e40926820be5f07"
format_stamp: "Formatted at 2026-08-12 00:02:36 on dist-test-slave-f0tn"
server_key: "0d2798d161d9f173474576a92e691b7c"
server_key_iv: "be36f96562a995e7031b987d5928b0b8"
server_key_version: "encryptionkey@0"
I20260812 00:02:36.431396 29868 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260812 00:02:36.432111 29899 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:36.432312 29868 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 00:02:36.432415 29868 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-1/wal
uuid: "5b22d0792ac341249e40926820be5f07"
format_stamp: "Formatted at 2026-08-12 00:02:36 on dist-test-slave-f0tn"
server_key: "0d2798d161d9f173474576a92e691b7c"
server_key_iv: "be36f96562a995e7031b987d5928b0b8"
server_key_version: "encryptionkey@0"
I20260812 00:02:36.432490 29868 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:02:36.436442 29868 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:02:36.436806 29868 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:02:36.436983 29868 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:02:36.437237 29868 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:02:36.437726 29868 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:02:36.437770 29868 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:36.437866 29868 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:02:36.437914 29868 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:36.444381 29868 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.66:38371
I20260812 00:02:36.444424 30123 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.66:38371 every 8 connection(s)
I20260812 00:02:36.444795 29868 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
I20260812 00:02:36.447948 29608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:36.445542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.66:40643 (local address 127.11.206.126:38089)
0812 00:02:36.445591 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:36.445593 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:36.445827 (+ 234us) server_negotiation.cc:407] Connection header received
0812 00:02:36.446354 (+ 527us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:36.446355 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:36.446363 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:36.446430 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:36.447678 (+ 1248us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:36.447679 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:36.447680 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:02:36.447685 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:36.447705 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:02:36.447710 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:36.447768 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:36.447850 (+ 82us) server_negotiation.cc:299] Negotiation successful
0812 00:02:36.447867 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 00:02:36.448146 30129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:36.445529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:38089 (local address 127.11.206.66:40643)
0812 00:02:36.445698 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:36.445733 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:36.446238 (+ 505us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:36.446510 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:36.446513 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:36.446529 (+ 16us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:36.447493 (+ 964us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:02:36.447493 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:36.447534 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:02:36.447567 (+ 33us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:02:36.447768 (+ 201us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:02:36.447774 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:02:36.447777 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:02:36.447857 (+ 80us) client_negotiation.cc:240] Negotiation successful
0812 00:02:36.447924 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":73,"threads_started":1}
I20260812 00:02:36.448642 30125 heartbeater.cc:347] Connected to a master server at 127.11.206.126:38089
I20260812 00:02:36.448729 30125 heartbeater.cc:464] Registering TS with master...
I20260812 00:02:36.448865 30125 heartbeater.cc:511] Master 127.11.206.126:38089 requested a full tablet report, sending...
I20260812 00:02:36.449201 29501 ts_manager.cc:194] Registered new tserver with Master: 5b22d0792ac341249e40926820be5f07 (127.11.206.66:38371)
I20260812 00:02:36.449820 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 29868
I20260812 00:02:36.449896 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-1/wal/instance
I20260812 00:02:36.450078 12089 external_mini_cluster.cc:1428] Setting key 270db2fb4bf3db596d6f5c8304433156
I20260812 00:02:36.450914 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.67:0
--local_ip_for_outbound_sockets=127.11.206.67
--webserver_interface=127.11.206.67
--webserver_port=0
--tserver_master_addrs=127.11.206.126:38089
--builtin_ntp_servers=127.11.206.84:44267
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260812 00:02:36.536202 30130 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:02:36.536424 30130 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:02:36.536448 30130 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:02:36.537724 30130 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:02:36.537781 30130 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:02:36.537810 30130 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.67
I20260812 00:02:36.539219 30130 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:44267
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.206.67
--webserver_port=0
--tserver_master_addrs=127.11.206.126:38089
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30130
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.67
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:02:36.539477 30130 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:02:36.539790 30130 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:02:36.544966 30142 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:36.544960 30141 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:36.545048 30130 server_base.cc:1034] running on GCE node
W20260812 00:02:36.544975 30150 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:36.545464 30130 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:02:36.545702 30130 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:02:36.546834 30130 hybrid_clock.cc:648] HybridClock initialized: now 1786492956546825 us; error 27 us; skew 500 ppm
I20260812 00:02:36.548063 30130 webserver.cc:460] Webserver started at http://127.11.206.67:37733/ using document root <none> and password file <none>
I20260812 00:02:36.548333 30130 fs_manager.cc:359] Metadata directory not provided
I20260812 00:02:36.548380 30130 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:02:36.548566 30130 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:02:36.549717 30130 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-2/data/instance:
uuid: "be278602582b4b1bb89c55d21931321b"
format_stamp: "Formatted at 2026-08-12 00:02:36 on dist-test-slave-f0tn"
server_key: "e2bede59339be57a2582f1767aa7c7e9"
server_key_iv: "4bc4575e62fddfe47346d13d079415dd"
server_key_version: "encryptionkey@0"
I20260812 00:02:36.550061 30130 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-2/wal/instance:
uuid: "be278602582b4b1bb89c55d21931321b"
format_stamp: "Formatted at 2026-08-12 00:02:36 on dist-test-slave-f0tn"
server_key: "e2bede59339be57a2582f1767aa7c7e9"
server_key_iv: "4bc4575e62fddfe47346d13d079415dd"
server_key_version: "encryptionkey@0"
I20260812 00:02:36.551326 30130 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 00:02:36.552069 30161 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:36.552248 30130 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:02:36.552335 30130 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-2/wal
uuid: "be278602582b4b1bb89c55d21931321b"
format_stamp: "Formatted at 2026-08-12 00:02:36 on dist-test-slave-f0tn"
server_key: "e2bede59339be57a2582f1767aa7c7e9"
server_key_iv: "4bc4575e62fddfe47346d13d079415dd"
server_key_version: "encryptionkey@0"
I20260812 00:02:36.552397 30130 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:02:36.555758 30130 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:02:36.555999 30130 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:02:36.556120 30130 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:02:36.556308 30130 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:02:36.556625 30130 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:02:36.556668 30130 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:36.556696 30130 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:02:36.556720 30130 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:36.562459 30130 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.67:34903
I20260812 00:02:36.562501 30348 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.67:34903 every 8 connection(s)
I20260812 00:02:36.562837 30130 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
I20260812 00:02:36.565840 29608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:36.563551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.67:39335 (local address 127.11.206.126:38089)
0812 00:02:36.563612 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:36.563615 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:36.563843 (+ 228us) server_negotiation.cc:407] Connection header received
0812 00:02:36.564381 (+ 538us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:36.564383 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:36.564389 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:36.564458 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:36.565642 (+ 1184us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:36.565643 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:36.565643 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:02:36.565648 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:36.565663 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:02:36.565667 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:36.565720 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:36.565772 (+ 52us) server_negotiation.cc:299] Negotiation successful
0812 00:02:36.565784 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260812 00:02:36.566021 30355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:36.563540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:38089 (local address 127.11.206.67:39335)
0812 00:02:36.563721 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:36.563760 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:36.564254 (+ 494us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:36.564522 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:36.564525 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:36.564534 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:36.565484 (+ 950us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:02:36.565484 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:36.565517 (+ 33us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:02:36.565546 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:02:36.565717 (+ 171us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:02:36.565721 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:02:36.565724 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:02:36.565780 (+ 56us) client_negotiation.cc:240] Negotiation successful
0812 00:02:36.565833 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":87,"threads_started":1}
I20260812 00:02:36.566123 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 30130
I20260812 00:02:36.566215 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786492899949492-12089-0/minicluster-data/ts-2/wal/instance
I20260812 00:02:36.566443 12089 external_mini_cluster.cc:1428] Setting key c894f47319b1cf500fa8db5c508dedc3
I20260812 00:02:36.566573 30350 heartbeater.cc:347] Connected to a master server at 127.11.206.126:38089
I20260812 00:02:36.566668 30350 heartbeater.cc:464] Registering TS with master...
I20260812 00:02:36.566826 30350 heartbeater.cc:511] Master 127.11.206.126:38089 requested a full tablet report, sending...
I20260812 00:02:36.567221 29500 ts_manager.cc:194] Registered new tserver with Master: be278602582b4b1bb89c55d21931321b (127.11.206.67:34903)
I20260812 00:02:36.578320 12089 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260812 00:02:36.580221 29608 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:02:36.579738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44420 (local address 127.11.206.126:38089)
0812 00:02:36.579797 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:36.579800 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:36.579889 (+ 89us) server_negotiation.cc:407] Connection header received
0812 00:02:36.579947 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:36.579948 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:36.579953 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:36.580002 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:36.580144 (+ 142us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44420: BlockingRecv error: recv got EOF from 127.0.0.1:44420 (error 108)
Metrics: {"server-negotiator.queue_time_us":31}
I20260812 00:02:36.580466 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 29609
I20260812 00:02:36.612686 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 29868
I20260812 00:02:36.631930 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 30130
I20260812 00:02:36.647145 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 29446
2026-08-12T00:02:36Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (626 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:02:36 dist-test-slave-f0tn krb5kdc[30366](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:02:36 dist-test-slave-f0tn krb5kdc[30366](info): set up 2 sockets
Aug 12 00:02:36 dist-test-slave-f0tn krb5kdc[30366](info): commencing operation
krb5kdc: starting...
W20260812 00:02:37.840108 12089 mini_kdc.cc:121] Time spent starting KDC: real 1.154s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/krb5kdc/test-user.keytab.
Aug 12 00:02:37 dist-test-slave-f0tn krb5kdc[30366](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492957, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:02:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:02:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.206.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab.
Entry for principal kudu/127.11.206.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab.
I20260812 00:02:37.953457 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:45761
--webserver_interface=127.11.206.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab
--principal=kudu/127.11.206.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:46721
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.206.126:45761
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:02:38.034770 30391 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:02:38.034977 30391 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:02:38.034998 30391 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:02:38.036070 30391 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:02:38.036103 30391 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:02:38.036114 30391 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:02:38.036125 30391 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:02:38.036140 30391 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:02:38.037616 30391 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:46721
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.206.126:45761
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab
--principal=kudu/127.11.206.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:45761
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.206.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30391
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:02:38.037825 30391 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:02:38.037995 30391 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:02:38.042691 30399 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:38.042691 30403 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:38.042699 30400 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:38.042869 30391 server_base.cc:1034] running on GCE node
I20260812 00:02:38.043202 30391 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:02:38.043483 30391 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:02:38.044633 30391 hybrid_clock.cc:648] HybridClock initialized: now 1786492958044618 us; error 32 us; skew 500 ppm
Aug 12 00:02:38 dist-test-slave-f0tn krb5kdc[30366](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492958, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:02:38.047080 30391 init.cc:377] Logged in from keytab as kudu/127.11.206.126@KRBTEST.COM (short username kudu)
I20260812 00:02:38.047462 30391 webserver.cc:460] Webserver started at http://127.11.206.126:44697/ using document root <none> and password file <none>
I20260812 00:02:38.047654 30391 fs_manager.cc:359] Metadata directory not provided
I20260812 00:02:38.047699 30391 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:02:38.047819 30391 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:02:38.048844 30391 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/minicluster-data/master-0/data/instance:
uuid: "2416e0cc1a1f4c73a2edabf65b2c9b61"
format_stamp: "Formatted at 2026-08-12 00:02:38 on dist-test-slave-f0tn"
server_key: "d54ae3a2f195e05990541df570f2077d"
server_key_iv: "7a4f2a32c04178076f8224103444af4a"
server_key_version: "encryptionkey@0"
I20260812 00:02:38.049144 30391 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/minicluster-data/master-0/wal/instance:
uuid: "2416e0cc1a1f4c73a2edabf65b2c9b61"
format_stamp: "Formatted at 2026-08-12 00:02:38 on dist-test-slave-f0tn"
server_key: "d54ae3a2f195e05990541df570f2077d"
server_key_iv: "7a4f2a32c04178076f8224103444af4a"
server_key_version: "encryptionkey@0"
I20260812 00:02:38.050384 30391 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:02:38.051023 30417 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:38.051153 30391 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:02:38.051244 30391 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/minicluster-data/master-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/minicluster-data/master-0/wal
uuid: "2416e0cc1a1f4c73a2edabf65b2c9b61"
format_stamp: "Formatted at 2026-08-12 00:02:38 on dist-test-slave-f0tn"
server_key: "d54ae3a2f195e05990541df570f2077d"
server_key_iv: "7a4f2a32c04178076f8224103444af4a"
server_key_version: "encryptionkey@0"
I20260812 00:02:38.051311 30391 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:02:38.074591 30391 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:02:38.076484 30391 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:02:38.076611 30391 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:02:38.080461 30391 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.126:45761
I20260812 00:02:38.080508 30519 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.126:45761 every 8 connection(s)
I20260812 00:02:38.080829 30391 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
I20260812 00:02:38.081878 30526 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:02:38.084147 30526 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2416e0cc1a1f4c73a2edabf65b2c9b61: Bootstrap starting.
I20260812 00:02:38.084728 30526 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2416e0cc1a1f4c73a2edabf65b2c9b61: Neither blocks nor log segments found. Creating new log.
I20260812 00:02:38.084990 30526 log.cc:824] T 00000000000000000000000000000000 P 2416e0cc1a1f4c73a2edabf65b2c9b61: Log is configured to *not* fsync() on all Append() calls
I20260812 00:02:38.085677 30526 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2416e0cc1a1f4c73a2edabf65b2c9b61: No bootstrap required, opened a new log
I20260812 00:02:38.087241 30526 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2416e0cc1a1f4c73a2edabf65b2c9b61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2416e0cc1a1f4c73a2edabf65b2c9b61" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 45761 } }
I20260812 00:02:38.087384 30526 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2416e0cc1a1f4c73a2edabf65b2c9b61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:02:38.087407 30526 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2416e0cc1a1f4c73a2edabf65b2c9b61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2416e0cc1a1f4c73a2edabf65b2c9b61, State: Initialized, Role: FOLLOWER
I20260812 00:02:38.087553 30526 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2416e0cc1a1f4c73a2edabf65b2c9b61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2416e0cc1a1f4c73a2edabf65b2c9b61" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 45761 } }
I20260812 00:02:38.087617 30526 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2416e0cc1a1f4c73a2edabf65b2c9b61 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:02:38.087641 30526 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2416e0cc1a1f4c73a2edabf65b2c9b61 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:02:38.087688 30526 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2416e0cc1a1f4c73a2edabf65b2c9b61 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:02:38.088351 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 30391
I20260812 00:02:38.088425 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/minicluster-data/master-0/wal/instance
I20260812 00:02:38.088493 30526 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2416e0cc1a1f4c73a2edabf65b2c9b61 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2416e0cc1a1f4c73a2edabf65b2c9b61" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 45761 } }
I20260812 00:02:38.088579 12089 external_mini_cluster.cc:1428] Setting key ff60c988dbbfca73ba7e37df5ad82d57
I20260812 00:02:38.088594 30526 leader_election.cc:302] T 00000000000000000000000000000000 P 2416e0cc1a1f4c73a2edabf65b2c9b61 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2416e0cc1a1f4c73a2edabf65b2c9b61; no voters:
I20260812 00:02:38.088771 30526 leader_election.cc:288] T 00000000000000000000000000000000 P 2416e0cc1a1f4c73a2edabf65b2c9b61 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:02:38.088792 30531 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2416e0cc1a1f4c73a2edabf65b2c9b61 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:02:38.088912 30531 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2416e0cc1a1f4c73a2edabf65b2c9b61 [term 1 LEADER]: Becoming Leader. State: Replica: 2416e0cc1a1f4c73a2edabf65b2c9b61, State: Running, Role: LEADER
I20260812 00:02:38.089064 30526 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2416e0cc1a1f4c73a2edabf65b2c9b61 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:02:38.089066 30531 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2416e0cc1a1f4c73a2edabf65b2c9b61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2416e0cc1a1f4c73a2edabf65b2c9b61" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 45761 } }
I20260812 00:02:38.089464 30533 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2416e0cc1a1f4c73a2edabf65b2c9b61 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2416e0cc1a1f4c73a2edabf65b2c9b61" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2416e0cc1a1f4c73a2edabf65b2c9b61" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 45761 } } }
I20260812 00:02:38.089473 30532 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2416e0cc1a1f4c73a2edabf65b2c9b61 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2416e0cc1a1f4c73a2edabf65b2c9b61. Latest consensus state: current_term: 1 leader_uuid: "2416e0cc1a1f4c73a2edabf65b2c9b61" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2416e0cc1a1f4c73a2edabf65b2c9b61" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 45761 } } }
I20260812 00:02:38.089560 30533 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2416e0cc1a1f4c73a2edabf65b2c9b61 [sys.catalog]: This master's current role is: LEADER
I20260812 00:02:38.089568 30532 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2416e0cc1a1f4c73a2edabf65b2c9b61 [sys.catalog]: This master's current role is: LEADER
I20260812 00:02:38.089800 30541 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:02:38.090355 30541 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:02:38.092026 30541 catalog_manager.cc:1347] Generated new cluster ID: 6b449c23fa5d4284923162fb542707d6
I20260812 00:02:38.092077 30541 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 00:02:38 dist-test-slave-f0tn krb5kdc[30366](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492957, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:02:38.100323 30539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:38.089417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47816 (local address 127.11.206.126:45761)
0812 00:02:38.089701 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:38.089712 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:38.089748 (+ 36us) server_negotiation.cc:407] Connection header received
0812 00:02:38.089870 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:38.089878 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:38.089935 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:38.090080 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:38.090895 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:38.092232 (+ 1337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:38.093234 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:38.093862 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:38.093958 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:38.096660 (+ 2702us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:38.096665 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:38.096665 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:38.096679 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:38.098718 (+ 2039us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:38.099078 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:38.099082 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:38.099082 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:38.099215 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:38.099388 (+ 173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:38.099389 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:38.099389 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:38.099715 (+ 326us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:38.099866 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:38.099937 (+ 71us) server_negotiation.cc:299] Negotiation successful
0812 00:02:38.100084 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":232,"thread_start_us":84,"threads_started":1}
I20260812 00:02:38.114796 30541 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:02:38.115563 30541 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:02:38.125726 30541 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2416e0cc1a1f4c73a2edabf65b2c9b61: Generated new TSK 0
I20260812 00:02:38.125927 30541 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.206.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.65.keytab.
Entry for principal kudu/127.11.206.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.65.keytab.
I20260812 00:02:38.150599 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.65:0
--local_ip_for_outbound_sockets=127.11.206.65
--webserver_interface=127.11.206.65
--webserver_port=0
--tserver_master_addrs=127.11.206.126:45761
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.65.keytab
--principal=kudu/127.11.206.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:46721
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:02:38.232926 30565 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:02:38.233150 30565 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:02:38.233183 30565 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:02:38.234346 30565 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:02:38.234388 30565 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:02:38.234422 30565 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.65
I20260812 00:02:38.235852 30565 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:46721
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.65.keytab
--principal=kudu/127.11.206.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.206.65
--webserver_port=0
--tserver_master_addrs=127.11.206.126:45761
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30565
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.65
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:02:38.236083 30565 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:02:38.236299 30565 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:02:38.241344 30578 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:38.241358 30581 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:38.241415 30576 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:38.241422 30565 server_base.cc:1034] running on GCE node
I20260812 00:02:38.241832 30565 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:02:38.242056 30565 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:02:38.243192 30565 hybrid_clock.cc:648] HybridClock initialized: now 1786492958243181 us; error 30 us; skew 500 ppm
Aug 12 00:02:38 dist-test-slave-f0tn krb5kdc[30366](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492958, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:02:38.245750 30565 init.cc:377] Logged in from keytab as kudu/127.11.206.65@KRBTEST.COM (short username kudu)
I20260812 00:02:38.246163 30565 webserver.cc:460] Webserver started at http://127.11.206.65:33053/ using document root <none> and password file <none>
I20260812 00:02:38.246376 30565 fs_manager.cc:359] Metadata directory not provided
I20260812 00:02:38.246420 30565 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:02:38.246543 30565 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:02:38.247574 30565 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/minicluster-data/ts-0/data/instance:
uuid: "5b82820c94eb40ab8102d2cabfbf1527"
format_stamp: "Formatted at 2026-08-12 00:02:38 on dist-test-slave-f0tn"
server_key: "3d0205a0cec87e89d07075601b2f3fcd"
server_key_iv: "216f19a96cf643b1c1f2151791d2d24d"
server_key_version: "encryptionkey@0"
I20260812 00:02:38.247927 30565 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/minicluster-data/ts-0/wal/instance:
uuid: "5b82820c94eb40ab8102d2cabfbf1527"
format_stamp: "Formatted at 2026-08-12 00:02:38 on dist-test-slave-f0tn"
server_key: "3d0205a0cec87e89d07075601b2f3fcd"
server_key_iv: "216f19a96cf643b1c1f2151791d2d24d"
server_key_version: "encryptionkey@0"
I20260812 00:02:38.249177 30565 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 00:02:38.249893 30592 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:38.250043 30565 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:38.250131 30565 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/minicluster-data/ts-0/wal
uuid: "5b82820c94eb40ab8102d2cabfbf1527"
format_stamp: "Formatted at 2026-08-12 00:02:38 on dist-test-slave-f0tn"
server_key: "3d0205a0cec87e89d07075601b2f3fcd"
server_key_iv: "216f19a96cf643b1c1f2151791d2d24d"
server_key_version: "encryptionkey@0"
I20260812 00:02:38.250197 30565 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:02:38.262636 30565 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:02:38.264493 30565 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:02:38.264642 30565 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:02:38.264870 30565 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:02:38.265184 30565 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:02:38.265218 30565 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:38.265247 30565 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:02:38.265281 30565 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:38.270889 30565 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.65:44639
I20260812 00:02:38.270932 30810 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.65:44639 every 8 connection(s)
I20260812 00:02:38.271261 30565 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
I20260812 00:02:38.276023 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 30565
I20260812 00:02:38.276101 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/minicluster-data/ts-0/wal/instance
I20260812 00:02:38.276295 12089 external_mini_cluster.cc:1428] Setting key 17282f8ae4e254a3fa5a5f4a310515e7
Aug 12 00:02:38 dist-test-slave-f0tn krb5kdc[30366](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492958, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.65@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:02:38.280505 30539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:38.271972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.65:45565 (local address 127.11.206.126:45761)
0812 00:02:38.272023 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:38.272025 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:38.272216 (+ 191us) server_negotiation.cc:407] Connection header received
0812 00:02:38.272705 (+ 489us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:38.272706 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:38.272720 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:38.272782 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:38.273768 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:38.274271 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:38.275211 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:38.275397 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:38.275441 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:38.277767 (+ 2326us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:38.277768 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:38.277769 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:38.277777 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:38.279120 (+ 1343us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:38.279588 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:38.279589 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:38.279589 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:38.279653 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:38.279875 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:38.279876 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:38.279876 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:38.280013 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:38.280074 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:38.280323 (+ 249us) server_negotiation.cc:299] Negotiation successful
0812 00:02:38.280414 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260812 00:02:38.280588 30814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:38.271939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:45761 (local address 127.11.206.65:45565)
0812 00:02:38.272091 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:38.272128 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:38.272626 (+ 498us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:38.272844 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:38.272848 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:38.273482 (+ 634us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:38.273686 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:38.273692 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:38.274340 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:38.274340 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:38.275150 (+ 810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:38.275152 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:38.275453 (+ 301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:38.275454 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:38.275559 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:38.276094 (+ 535us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:38.276105 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:38.277671 (+ 1566us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:02:38.279195 (+ 1524us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:38.279202 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:38.279204 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:38.279521 (+ 317us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:38.279714 (+ 193us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:38.279715 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:38.279715 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:38.279822 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:38.280071 (+ 249us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:02:38.280074 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:02:38.280193 (+ 119us) client_negotiation.cc:769] Sending connection context
0812 00:02:38.280286 (+ 93us) client_negotiation.cc:240] Negotiation successful
0812 00:02:38.280415 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":88,"threads_started":1}
I20260812 00:02:38.281142 30812 heartbeater.cc:347] Connected to a master server at 127.11.206.126:45761
I20260812 00:02:38.281252 30812 heartbeater.cc:464] Registering TS with master...
I20260812 00:02:38.281458 30812 heartbeater.cc:511] Master 127.11.206.126:45761 requested a full tablet report, sending...
I20260812 00:02:38.282055 30445 ts_manager.cc:194] Registered new tserver with Master: 5b82820c94eb40ab8102d2cabfbf1527 (127.11.206.65:44639)
I20260812 00:02:38.282953 30445 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.206.65@KRBTEST.COM'} at 127.11.206.65:45565
WARNING: no policy specified for kudu/127.11.206.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.66.keytab.
Entry for principal kudu/127.11.206.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.66.keytab.
I20260812 00:02:38.301898 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.66:0
--local_ip_for_outbound_sockets=127.11.206.66
--webserver_interface=127.11.206.66
--webserver_port=0
--tserver_master_addrs=127.11.206.126:45761
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.66.keytab
--principal=kudu/127.11.206.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:46721
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:02:38.383244 30818 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:02:38.383455 30818 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:02:38.383477 30818 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:02:38.384593 30818 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:02:38.384639 30818 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:02:38.384666 30818 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.66
I20260812 00:02:38.386138 30818 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:46721
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.66.keytab
--principal=kudu/127.11.206.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.206.66
--webserver_port=0
--tserver_master_addrs=127.11.206.126:45761
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30818
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.66
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:02:38.386363 30818 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:02:38.386575 30818 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 00:02:38.391666 30818 server_base.cc:1034] running on GCE node
W20260812 00:02:38.391788 30829 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:38.391644 30828 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:38.391819 30834 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:38.392127 30818 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:02:38.392338 30818 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:02:38.393427 30818 hybrid_clock.cc:648] HybridClock initialized: now 1786492958393413 us; error 27 us; skew 500 ppm
Aug 12 00:02:38 dist-test-slave-f0tn krb5kdc[30366](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492958, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:02:38.395779 30818 init.cc:377] Logged in from keytab as kudu/127.11.206.66@KRBTEST.COM (short username kudu)
I20260812 00:02:38.396210 30818 webserver.cc:460] Webserver started at http://127.11.206.66:37405/ using document root <none> and password file <none>
I20260812 00:02:38.396417 30818 fs_manager.cc:359] Metadata directory not provided
I20260812 00:02:38.396466 30818 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:02:38.396592 30818 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:02:38.397670 30818 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/minicluster-data/ts-1/data/instance:
uuid: "98a7b08f21744f95a37df0a3feed9316"
format_stamp: "Formatted at 2026-08-12 00:02:38 on dist-test-slave-f0tn"
server_key: "9f5a400dc91e7a39271a1ea30b38f90e"
server_key_iv: "b0d9f29f5b28c482c31d98a531d17e1b"
server_key_version: "encryptionkey@0"
I20260812 00:02:38.398006 30818 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/minicluster-data/ts-1/wal/instance:
uuid: "98a7b08f21744f95a37df0a3feed9316"
format_stamp: "Formatted at 2026-08-12 00:02:38 on dist-test-slave-f0tn"
server_key: "9f5a400dc91e7a39271a1ea30b38f90e"
server_key_iv: "b0d9f29f5b28c482c31d98a531d17e1b"
server_key_version: "encryptionkey@0"
I20260812 00:02:38.399259 30818 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 00:02:38.399986 30842 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:38.400159 30818 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:02:38.400252 30818 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/minicluster-data/ts-1/wal
uuid: "98a7b08f21744f95a37df0a3feed9316"
format_stamp: "Formatted at 2026-08-12 00:02:38 on dist-test-slave-f0tn"
server_key: "9f5a400dc91e7a39271a1ea30b38f90e"
server_key_iv: "b0d9f29f5b28c482c31d98a531d17e1b"
server_key_version: "encryptionkey@0"
I20260812 00:02:38.400318 30818 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:02:38.425161 30818 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:02:38.427080 30818 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:02:38.427233 30818 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:02:38.427469 30818 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:02:38.427790 30818 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:02:38.427824 30818 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:38.427855 30818 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:02:38.427877 30818 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:38.433600 30818 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.66:45085
I20260812 00:02:38.433637 31031 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.66:45085 every 8 connection(s)
I20260812 00:02:38.433962 30818 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
I20260812 00:02:38.437039 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 30818
I20260812 00:02:38.437156 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/minicluster-data/ts-1/wal/instance
I20260812 00:02:38.437347 12089 external_mini_cluster.cc:1428] Setting key b5706a27e33450130d3034892112d324
Aug 12 00:02:38 dist-test-slave-f0tn krb5kdc[30366](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492958, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.66@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:02:38.443779 30539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:38.434679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.66:55691 (local address 127.11.206.126:45761)
0812 00:02:38.434760 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:38.434762 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:38.434945 (+ 183us) server_negotiation.cc:407] Connection header received
0812 00:02:38.435494 (+ 549us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:38.435495 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:38.435506 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:38.435545 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:38.436476 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:38.436998 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:38.438384 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:38.438581 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:38.438636 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:38.440987 (+ 2351us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:38.440988 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:38.440988 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:38.440995 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:38.442348 (+ 1353us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:38.442813 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:38.442813 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:38.442814 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:38.442861 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:38.443143 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:38.443144 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:38.443144 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:38.443256 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:38.443307 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:38.443639 (+ 332us) server_negotiation.cc:299] Negotiation successful
0812 00:02:38.443712 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260812 00:02:38.444031 31038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:38.434654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:45761 (local address 127.11.206.66:55691)
0812 00:02:38.434823 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:38.434863 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:38.435393 (+ 530us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:38.435610 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:38.435613 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:38.436198 (+ 585us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:38.436403 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:38.436409 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:38.437098 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:38.437099 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:38.438308 (+ 1209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:38.438311 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:38.438650 (+ 339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:38.438651 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:38.438787 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:38.439278 (+ 491us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:38.439290 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:38.440898 (+ 1608us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:02:38.442427 (+ 1529us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:38.442437 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:38.442440 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:38.442745 (+ 305us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:38.442916 (+ 171us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:38.442917 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:38.442917 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:38.443060 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:38.443316 (+ 256us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:02:38.443322 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:02:38.443499 (+ 177us) client_negotiation.cc:769] Sending connection context
0812 00:02:38.443613 (+ 114us) client_negotiation.cc:240] Negotiation successful
0812 00:02:38.443787 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":91,"threads_started":1}
I20260812 00:02:38.444598 31033 heartbeater.cc:347] Connected to a master server at 127.11.206.126:45761
I20260812 00:02:38.444697 31033 heartbeater.cc:464] Registering TS with master...
I20260812 00:02:38.444880 31033 heartbeater.cc:511] Master 127.11.206.126:45761 requested a full tablet report, sending...
I20260812 00:02:38.445292 30445 ts_manager.cc:194] Registered new tserver with Master: 98a7b08f21744f95a37df0a3feed9316 (127.11.206.66:45085)
I20260812 00:02:38.445811 30445 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.206.66@KRBTEST.COM'} at 127.11.206.66:55691
WARNING: no policy specified for kudu/127.11.206.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.67.keytab.
Entry for principal kudu/127.11.206.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.67.keytab.
I20260812 00:02:38.464393 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.67:0
--local_ip_for_outbound_sockets=127.11.206.67
--webserver_interface=127.11.206.67
--webserver_port=0
--tserver_master_addrs=127.11.206.126:45761
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.67.keytab
--principal=kudu/127.11.206.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:46721
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:02:38.548219 31044 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:02:38.548431 31044 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:02:38.548453 31044 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:02:38.549652 31044 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:02:38.549700 31044 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:02:38.549724 31044 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.67
I20260812 00:02:38.551271 31044 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:46721
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.67.keytab
--principal=kudu/127.11.206.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.206.67
--webserver_port=0
--tserver_master_addrs=127.11.206.126:45761
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31044
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.67
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:02:38.551496 31044 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:02:38.551690 31044 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:02:38.557300 31054 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:38.557317 31057 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:02:38.557312 31053 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:02:38.558193 31044 server_base.cc:1034] running on GCE node
I20260812 00:02:38.558431 31044 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:02:38.558719 31044 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:02:38.559892 31044 hybrid_clock.cc:648] HybridClock initialized: now 1786492958559871 us; error 34 us; skew 500 ppm
Aug 12 00:02:38 dist-test-slave-f0tn krb5kdc[30366](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492958, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:02:38.563716 31044 init.cc:377] Logged in from keytab as kudu/127.11.206.67@KRBTEST.COM (short username kudu)
I20260812 00:02:38.564260 31044 webserver.cc:460] Webserver started at http://127.11.206.67:45337/ using document root <none> and password file <none>
I20260812 00:02:38.564496 31044 fs_manager.cc:359] Metadata directory not provided
I20260812 00:02:38.564561 31044 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:02:38.564702 31044 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:02:38.566058 31044 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/minicluster-data/ts-2/data/instance:
uuid: "5b16306495e8444f9b5052fcb337c1f6"
format_stamp: "Formatted at 2026-08-12 00:02:38 on dist-test-slave-f0tn"
server_key: "03732685064e93816b80700f276ba02d"
server_key_iv: "9b856b624820a067c25c67350cfd2d31"
server_key_version: "encryptionkey@0"
I20260812 00:02:38.566372 31044 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/minicluster-data/ts-2/wal/instance:
uuid: "5b16306495e8444f9b5052fcb337c1f6"
format_stamp: "Formatted at 2026-08-12 00:02:38 on dist-test-slave-f0tn"
server_key: "03732685064e93816b80700f276ba02d"
server_key_iv: "9b856b624820a067c25c67350cfd2d31"
server_key_version: "encryptionkey@0"
I20260812 00:02:38.567557 31044 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260812 00:02:38.568188 31070 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:38.568332 31044 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:38.568418 31044 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/minicluster-data/ts-2/wal
uuid: "5b16306495e8444f9b5052fcb337c1f6"
format_stamp: "Formatted at 2026-08-12 00:02:38 on dist-test-slave-f0tn"
server_key: "03732685064e93816b80700f276ba02d"
server_key_iv: "9b856b624820a067c25c67350cfd2d31"
server_key_version: "encryptionkey@0"
I20260812 00:02:38.568485 31044 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:02:38.592108 31044 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:02:38.594012 31044 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:02:38.594159 31044 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:02:38.594408 31044 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:02:38.594729 31044 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:02:38.594766 31044 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:38.594797 31044 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:02:38.594822 31044 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:02:38.601269 31044 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.67:40659
I20260812 00:02:38.601320 31264 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.67:40659 every 8 connection(s)
I20260812 00:02:38.601696 31044 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
Aug 12 00:02:38 dist-test-slave-f0tn krb5kdc[30366](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492958, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.67@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:02:38.609997 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 31044
I20260812 00:02:38.610086 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/minicluster-data/ts-2/wal/instance
I20260812 00:02:38.610275 12089 external_mini_cluster.cc:1428] Setting key 29590caf2c64b9ab41aa5a250d418a07
I20260812 00:02:38.610708 30539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:38.602436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.67:40553 (local address 127.11.206.126:45761)
0812 00:02:38.602498 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:38.602500 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:38.602690 (+ 190us) server_negotiation.cc:407] Connection header received
0812 00:02:38.603198 (+ 508us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:38.603199 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:38.603209 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:38.603270 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:38.604212 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:38.604714 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:38.605759 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:38.605945 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:38.605997 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:38.608045 (+ 2048us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:38.608047 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:38.608047 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:38.608054 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:38.609326 (+ 1272us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:38.609690 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:38.609691 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:38.609691 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:38.609743 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:38.609979 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:38.609979 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:38.609979 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:38.610099 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:38.610180 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:38.610525 (+ 345us) server_negotiation.cc:299] Negotiation successful
0812 00:02:38.610616 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260812 00:02:38.610913 31269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:38.602396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:45761 (local address 127.11.206.67:40553)
0812 00:02:38.602555 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:38.602607 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:38.603110 (+ 503us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:38.603328 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:38.603332 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:38.603911 (+ 579us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:02:38.604117 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:38.604124 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:38.604791 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:38.604792 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:38.605693 (+ 901us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:38.605697 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:38.606004 (+ 307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:38.606005 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:38.606108 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:38.606593 (+ 485us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:02:38.606602 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:02:38.607964 (+ 1362us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:02:38.609419 (+ 1455us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:38.609425 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:38.609428 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:38.609637 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:38.609789 (+ 152us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:02:38.609790 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:02:38.609790 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:02:38.609923 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:02:38.610208 (+ 285us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:02:38.610215 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:02:38.610366 (+ 151us) client_negotiation.cc:769] Sending connection context
0812 00:02:38.610483 (+ 117us) client_negotiation.cc:240] Negotiation successful
0812 00:02:38.610663 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":78,"threads_started":1}
I20260812 00:02:38.611362 31267 heartbeater.cc:347] Connected to a master server at 127.11.206.126:45761
I20260812 00:02:38.611460 31267 heartbeater.cc:464] Registering TS with master...
I20260812 00:02:38.611649 31267 heartbeater.cc:511] Master 127.11.206.126:45761 requested a full tablet report, sending...
I20260812 00:02:38.612007 30445 ts_manager.cc:194] Registered new tserver with Master: 5b16306495e8444f9b5052fcb337c1f6 (127.11.206.67:40659)
I20260812 00:02:38.612355 30445 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.206.67@KRBTEST.COM'} at 127.11.206.67:40553
I20260812 00:02:38.622232 12089 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:02:38.629426 30539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:38.623470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47832 (local address 127.11.206.126:45761)
0812 00:02:38.623533 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:38.623535 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:38.623687 (+ 152us) server_negotiation.cc:407] Connection header received
0812 00:02:38.623738 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:38.623739 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:38.623747 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:38.623804 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:02:38.624334 (+ 530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:38.624828 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:38.625579 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:38.625825 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:38.625897 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:38.627054 (+ 1157us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:02:38.627055 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:02:38.627056 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:02:38.627064 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:02:38.628322 (+ 1258us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:38.628632 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:38.628633 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:38.628634 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:38.628689 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:02:38.628852 (+ 163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:02:38.628853 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:02:38.628853 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:02:38.629004 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:02:38.629090 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:38.629212 (+ 122us) server_negotiation.cc:299] Negotiation successful
0812 00:02:38.629293 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260812 00:02:38.630810 30445 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47832:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:02:38.632310 30445 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:02:38.638506 31290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:38.634515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.65:44639 (local address 127.0.0.1:39256)
0812 00:02:38.634709 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:38.634768 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:38.634832 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:38.635061 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:38.635064 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:38.635066 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:02:38.635140 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:38.635142 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:38.636180 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:38.636181 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:38.637350 (+ 1169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:38.637353 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:38.638215 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:38.638216 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:38.638296 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:38.638310 (+ 14us) client_negotiation.cc:769] Sending connection context
0812 00:02:38.638373 (+ 63us) client_negotiation.cc:240] Negotiation successful
0812 00:02:38.638428 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":44,"threads_started":1}
I20260812 00:02:38.638521 31294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:38.634704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39256 (local address 127.11.206.65:44639)
0812 00:02:38.634912 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:38.634917 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:38.634929 (+ 12us) server_negotiation.cc:407] Connection header received
0812 00:02:38.634970 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:38.634972 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:38.634986 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:38.635055 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:02:38.635286 (+ 231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:38.636087 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:38.637467 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:38.638142 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:38.638205 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:38.638279 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:38.638394 (+ 115us) server_negotiation.cc:299] Negotiation successful
0812 00:02:38.638435 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":176,"thread_start_us":97,"threads_started":1}
I20260812 00:02:38.638744 31289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:38.634516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.66:45085 (local address 127.0.0.1:52230)
0812 00:02:38.634862 (+ 346us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:38.634871 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:38.634909 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:38.635401 (+ 492us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:38.635403 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:38.635405 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:02:38.635447 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:38.635448 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:38.636683 (+ 1235us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:38.636684 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:38.637563 (+ 879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:38.637566 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:38.638518 (+ 952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:38.638519 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:38.638580 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:38.638584 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:02:38.638614 (+ 30us) client_negotiation.cc:240] Negotiation successful
0812 00:02:38.638660 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":333,"mutex_wait_us":2,"spinlock_wait_cycles":384,"thread_start_us":124,"threads_started":1}
I20260812 00:02:38.639026 31297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:38.634758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46558 (local address 127.11.206.67:40659)
0812 00:02:38.635027 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:38.635032 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:38.635042 (+ 10us) server_negotiation.cc:407] Connection header received
0812 00:02:38.635076 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:38.635078 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:38.635094 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:38.635171 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:02:38.635336 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:38.636476 (+ 1140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:38.637737 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:38.638410 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:38.638474 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:38.638531 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:38.638901 (+ 370us) server_negotiation.cc:299] Negotiation successful
0812 00:02:38.638948 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":233,"thread_start_us":95,"threads_started":1}
I20260812 00:02:38.639230 31291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:38.634531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.67:40659 (local address 127.0.0.1:46558)
0812 00:02:38.634928 (+ 397us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:38.634935 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:38.634969 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:38.635188 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:38.635189 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:38.635191 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:02:38.635239 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:38.635241 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:38.636583 (+ 1342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:38.636584 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:38.637663 (+ 1079us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:38.637666 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:38.638687 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:38.638688 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:38.638745 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:38.638748 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:02:38.638793 (+ 45us) client_negotiation.cc:240] Negotiation successful
0812 00:02:38.639166 (+ 373us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":383,"thread_start_us":91,"threads_started":1}
I20260812 00:02:38.639348 31292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:38.634685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52230 (local address 127.11.206.66:45085)
0812 00:02:38.635251 (+ 566us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:38.635255 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:38.635265 (+ 10us) server_negotiation.cc:407] Connection header received
0812 00:02:38.635300 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:38.635302 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:38.635317 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:38.635512 (+ 195us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:02:38.635581 (+ 69us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:38.636592 (+ 1011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:38.637645 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:38.638403 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:38.639134 (+ 731us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:38.639205 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:38.639229 (+ 24us) server_negotiation.cc:299] Negotiation successful
0812 00:02:38.639272 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":466,"thread_start_us":97,"threads_started":1}
I20260812 00:02:38.639257 30688 tablet_service.cc:1467] Processing CreateTablet for tablet 37e22e2f1a0040aa931738e8db11c292 (DEFAULT_TABLE table=test-table [id=0f86b6ebec664d72aa94703ef3562c23]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:02:38.639681 30688 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37e22e2f1a0040aa931738e8db11c292. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:02:38.640048 31149 tablet_service.cc:1467] Processing CreateTablet for tablet 37e22e2f1a0040aa931738e8db11c292 (DEFAULT_TABLE table=test-table [id=0f86b6ebec664d72aa94703ef3562c23]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:02:38.640386 31149 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37e22e2f1a0040aa931738e8db11c292. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:02:38.641750 30928 tablet_service.cc:1467] Processing CreateTablet for tablet 37e22e2f1a0040aa931738e8db11c292 (DEFAULT_TABLE table=test-table [id=0f86b6ebec664d72aa94703ef3562c23]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:02:38.642016 30928 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37e22e2f1a0040aa931738e8db11c292. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:02:38.643144 31299 tablet_bootstrap.cc:492] T 37e22e2f1a0040aa931738e8db11c292 P 5b82820c94eb40ab8102d2cabfbf1527: Bootstrap starting.
I20260812 00:02:38.643641 31302 tablet_bootstrap.cc:492] T 37e22e2f1a0040aa931738e8db11c292 P 5b16306495e8444f9b5052fcb337c1f6: Bootstrap starting.
I20260812 00:02:38.643846 31299 tablet_bootstrap.cc:654] T 37e22e2f1a0040aa931738e8db11c292 P 5b82820c94eb40ab8102d2cabfbf1527: Neither blocks nor log segments found. Creating new log.
I20260812 00:02:38.644182 31302 tablet_bootstrap.cc:654] T 37e22e2f1a0040aa931738e8db11c292 P 5b16306495e8444f9b5052fcb337c1f6: Neither blocks nor log segments found. Creating new log.
I20260812 00:02:38.644450 31299 log.cc:824] T 37e22e2f1a0040aa931738e8db11c292 P 5b82820c94eb40ab8102d2cabfbf1527: Log is configured to *not* fsync() on all Append() calls
I20260812 00:02:38.644556 31302 log.cc:824] T 37e22e2f1a0040aa931738e8db11c292 P 5b16306495e8444f9b5052fcb337c1f6: Log is configured to *not* fsync() on all Append() calls
I20260812 00:02:38.645274 31302 tablet_bootstrap.cc:492] T 37e22e2f1a0040aa931738e8db11c292 P 5b16306495e8444f9b5052fcb337c1f6: No bootstrap required, opened a new log
I20260812 00:02:38.645329 31302 ts_tablet_manager.cc:1397] T 37e22e2f1a0040aa931738e8db11c292 P 5b16306495e8444f9b5052fcb337c1f6: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 00:02:38.645430 31299 tablet_bootstrap.cc:492] T 37e22e2f1a0040aa931738e8db11c292 P 5b82820c94eb40ab8102d2cabfbf1527: No bootstrap required, opened a new log
I20260812 00:02:38.645499 31299 ts_tablet_manager.cc:1397] T 37e22e2f1a0040aa931738e8db11c292 P 5b82820c94eb40ab8102d2cabfbf1527: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 00:02:38.646737 31302 raft_consensus.cc:348] T 37e22e2f1a0040aa931738e8db11c292 P 5b16306495e8444f9b5052fcb337c1f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b82820c94eb40ab8102d2cabfbf1527" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 44639 } } peers { permanent_uuid: "98a7b08f21744f95a37df0a3feed9316" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 45085 } } peers { permanent_uuid: "5b16306495e8444f9b5052fcb337c1f6" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 40659 } }
I20260812 00:02:38.646864 31302 raft_consensus.cc:374] T 37e22e2f1a0040aa931738e8db11c292 P 5b16306495e8444f9b5052fcb337c1f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:02:38.646885 31302 raft_consensus.cc:729] T 37e22e2f1a0040aa931738e8db11c292 P 5b16306495e8444f9b5052fcb337c1f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b16306495e8444f9b5052fcb337c1f6, State: Initialized, Role: FOLLOWER
I20260812 00:02:38.646878 31299 raft_consensus.cc:348] T 37e22e2f1a0040aa931738e8db11c292 P 5b82820c94eb40ab8102d2cabfbf1527 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b82820c94eb40ab8102d2cabfbf1527" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 44639 } } peers { permanent_uuid: "98a7b08f21744f95a37df0a3feed9316" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 45085 } } peers { permanent_uuid: "5b16306495e8444f9b5052fcb337c1f6" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 40659 } }
I20260812 00:02:38.646981 31302 consensus_queue.cc:260] T 37e22e2f1a0040aa931738e8db11c292 P 5b16306495e8444f9b5052fcb337c1f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b82820c94eb40ab8102d2cabfbf1527" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 44639 } } peers { permanent_uuid: "98a7b08f21744f95a37df0a3feed9316" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 45085 } } peers { permanent_uuid: "5b16306495e8444f9b5052fcb337c1f6" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 40659 } }
I20260812 00:02:38.647035 31299 raft_consensus.cc:374] T 37e22e2f1a0040aa931738e8db11c292 P 5b82820c94eb40ab8102d2cabfbf1527 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:02:38.647076 31299 raft_consensus.cc:729] T 37e22e2f1a0040aa931738e8db11c292 P 5b82820c94eb40ab8102d2cabfbf1527 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b82820c94eb40ab8102d2cabfbf1527, State: Initialized, Role: FOLLOWER
I20260812 00:02:38.647184 31299 consensus_queue.cc:260] T 37e22e2f1a0040aa931738e8db11c292 P 5b82820c94eb40ab8102d2cabfbf1527 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b82820c94eb40ab8102d2cabfbf1527" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 44639 } } peers { permanent_uuid: "98a7b08f21744f95a37df0a3feed9316" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 45085 } } peers { permanent_uuid: "5b16306495e8444f9b5052fcb337c1f6" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 40659 } }
I20260812 00:02:38.647236 31302 ts_tablet_manager.cc:1428] T 37e22e2f1a0040aa931738e8db11c292 P 5b16306495e8444f9b5052fcb337c1f6: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260812 00:02:38.647271 31267 heartbeater.cc:503] Master 127.11.206.126:45761 was elected leader, sending a full tablet report...
I20260812 00:02:38.647311 31305 tablet_bootstrap.cc:492] T 37e22e2f1a0040aa931738e8db11c292 P 98a7b08f21744f95a37df0a3feed9316: Bootstrap starting.
I20260812 00:02:38.647459 31299 ts_tablet_manager.cc:1428] T 37e22e2f1a0040aa931738e8db11c292 P 5b82820c94eb40ab8102d2cabfbf1527: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 00:02:38.647509 30812 heartbeater.cc:503] Master 127.11.206.126:45761 was elected leader, sending a full tablet report...
I20260812 00:02:38.647994 31305 tablet_bootstrap.cc:654] T 37e22e2f1a0040aa931738e8db11c292 P 98a7b08f21744f95a37df0a3feed9316: Neither blocks nor log segments found. Creating new log.
I20260812 00:02:38.648538 31305 log.cc:824] T 37e22e2f1a0040aa931738e8db11c292 P 98a7b08f21744f95a37df0a3feed9316: Log is configured to *not* fsync() on all Append() calls
I20260812 00:02:38.649137 31305 tablet_bootstrap.cc:492] T 37e22e2f1a0040aa931738e8db11c292 P 98a7b08f21744f95a37df0a3feed9316: No bootstrap required, opened a new log
I20260812 00:02:38.649194 31305 ts_tablet_manager.cc:1397] T 37e22e2f1a0040aa931738e8db11c292 P 98a7b08f21744f95a37df0a3feed9316: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260812 00:02:38.650535 31305 raft_consensus.cc:348] T 37e22e2f1a0040aa931738e8db11c292 P 98a7b08f21744f95a37df0a3feed9316 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b82820c94eb40ab8102d2cabfbf1527" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 44639 } } peers { permanent_uuid: "98a7b08f21744f95a37df0a3feed9316" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 45085 } } peers { permanent_uuid: "5b16306495e8444f9b5052fcb337c1f6" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 40659 } }
I20260812 00:02:38.650658 31305 raft_consensus.cc:374] T 37e22e2f1a0040aa931738e8db11c292 P 98a7b08f21744f95a37df0a3feed9316 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:02:38.650689 31305 raft_consensus.cc:729] T 37e22e2f1a0040aa931738e8db11c292 P 98a7b08f21744f95a37df0a3feed9316 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98a7b08f21744f95a37df0a3feed9316, State: Initialized, Role: FOLLOWER
I20260812 00:02:38.650803 31305 consensus_queue.cc:260] T 37e22e2f1a0040aa931738e8db11c292 P 98a7b08f21744f95a37df0a3feed9316 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b82820c94eb40ab8102d2cabfbf1527" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 44639 } } peers { permanent_uuid: "98a7b08f21744f95a37df0a3feed9316" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 45085 } } peers { permanent_uuid: "5b16306495e8444f9b5052fcb337c1f6" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 40659 } }
I20260812 00:02:38.651044 31305 ts_tablet_manager.cc:1428] T 37e22e2f1a0040aa931738e8db11c292 P 98a7b08f21744f95a37df0a3feed9316: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 00:02:38.651093 31033 heartbeater.cc:503] Master 127.11.206.126:45761 was elected leader, sending a full tablet report...
W20260812 00:02:38.684513 31034 tablet.cc:2369] T 37e22e2f1a0040aa931738e8db11c292 P 98a7b08f21744f95a37df0a3feed9316: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 00:02:38.771938 30813 tablet.cc:2369] T 37e22e2f1a0040aa931738e8db11c292 P 5b82820c94eb40ab8102d2cabfbf1527: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 00:02:38.852273 31268 tablet.cc:2369] T 37e22e2f1a0040aa931738e8db11c292 P 5b16306495e8444f9b5052fcb337c1f6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:02:38.910517 31307 raft_consensus.cc:482] T 37e22e2f1a0040aa931738e8db11c292 P 5b16306495e8444f9b5052fcb337c1f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:02:38.910650 31307 raft_consensus.cc:504] T 37e22e2f1a0040aa931738e8db11c292 P 5b16306495e8444f9b5052fcb337c1f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b82820c94eb40ab8102d2cabfbf1527" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 44639 } } peers { permanent_uuid: "98a7b08f21744f95a37df0a3feed9316" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 45085 } } peers { permanent_uuid: "5b16306495e8444f9b5052fcb337c1f6" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 40659 } }
I20260812 00:02:38.910986 31307 leader_election.cc:288] T 37e22e2f1a0040aa931738e8db11c292 P 5b16306495e8444f9b5052fcb337c1f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b82820c94eb40ab8102d2cabfbf1527 (127.11.206.65:44639), 98a7b08f21744f95a37df0a3feed9316 (127.11.206.66:45085)
I20260812 00:02:38.913739 31292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:38.911320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.67:47725 (local address 127.11.206.66:45085)
0812 00:02:38.911366 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:38.911368 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:38.911375 (+ 7us) server_negotiation.cc:407] Connection header received
0812 00:02:38.911401 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:38.911402 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:38.911408 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:38.911454 (+ 46us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:02:38.911601 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:38.912076 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:38.913009 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:38.913421 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:38.913488 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:38.913498 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:38.913628 (+ 130us) server_negotiation.cc:299] Negotiation successful
0812 00:02:38.913666 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 00:02:38.913765 31294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:38.911270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.67:51045 (local address 127.11.206.65:44639)
0812 00:02:38.911317 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:38.911319 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:38.911460 (+ 141us) server_negotiation.cc:407] Connection header received
0812 00:02:38.911511 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:38.911512 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:38.911522 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:38.911568 (+ 46us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:02:38.911704 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:38.912166 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:38.913060 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:38.913458 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:38.913513 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:38.913522 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:38.913654 (+ 132us) server_negotiation.cc:299] Negotiation successful
0812 00:02:38.913689 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 00:02:38.913774 31269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:38.911182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.66:45085 (local address 127.11.206.67:47725)
0812 00:02:38.911240 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:38.911252 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:38.911304 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:38.911469 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:38.911470 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:38.911472 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:02:38.911543 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:38.911544 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:38.912157 (+ 613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:38.912158 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:38.912920 (+ 762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:38.912922 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:38.913491 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:38.913492 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:38.913568 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:38.913571 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:02:38.913617 (+ 46us) client_negotiation.cc:240] Negotiation successful
0812 00:02:38.913660 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260812 00:02:38.913784 31314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:38.911202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.65:44639 (local address 127.11.206.67:51045)
0812 00:02:38.911385 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:38.911393 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 00:02:38.911451 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:02:38.911575 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:02:38.911576 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:02:38.911577 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:02:38.911645 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:38.911647 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:38.912244 (+ 597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:38.912245 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:38.912971 (+ 726us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:02:38.912972 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:02:38.913533 (+ 561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:02:38.913534 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:02:38.913595 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:38.913598 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:02:38.913641 (+ 43us) client_negotiation.cc:240] Negotiation successful
0812 00:02:38.913684 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":104,"threads_started":1}
I20260812 00:02:38.914161 30723 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37e22e2f1a0040aa931738e8db11c292" candidate_uuid: "5b16306495e8444f9b5052fcb337c1f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b82820c94eb40ab8102d2cabfbf1527" is_pre_election: true
I20260812 00:02:38.914153 30959 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37e22e2f1a0040aa931738e8db11c292" candidate_uuid: "5b16306495e8444f9b5052fcb337c1f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98a7b08f21744f95a37df0a3feed9316" is_pre_election: true
I20260812 00:02:38.914328 30959 raft_consensus.cc:2454] T 37e22e2f1a0040aa931738e8db11c292 P 98a7b08f21744f95a37df0a3feed9316 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b16306495e8444f9b5052fcb337c1f6 in term 0.
I20260812 00:02:38.914328 30723 raft_consensus.cc:2454] T 37e22e2f1a0040aa931738e8db11c292 P 5b82820c94eb40ab8102d2cabfbf1527 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b16306495e8444f9b5052fcb337c1f6 in term 0.
I20260812 00:02:38.914579 31072 leader_election.cc:302] T 37e22e2f1a0040aa931738e8db11c292 P 5b16306495e8444f9b5052fcb337c1f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b16306495e8444f9b5052fcb337c1f6, 98a7b08f21744f95a37df0a3feed9316; no voters:
I20260812 00:02:38.914721 31307 raft_consensus.cc:2781] T 37e22e2f1a0040aa931738e8db11c292 P 5b16306495e8444f9b5052fcb337c1f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:02:38.914785 31307 raft_consensus.cc:482] T 37e22e2f1a0040aa931738e8db11c292 P 5b16306495e8444f9b5052fcb337c1f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:02:38.914810 31307 raft_consensus.cc:3037] T 37e22e2f1a0040aa931738e8db11c292 P 5b16306495e8444f9b5052fcb337c1f6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:02:38.915490 31307 raft_consensus.cc:504] T 37e22e2f1a0040aa931738e8db11c292 P 5b16306495e8444f9b5052fcb337c1f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b82820c94eb40ab8102d2cabfbf1527" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 44639 } } peers { permanent_uuid: "98a7b08f21744f95a37df0a3feed9316" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 45085 } } peers { permanent_uuid: "5b16306495e8444f9b5052fcb337c1f6" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 40659 } }
I20260812 00:02:38.915612 31307 leader_election.cc:288] T 37e22e2f1a0040aa931738e8db11c292 P 5b16306495e8444f9b5052fcb337c1f6 [CANDIDATE]: Term 1 election: Requested vote from peers 5b82820c94eb40ab8102d2cabfbf1527 (127.11.206.65:44639), 98a7b08f21744f95a37df0a3feed9316 (127.11.206.66:45085)
I20260812 00:02:38.915755 30959 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37e22e2f1a0040aa931738e8db11c292" candidate_uuid: "5b16306495e8444f9b5052fcb337c1f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98a7b08f21744f95a37df0a3feed9316"
I20260812 00:02:38.915835 30959 raft_consensus.cc:3037] T 37e22e2f1a0040aa931738e8db11c292 P 98a7b08f21744f95a37df0a3feed9316 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:02:38.916517 30959 raft_consensus.cc:2454] T 37e22e2f1a0040aa931738e8db11c292 P 98a7b08f21744f95a37df0a3feed9316 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b16306495e8444f9b5052fcb337c1f6 in term 1.
I20260812 00:02:38.916646 30723 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37e22e2f1a0040aa931738e8db11c292" candidate_uuid: "5b16306495e8444f9b5052fcb337c1f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b82820c94eb40ab8102d2cabfbf1527"
I20260812 00:02:38.916679 31072 leader_election.cc:302] T 37e22e2f1a0040aa931738e8db11c292 P 5b16306495e8444f9b5052fcb337c1f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b16306495e8444f9b5052fcb337c1f6, 98a7b08f21744f95a37df0a3feed9316; no voters:
I20260812 00:02:38.916738 30723 raft_consensus.cc:3037] T 37e22e2f1a0040aa931738e8db11c292 P 5b82820c94eb40ab8102d2cabfbf1527 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:02:38.916785 31307 raft_consensus.cc:2781] T 37e22e2f1a0040aa931738e8db11c292 P 5b16306495e8444f9b5052fcb337c1f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:02:38.916951 31307 raft_consensus.cc:686] T 37e22e2f1a0040aa931738e8db11c292 P 5b16306495e8444f9b5052fcb337c1f6 [term 1 LEADER]: Becoming Leader. State: Replica: 5b16306495e8444f9b5052fcb337c1f6, State: Running, Role: LEADER
I20260812 00:02:38.917052 31307 consensus_queue.cc:237] T 37e22e2f1a0040aa931738e8db11c292 P 5b16306495e8444f9b5052fcb337c1f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b82820c94eb40ab8102d2cabfbf1527" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 44639 } } peers { permanent_uuid: "98a7b08f21744f95a37df0a3feed9316" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 45085 } } peers { permanent_uuid: "5b16306495e8444f9b5052fcb337c1f6" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 40659 } }
I20260812 00:02:38.917690 30723 raft_consensus.cc:2454] T 37e22e2f1a0040aa931738e8db11c292 P 5b82820c94eb40ab8102d2cabfbf1527 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b16306495e8444f9b5052fcb337c1f6 in term 1.
I20260812 00:02:38.918190 30445 catalog_manager.cc:5495] T 37e22e2f1a0040aa931738e8db11c292 P 5b16306495e8444f9b5052fcb337c1f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5b16306495e8444f9b5052fcb337c1f6 (127.11.206.67). New cstate: current_term: 1 leader_uuid: "5b16306495e8444f9b5052fcb337c1f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b82820c94eb40ab8102d2cabfbf1527" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 44639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98a7b08f21744f95a37df0a3feed9316" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 45085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b16306495e8444f9b5052fcb337c1f6" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 40659 } health_report { overall_health: HEALTHY } } }
I20260812 00:02:38.992028 31297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:38.989700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46568 (local address 127.11.206.67:40659)
0812 00:02:38.989741 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0812 00:02:38.989743 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:02:38.989752 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:02:38.989808 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:02:38.989809 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:02:38.989827 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:02:38.989887 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:02:38.990026 (+ 139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:38.990531 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:38.991298 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:02:38.991490 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:02:38.991545 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:02:38.991691 (+ 146us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:02:38.991804 (+ 113us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:02:38.991874 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 00:02:38.991909 (+ 35us) server_negotiation.cc:299] Negotiation successful
0812 00:02:38.991929 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 00:02:38.993830 30723 raft_consensus.cc:1261] T 37e22e2f1a0040aa931738e8db11c292 P 5b82820c94eb40ab8102d2cabfbf1527 [term 1 FOLLOWER]: Refusing update from remote peer 5b16306495e8444f9b5052fcb337c1f6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:02:38.993844 30959 raft_consensus.cc:1261] T 37e22e2f1a0040aa931738e8db11c292 P 98a7b08f21744f95a37df0a3feed9316 [term 1 FOLLOWER]: Refusing update from remote peer 5b16306495e8444f9b5052fcb337c1f6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:02:38.994144 31307 consensus_queue.cc:1035] T 37e22e2f1a0040aa931738e8db11c292 P 5b16306495e8444f9b5052fcb337c1f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b82820c94eb40ab8102d2cabfbf1527" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 44639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:02:38.994287 31316 consensus_queue.cc:1035] T 37e22e2f1a0040aa931738e8db11c292 P 5b16306495e8444f9b5052fcb337c1f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98a7b08f21744f95a37df0a3feed9316" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 45085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:02:38.996600 31328 mvcc.cc:205] Tried to move back new op lower bound from 7317475160035905536 to 7317475159724761088. Current Snapshot: MvccSnapshot[applied={T|T < 7317475160035905536}]
I20260812 00:02:38.996825 31324 mvcc.cc:205] Tried to move back new op lower bound from 7317475160035905536 to 7317475159724761088. Current Snapshot: MvccSnapshot[applied={T|T < 7317475160035905536}]
I20260812 00:02:38.996951 31323 mvcc.cc:205] Tried to move back new op lower bound from 7317475160035905536 to 7317475159724761088. Current Snapshot: MvccSnapshot[applied={T|T < 7317475160035905536}]
I20260812 00:02:38.999421 30444 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47832:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:02:38.999507 30444 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47832:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:02:39.000227 30444 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2416e0cc1a1f4c73a2edabf65b2c9b61: Sending DeleteTablet for 3 replicas of tablet 37e22e2f1a0040aa931738e8db11c292
I20260812 00:02:39.000530 30688 tablet_service.cc:1514] Processing DeleteTablet for tablet 37e22e2f1a0040aa931738e8db11c292 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:02:38 UTC) from {username='kudu', principal='kudu/127.11.206.126@KRBTEST.COM'} at 127.0.0.1:39256
I20260812 00:02:39.000583 30928 tablet_service.cc:1514] Processing DeleteTablet for tablet 37e22e2f1a0040aa931738e8db11c292 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:02:38 UTC) from {username='kudu', principal='kudu/127.11.206.126@KRBTEST.COM'} at 127.0.0.1:52230
I20260812 00:02:39.000620 31149 tablet_service.cc:1514] Processing DeleteTablet for tablet 37e22e2f1a0040aa931738e8db11c292 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:02:38 UTC) from {username='kudu', principal='kudu/127.11.206.126@KRBTEST.COM'} at 127.0.0.1:46558
I20260812 00:02:39.000810 31342 tablet_replica.cc:330] T 37e22e2f1a0040aa931738e8db11c292 P 98a7b08f21744f95a37df0a3feed9316: stopping tablet replica
I20260812 00:02:39.000912 31342 raft_consensus.cc:2229] T 37e22e2f1a0040aa931738e8db11c292 P 98a7b08f21744f95a37df0a3feed9316 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:02:39.000989 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 30565
I20260812 00:02:39.001015 31342 raft_consensus.cc:2258] T 37e22e2f1a0040aa931738e8db11c292 P 98a7b08f21744f95a37df0a3feed9316 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:02:39.006424 31342 ts_tablet_manager.cc:1905] T 37e22e2f1a0040aa931738e8db11c292 P 98a7b08f21744f95a37df0a3feed9316: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:02:39.008327 31342 ts_tablet_manager.cc:1918] T 37e22e2f1a0040aa931738e8db11c292 P 98a7b08f21744f95a37df0a3feed9316: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:02:39.008421 31342 log.cc:1196] T 37e22e2f1a0040aa931738e8db11c292 P 98a7b08f21744f95a37df0a3feed9316: Deleting WAL directory at /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/minicluster-data/ts-1/wal/wals/37e22e2f1a0040aa931738e8db11c292
I20260812 00:02:39.008718 31342 ts_tablet_manager.cc:1939] T 37e22e2f1a0040aa931738e8db11c292 P 98a7b08f21744f95a37df0a3feed9316: Deleting consensus metadata
I20260812 00:02:39.009284 30418 catalog_manager.cc:4841] TS 98a7b08f21744f95a37df0a3feed9316 (127.11.206.66:45085): tablet 37e22e2f1a0040aa931738e8db11c292 (table test-table [id=0f86b6ebec664d72aa94703ef3562c23]) successfully deleted
I20260812 00:02:39.013502 31344 tablet_replica.cc:330] T 37e22e2f1a0040aa931738e8db11c292 P 5b16306495e8444f9b5052fcb337c1f6: stopping tablet replica
I20260812 00:02:39.013633 31344 raft_consensus.cc:2229] T 37e22e2f1a0040aa931738e8db11c292 P 5b16306495e8444f9b5052fcb337c1f6 [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:02:39.013790 31344 raft_consensus.cc:2258] T 37e22e2f1a0040aa931738e8db11c292 P 5b16306495e8444f9b5052fcb337c1f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:02:39.017194 31344 ts_tablet_manager.cc:1905] T 37e22e2f1a0040aa931738e8db11c292 P 5b16306495e8444f9b5052fcb337c1f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:02:39.018723 31344 ts_tablet_manager.cc:1918] T 37e22e2f1a0040aa931738e8db11c292 P 5b16306495e8444f9b5052fcb337c1f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:02:39.018808 31344 log.cc:1196] T 37e22e2f1a0040aa931738e8db11c292 P 5b16306495e8444f9b5052fcb337c1f6: Deleting WAL directory at /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786492899949492-12089-0/minicluster-data/ts-2/wal/wals/37e22e2f1a0040aa931738e8db11c292
I20260812 00:02:39.019079 31344 ts_tablet_manager.cc:1939] T 37e22e2f1a0040aa931738e8db11c292 P 5b16306495e8444f9b5052fcb337c1f6: Deleting consensus metadata
I20260812 00:02:39.019515 30422 catalog_manager.cc:4841] TS 5b16306495e8444f9b5052fcb337c1f6 (127.11.206.67:40659): tablet 37e22e2f1a0040aa931738e8db11c292 (table test-table [id=0f86b6ebec664d72aa94703ef3562c23]) successfully deleted
W20260812 00:02:39.021725 30420 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.206.65:44639 (error 108)
I20260812 00:02:39.021965 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 30818
I20260812 00:02:39.027236 31291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:02:39.027043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.65:44639 (local address 127.0.0.1:39266)
0812 00:02:39.027116 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0812 00:02:39.027185 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.65:44639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260812 00:02:39.027441 30420 catalog_manager.cc:4584] TS 5b82820c94eb40ab8102d2cabfbf1527 (127.11.206.65:44639): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 37e22e2f1a0040aa931738e8db11c292: Network error: Client connection negotiation failed: client connection to 127.11.206.65:44639: connect: Connection refused (error 111)
I20260812 00:02:39.038748 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 31044
I20260812 00:02:39.055806 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 30391
2026-08-12T00:02:39Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2397 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:02:39 dist-test-slave-f0tn krb5kdc[31348](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:02:39 dist-test-slave-f0tn krb5kdc[31348](info): set up 2 sockets
Aug 12 00:02:39 dist-test-slave-f0tn krb5kdc[31348](info): commencing operation
krb5kdc: starting...
W20260812 00:02:40.244709 12089 mini_kdc.cc:121] Time spent starting KDC: real 1.162s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/krb5kdc/test-user.keytab.
Aug 12 00:02:40 dist-test-slave-f0tn krb5kdc[31348](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492960, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:02:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:02:40Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.11.206.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.11.206.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.11.206.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/krb5kdc/rangeradmin_127.11.206.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.11.206.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/krb5kdc/rangeradmin_127.11.206.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.11.206.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.11.206.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.11.206.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/krb5kdc/rangerlookup_127.11.206.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.11.206.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/krb5kdc/rangerlookup_127.11.206.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.11.206.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.11.206.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.11.206.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/krb5kdc/HTTP_127.11.206.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.11.206.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/krb5kdc/HTTP_127.11.206.84@KRBTEST.COM.keytab.
I20260812 00:02:40.401861 12089 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-tasksssay4/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/postgres -l logfile start
2026-08-12 00:02:42.649 UTC [31400] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-12 00:02:42.649 UTC [31400] LOG: listening on IPv4 address "127.11.206.84", port 53997
2026-08-12 00:02:42.652 UTC [31400] LOG: listening on Unix socket "/tmp/.s.PGSQL.53997"
2026-08-12 00:02:42.679 UTC [31403] LOG: database system was shut down at 2026-08-12 00:02:41 UTC
2026-08-12 00:02:42.683 UTC [31400] LOG: database system is ready to accept connections
I20260812 00:02:43.802884 12089 mini_postgres.cc:96] Postgres bound to 53997
2026-08-12 00:02:43.809 UTC [31424] FATAL: database "slave" does not exist
127.11.206.84:53997 - accepting connections
I20260812 00:02:43.810493 12089 mini_ranger.cc:161] Starting Ranger...
I20260812 00:02:43.826164 12089 mini_ranger.cc:84] Created miniranger Postgres user
I20260812 00:02:44.246215 12089 mini_ranger.cc:87] Created ranger Postgres database
I20260812 00:02:44.246299 12089 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/ranger-admin
2026-08-12 00:02:44,525 [I] DB FLAVOR :POSTGRES
2026-08-12 00:02:44,526 [I] --------- Verifying Ranger DB connection ---------
2026-08-12 00:02:44,526 [I] Checking connection..
2026-08-12 00:02:44,526 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksssay4/build/release/bin/postgresql.jar:/tmp/dist-test-tasksssay4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.206.84:53997/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-12 00:02:44,794 [I] Checking connection passed.
2026-08-12 00:02:44,795 [I] --------- Verifying version history table ---------
2026-08-12 00:02:44,795 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksssay4/build/release/bin/postgresql.jar:/tmp/dist-test-tasksssay4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.206.84:53997/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 00:02:45,073 [I] Table x_db_version_h does not exist in database ranger
2026-08-12 00:02:45,074 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksssay4/build/release/bin/postgresql.jar:/tmp/dist-test-tasksssay4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.206.84:53997/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 00:02:45,343 [I] Table x_db_version_h does not exist in database ranger
2026-08-12 00:02:45,343 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-12 00:02:45,343 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksssay4/build/release/bin/postgresql.jar:/tmp/dist-test-tasksssay4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.206.84:53997/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-tasksssay4/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-12 00:02:45.580 UTC [31561] WARNING: there is no transaction in progress
2026-08-12 00:02:45,589 [I] create_dbversion_catalog.sql file imported successfully
2026-08-12 00:02:45,589 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksssay4/build/release/bin/postgresql.jar:/tmp/dist-test-tasksssay4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.206.84:53997/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 00:02:45,857 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-12 00:02:45,857 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-12 00:02:45,857 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksssay4/build/release/bin/postgresql.jar:/tmp/dist-test-tasksssay4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.206.84:53997/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-12 00:02:46,093 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksssay4/build/release/bin/postgresql.jar:/tmp/dist-test-tasksssay4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.206.84:53997/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-12 00:02:46,340 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksssay4/build/release/bin/postgresql.jar:/tmp/dist-test-tasksssay4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.206.84:53997/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-f0tn.c.gcp-upstream.internal','N') ;"
2026-08-12 00:02:46,596 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksssay4/build/release/bin/postgresql.jar:/tmp/dist-test-tasksssay4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.206.84:53997/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-12 00:02:46,855 [I] Table x_portal_user does not exist in database ranger
2026-08-12 00:02:46,856 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksssay4/build/release/bin/postgresql.jar:/tmp/dist-test-tasksssay4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.206.84:53997/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-12 00:02:47,120 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-12 00:02:47,121 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksssay4/build/release/bin/postgresql.jar:/tmp/dist-test-tasksssay4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.206.84:53997/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-12 00:02:47,372 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksssay4/build/release/bin/postgresql.jar:/tmp/dist-test-tasksssay4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.206.84:53997/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-12 00:02:47,635 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-12 00:02:47,636 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksssay4/build/release/bin/postgresql.jar:/tmp/dist-test-tasksssay4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.206.84:53997/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-tasksssay4/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-12 00:02:48.563 UTC [31751] WARNING: there is no transaction in progress
2026-08-12 00:02:48.579 UTC [31751] WARNING: there is no transaction in progress
2026-08-12 00:02:48.603 UTC [31751] WARNING: there is no transaction in progress
2026-08-12 00:02:48.619 UTC [31751] WARNING: there is no transaction in progress
2026-08-12 00:02:48.635 UTC [31751] WARNING: there is no transaction in progress
2026-08-12 00:02:48.652 UTC [31751] WARNING: there is no transaction in progress
2026-08-12 00:02:48.715 UTC [31751] WARNING: there is no transaction in progress
2026-08-12 00:02:48.721 UTC [31751] WARNING: there is no transaction in progress
2026-08-12 00:02:48.735 UTC [31751] WARNING: there is no transaction in progress
2026-08-12 00:02:48.746 UTC [31751] WARNING: there is no transaction in progress
2026-08-12 00:02:48.761 UTC [31751] WARNING: there is no transaction in progress
2026-08-12 00:02:48.776 UTC [31751] WARNING: there is no transaction in progress
2026-08-12 00:02:48.788 UTC [31751] WARNING: there is no transaction in progress
2026-08-12 00:02:48.796 UTC [31751] WARNING: there is no transaction in progress
2026-08-12 00:02:48.803 UTC [31751] WARNING: there is no transaction in progress
2026-08-12 00:02:48.809 UTC [31751] WARNING: there is no transaction in progress
2026-08-12 00:02:49,399 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-12 00:02:49,399 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksssay4/build/release/bin/postgresql.jar:/tmp/dist-test-tasksssay4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.206.84:53997/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-12 00:02:49,636 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-12 00:02:49,636 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksssay4/build/release/bin/postgresql.jar:/tmp/dist-test-tasksssay4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.206.84:53997/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-12 00:02:49,902 [I] Table x_portal_user already exists in database 'ranger'
2026-08-12 00:02:49,902 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksssay4/build/release/bin/postgresql.jar:/tmp/dist-test-tasksssay4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.206.84:53997/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-12 00:02:50,148 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-12 00:02:50,148 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksssay4/build/release/bin/postgresql.jar:/tmp/dist-test-tasksssay4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.206.84:53997/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-12 00:02:50,402 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksssay4/build/release/bin/postgresql.jar:/tmp/dist-test-tasksssay4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.206.84:53997/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-12 00:02:50,663 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksssay4/build/release/bin/postgresql.jar:/tmp/dist-test-tasksssay4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.206.84:53997/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-f0tn.c.gcp-upstream.internal';"
2026-08-12 00:02:50,901 [I] CORE_DB_SCHEMA import status has been updated
2026-08-12 00:02:50,901 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksssay4/build/release/bin/postgresql.jar:/tmp/dist-test-tasksssay4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.206.84:53997/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-12 00:02:51,165 [I] DB_PATCHES have already been applied
I20260812 00:02:51.171128 12089 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/ranger-admin:/tmp/dist-test-tasksssay4/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-tasksssay4/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-tasksssay4/build/release/bin/postgresql.jar:/tmp/dist-test-tasksssay4/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260812 00:02:51.171200 12089 mini_ranger.cc:193] Using host: 127.11.206.84
I20260812 00:02:51.174589 12089 mini_ranger.cc:227] Ranger admin URL: http://127.11.206.84:44375
Aug 12, 2026 12:02:51 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 12, 2026 12:02:51 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 12, 2026 12:02:51 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/ranger-admin/ews/webapp
Aug 12, 2026 12:02:51 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 12, 2026 12:02:51 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 12, 2026 12:02:52 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/ranger-admin/ews/webapp].
Aug 12, 2026 12:02:52 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260812 00:02:52.450817 12089 mini_ranger.cc:160] Time spent starting Ranger: real 8.640s user 0.003s sys 0.007s
Aug 12, 2026 12:03:13 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 12, 2026 12:03:13 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Aug 12, 2026 12:03:13 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 12, 2026 12:03:13 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 12, 2026 12:03:13 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 12, 2026 12:03:13 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 12, 2026 12:03:13 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 12, 2026 12:03:13 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 12, 2026 12:03:13 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 12, 2026 12:03:13 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 12, 2026 12:03:13 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 12, 2026 12:03:13 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 12, 2026 12:03:13 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 12, 2026 12:03:13 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 12, 2026 12:03:13 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 12, 2026 12:03:13 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 12, 2026 12:03:13 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 12, 2026 12:03:14 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260812 00:03:15.047868 12089 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.11.206.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.11.206.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.11.206.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/krb5kdc/rangerkms_127.11.206.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.11.206.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/krb5kdc/rangerkms_127.11.206.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.11.206.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.11.206.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.11.206.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/krb5kdc/HTTP_127.11.206.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.11.206.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/krb5kdc/HTTP_127.11.206.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 12 00:03:15 dist-test-slave-f0tn krb5kdc[31348](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492995, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260812 00:03:15.129822 12089 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260812 00:03:15.140472 12089 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260812 00:03:15.852519 12089 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260812 00:03:15.852603 12089 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/ranger-kms
I20260812 00:03:15.852618 12089 mini_ranger_kms.cc:227] Using postgres at 127.11.206.84:53997
2026-08-12 00:03:16,647 [I] DB FLAVOR :POSTGRES
2026-08-12 00:03:16,647 [I] --------- Verifying Ranger DB connection ---------
2026-08-12 00:03:16,647 [I] Checking connection
2026-08-12 00:03:16,647 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksssay4/build/release/bin/postgresql.jar:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.206.84:53997/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-12 00:03:16,996 [I] connection success
2026-08-12 00:03:16,997 [I] --------- Verifying Ranger DB tables ---------
2026-08-12 00:03:16,997 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-12 00:03:16,997 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksssay4/build/release/bin/postgresql.jar:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.206.84:53997/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-12 00:03:17,264 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-12 00:03:17,265 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-12 00:03:17,265 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-12 00:03:17,265 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksssay4/build/release/bin/postgresql.jar:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.206.84:53997/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-12 00:03:17,522 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260812 00:03:17.987690 12089 mini_ranger_kms.cc:310] Created kms service
I20260812 00:03:18.233367 12089 mini_ranger_kms.cc:326] Created kudu user
I20260812 00:03:18.287863 12089 mini_ranger_kms.cc:343] Created rangerkms user
Aug 12 00:03:18 dist-test-slave-f0tn krb5kdc[31348](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786492995, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.11.206.84@KRBTEST.COM
I20260812 00:03:18.711800 12089 mini_ranger_kms.cc:384] Added ranger policy
I20260812 00:03:18.711912 12089 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/ranger-kms:/tmp/dist-test-tasksssay4/build/release/bin/postgresql.jar:/tmp/dist-test-tasksssay4/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-tasksssay4/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260812 00:03:18.711930 12089 mini_ranger_kms.cc:240] Using host: 127.11.206.84
I20260812 00:03:18.715900 12089 mini_ranger_kms.cc:276] Ranger KMS PID: 32070
I20260812 00:03:18.716029 12089 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.11.206.84:53303
Aug 12, 2026 12:03:20 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 12, 2026 12:03:20 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 12, 2026 12:03:21 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 12, 2026 12:03:21 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 12, 2026 12:03:21 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/ranger-kms/ews/webapp].
Aug 12, 2026 12:03:21 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 12 00:03:22 dist-test-slave-f0tn krb5kdc[31348](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786493002, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.11.206.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:03:22.186256 12089 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 7.056s user 0.000s sys 0.699s
I20260812 00:03:22.186363 12089 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260812 00:03:22.186437 12089 mini_ranger_kms.cc:401] 127.11.206.84:53303/kms/v1/keys
Aug 12 00:03:22 dist-test-slave-f0tn krb5kdc[31348](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493002, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.11.206.84@KRBTEST.COM for HTTP/127.11.206.84@KRBTEST.COM
Aug 12 00:03:22 dist-test-slave-f0tn krb5kdc[31348](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493002, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.11.206.84@KRBTEST.COM for HTTP/127.11.206.84@KRBTEST.COM
Aug 12 00:03:25 dist-test-slave-f0tn krb5kdc[31348](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493005, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.11.206.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab.
Entry for principal kudu/127.11.206.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab.
I20260812 00:03:25.493448 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:35629
--webserver_interface=127.11.206.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab
--principal=kudu/127.11.206.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:45399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.206.126:35629
--ranger_config_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.206.84:53303/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:03:25.607975 32171 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:03:25.608217 32171 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:03:25.608250 32171 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:03:25.609540 32171 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:03:25.609581 32171 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:03:25.609594 32171 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:03:25.609606 32171 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:03:25.609625 32171 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:03:25.611361 32171 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:45399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/master-0/wal
--ranger_kms_url=127.11.206.84:53303/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.11.206.126:35629
--ranger_config_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab
--principal=kudu/127.11.206.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:35629
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.206.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32171
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:03:25.611573 32171 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:03:25.611754 32171 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 00:03:25.617483 32171 server_base.cc:1034] running on GCE node
W20260812 00:03:25.617475 32179 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:03:25.617479 32185 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:03:25.617514 32181 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:03:25.617988 32171 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:03:25.618295 32171 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:03:25.619439 32171 hybrid_clock.cc:648] HybridClock initialized: now 1786493005619429 us; error 34 us; skew 500 ppm
Aug 12 00:03:25 dist-test-slave-f0tn krb5kdc[31348](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493005, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:03:25.625231 32171 init.cc:377] Logged in from keytab as kudu/127.11.206.126@KRBTEST.COM (short username kudu)
I20260812 00:03:25.625746 32171 webserver.cc:460] Webserver started at http://127.11.206.126:35227/ using document root <none> and password file <none>
I20260812 00:03:25.625955 32171 fs_manager.cc:359] Metadata directory not provided
I20260812 00:03:25.625995 32171 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:03:25.626120 32171 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 00:03:25 dist-test-slave-f0tn krb5kdc[31348](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493005, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.126@KRBTEST.COM for HTTP/127.11.206.84@KRBTEST.COM
I20260812 00:03:25.686239 32171 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/master-0/data/instance:
uuid: "7f6ec4e888f643b58bc932df4afc3c4a"
format_stamp: "Formatted at 2026-08-12 00:03:25 on dist-test-slave-f0tn"
server_key: "3a9fad8563ddd96b6aef1afac47a376c"
server_key_iv: "cc2481e2ae36f4a8c0863ec53b5c8549"
server_key_version: "kuduclusterkey@0"
I20260812 00:03:25.686815 32171 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/master-0/wal/instance:
uuid: "7f6ec4e888f643b58bc932df4afc3c4a"
format_stamp: "Formatted at 2026-08-12 00:03:25 on dist-test-slave-f0tn"
server_key: "3a9fad8563ddd96b6aef1afac47a376c"
server_key_iv: "cc2481e2ae36f4a8c0863ec53b5c8549"
server_key_version: "kuduclusterkey@0"
I20260812 00:03:25.688530 32171 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260812 00:03:25.704295 32192 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:03:25.704591 32171 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 00:03:25.704699 32171 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/master-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/master-0/wal
uuid: "7f6ec4e888f643b58bc932df4afc3c4a"
format_stamp: "Formatted at 2026-08-12 00:03:25 on dist-test-slave-f0tn"
server_key: "3a9fad8563ddd96b6aef1afac47a376c"
server_key_iv: "cc2481e2ae36f4a8c0863ec53b5c8549"
server_key_version: "kuduclusterkey@0"
I20260812 00:03:25.704805 32171 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:03:25.718360 32171 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:03:25.720331 32171 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:03:25.720533 32171 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:03:25.730506 32171 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.126:35629
I20260812 00:03:25.730602 32287 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.126:35629 every 8 connection(s)
I20260812 00:03:25.730962 32171 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
I20260812 00:03:25.732014 32288 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:03:25.736205 32288 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f6ec4e888f643b58bc932df4afc3c4a: Bootstrap starting.
I20260812 00:03:25.737562 32288 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7f6ec4e888f643b58bc932df4afc3c4a: Neither blocks nor log segments found. Creating new log.
I20260812 00:03:25.738335 32288 log.cc:824] T 00000000000000000000000000000000 P 7f6ec4e888f643b58bc932df4afc3c4a: Log is configured to *not* fsync() on all Append() calls
I20260812 00:03:25.739200 32288 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f6ec4e888f643b58bc932df4afc3c4a: No bootstrap required, opened a new log
I20260812 00:03:25.740101 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 32171
I20260812 00:03:25.740190 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/master-0/wal/instance
I20260812 00:03:25.740371 12089 external_mini_cluster.cc:1428] Setting key 10b587af49f7f34140c530d0ee501d46
I20260812 00:03:25.743163 32288 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7f6ec4e888f643b58bc932df4afc3c4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f6ec4e888f643b58bc932df4afc3c4a" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 35629 } }
I20260812 00:03:25.743347 32288 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7f6ec4e888f643b58bc932df4afc3c4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:03:25.743394 32288 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7f6ec4e888f643b58bc932df4afc3c4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f6ec4e888f643b58bc932df4afc3c4a, State: Initialized, Role: FOLLOWER
I20260812 00:03:25.743547 32288 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7f6ec4e888f643b58bc932df4afc3c4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f6ec4e888f643b58bc932df4afc3c4a" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 35629 } }
I20260812 00:03:25.743625 32288 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7f6ec4e888f643b58bc932df4afc3c4a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:03:25.743649 32288 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7f6ec4e888f643b58bc932df4afc3c4a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:03:25.743695 32288 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7f6ec4e888f643b58bc932df4afc3c4a [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:03:25.744637 32288 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7f6ec4e888f643b58bc932df4afc3c4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f6ec4e888f643b58bc932df4afc3c4a" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 35629 } }
I20260812 00:03:25.744741 32288 leader_election.cc:302] T 00000000000000000000000000000000 P 7f6ec4e888f643b58bc932df4afc3c4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7f6ec4e888f643b58bc932df4afc3c4a; no voters:
I20260812 00:03:25.744901 32288 leader_election.cc:288] T 00000000000000000000000000000000 P 7f6ec4e888f643b58bc932df4afc3c4a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:03:25.745028 32297 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7f6ec4e888f643b58bc932df4afc3c4a [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:03:25.745169 32288 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7f6ec4e888f643b58bc932df4afc3c4a [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:03:25.745185 32297 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7f6ec4e888f643b58bc932df4afc3c4a [term 1 LEADER]: Becoming Leader. State: Replica: 7f6ec4e888f643b58bc932df4afc3c4a, State: Running, Role: LEADER
I20260812 00:03:25.745302 32297 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7f6ec4e888f643b58bc932df4afc3c4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f6ec4e888f643b58bc932df4afc3c4a" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 35629 } }
I20260812 00:03:25.745682 32297 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f6ec4e888f643b58bc932df4afc3c4a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7f6ec4e888f643b58bc932df4afc3c4a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f6ec4e888f643b58bc932df4afc3c4a" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 35629 } } }
I20260812 00:03:25.745846 32301 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f6ec4e888f643b58bc932df4afc3c4a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7f6ec4e888f643b58bc932df4afc3c4a. Latest consensus state: current_term: 1 leader_uuid: "7f6ec4e888f643b58bc932df4afc3c4a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f6ec4e888f643b58bc932df4afc3c4a" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 35629 } } }
I20260812 00:03:25.745885 32297 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f6ec4e888f643b58bc932df4afc3c4a [sys.catalog]: This master's current role is: LEADER
I20260812 00:03:25.746019 32301 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f6ec4e888f643b58bc932df4afc3c4a [sys.catalog]: This master's current role is: LEADER
I20260812 00:03:25.746384 32304 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:03:25.748445 32304 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:03:25.749322 32288 ranger_client.cc:318] Using new properties file: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
Aug 12 00:03:25 dist-test-slave-f0tn krb5kdc[31348](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493005, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:03:25.756649 32304 catalog_manager.cc:1347] Generated new cluster ID: 564214d92bdc4770bc1f9f9c755be14a
I20260812 00:03:25.756886 32304 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:03:25.760216 32296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:25.740900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59470 (local address 127.11.206.126:35629)
0812 00:03:25.741203 (+ 303us) server_negotiation.cc:206] Beginning negotiation
0812 00:03:25.741214 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 00:03:25.741273 (+ 59us) server_negotiation.cc:407] Connection header received
0812 00:03:25.743177 (+ 1904us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:03:25.743187 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:03:25.743255 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:03:25.743415 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:03:25.744173 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:25.745954 (+ 1781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:25.747477 (+ 1523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:25.748095 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:25.748646 (+ 551us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:25.752318 (+ 3672us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:03:25.752485 (+ 167us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:03:25.752485 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:03:25.752755 (+ 270us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:03:25.757853 (+ 5098us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:03:25.758308 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:03:25.758312 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:03:25.758312 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:03:25.758504 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:03:25.758742 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:03:25.758743 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:03:25.758743 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:03:25.759055 (+ 312us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:03:25.759640 (+ 585us) server_negotiation.cc:1035] Waiting for connection context
0812 00:03:25.759725 (+ 85us) server_negotiation.cc:299] Negotiation successful
0812 00:03:25.759878 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":222,"thread_start_us":95,"threads_started":1}
I20260812 00:03:25.765899 32304 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:03:25.766736 32304 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:03:25.775648 32304 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7f6ec4e888f643b58bc932df4afc3c4a: Generated new TSK 0
I20260812 00:03:25.775827 32304 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.206.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.65.keytab.
Entry for principal kudu/127.11.206.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.65.keytab.
I20260812 00:03:26.641727 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.206.84:53303/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.65:0
--local_ip_for_outbound_sockets=127.11.206.65
--webserver_interface=127.11.206.65
--webserver_port=0
--tserver_master_addrs=127.11.206.126:35629
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.65.keytab
--principal=kudu/127.11.206.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:45399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:03:26.784080 32359 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:03:26.784304 32359 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:03:26.784329 32359 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:03:26.785529 32359 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:03:26.785575 32359 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:03:26.785604 32359 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.65
I20260812 00:03:26.787305 32359 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:45399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.11.206.84:53303/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.65.keytab
--principal=kudu/127.11.206.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.206.65
--webserver_port=0
--tserver_master_addrs=127.11.206.126:35629
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32359
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.65
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:03:26.787563 32359 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:03:26.787920 32359 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:03:26.794891 32374 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:03:26.794891 32368 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:03:26.794992 32367 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:03:26.795650 32359 server_base.cc:1034] running on GCE node
I20260812 00:03:26.795855 32359 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:03:26.796087 32359 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:03:26.797235 32359 hybrid_clock.cc:648] HybridClock initialized: now 1786493006797224 us; error 27 us; skew 500 ppm
Aug 12 00:03:26 dist-test-slave-f0tn krb5kdc[31348](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493006, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:03:26.800115 32359 init.cc:377] Logged in from keytab as kudu/127.11.206.65@KRBTEST.COM (short username kudu)
I20260812 00:03:26.800568 32359 webserver.cc:460] Webserver started at http://127.11.206.65:46481/ using document root <none> and password file <none>
I20260812 00:03:26.800805 32359 fs_manager.cc:359] Metadata directory not provided
I20260812 00:03:26.800853 32359 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:03:26.801010 32359 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 00:03:26 dist-test-slave-f0tn krb5kdc[31348](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493006, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.65@KRBTEST.COM for HTTP/127.11.206.84@KRBTEST.COM
I20260812 00:03:26.815438 32359 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/ts-0/data/instance:
uuid: "a850c79ab36e43dea03f9a5f318e2d01"
format_stamp: "Formatted at 2026-08-12 00:03:26 on dist-test-slave-f0tn"
server_key: "b56a51dd6df5a6d251d6d291e2e40eeb"
server_key_iv: "b267c3e9303b6e8b25e231b16ed9df97"
server_key_version: "kuduclusterkey@0"
I20260812 00:03:26.816027 32359 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/ts-0/wal/instance:
uuid: "a850c79ab36e43dea03f9a5f318e2d01"
format_stamp: "Formatted at 2026-08-12 00:03:26 on dist-test-slave-f0tn"
server_key: "b56a51dd6df5a6d251d6d291e2e40eeb"
server_key_iv: "b267c3e9303b6e8b25e231b16ed9df97"
server_key_version: "kuduclusterkey@0"
I20260812 00:03:26.819500 32359 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.001s
I20260812 00:03:26.837520 32389 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:03:26.837797 32359 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.001s sys 0.000s
I20260812 00:03:26.838001 32359 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/ts-0/wal
uuid: "a850c79ab36e43dea03f9a5f318e2d01"
format_stamp: "Formatted at 2026-08-12 00:03:26 on dist-test-slave-f0tn"
server_key: "b56a51dd6df5a6d251d6d291e2e40eeb"
server_key_iv: "b267c3e9303b6e8b25e231b16ed9df97"
server_key_version: "kuduclusterkey@0"
I20260812 00:03:26.838201 32359 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:03:26.850656 32359 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:03:26.852574 32359 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:03:26.852706 32359 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:03:26.852993 32359 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:03:26.853428 32359 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:03:26.853471 32359 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:03:26.853502 32359 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:03:26.853526 32359 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:03:26.862591 32359 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.65:32791
I20260812 00:03:26.863119 32359 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
I20260812 00:03:26.865514 32617 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.65:32791 every 8 connection(s)
I20260812 00:03:26.870464 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 32359
I20260812 00:03:26.870573 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/ts-0/wal/instance
I20260812 00:03:26.870774 12089 external_mini_cluster.cc:1428] Setting key 9f407bf747df8cf87bfcf8bbc8ce24c1
Aug 12 00:03:26 dist-test-slave-f0tn krb5kdc[31348](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493006, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.65@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:03:26.875653 32622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:26.864152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:35629 (local address 127.11.206.65:56159)
0812 00:03:26.865741 (+ 1589us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:26.865781 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 00:03:26.866313 (+ 532us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:03:26.866598 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:03:26.866602 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:03:26.866815 (+ 213us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:03:26.867023 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:03:26.867028 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:03:26.868024 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:03:26.868025 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:03:26.868922 (+ 897us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:03:26.868926 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:03:26.869463 (+ 537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:03:26.869464 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:03:26.869567 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:26.870067 (+ 500us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:03:26.870075 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:03:26.871743 (+ 1668us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:03:26.873918 (+ 2175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:03:26.873925 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:03:26.873928 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:03:26.874208 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:03:26.874471 (+ 263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:03:26.874472 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:03:26.874472 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:03:26.874622 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:03:26.874940 (+ 318us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:03:26.874947 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:03:26.875119 (+ 172us) client_negotiation.cc:769] Sending connection context
0812 00:03:26.875232 (+ 113us) client_negotiation.cc:240] Negotiation successful
0812 00:03:26.875385 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1553,"thread_start_us":87,"threads_started":1}
I20260812 00:03:26.876111 32621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:26.864195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.65:56159 (local address 127.11.206.126:35629)
0812 00:03:26.864307 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0812 00:03:26.864309 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:03:26.865874 (+ 1565us) server_negotiation.cc:407] Connection header received
0812 00:03:26.866428 (+ 554us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:03:26.866430 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:03:26.866446 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:03:26.866540 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:03:26.867130 (+ 590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:26.867923 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:26.869012 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:26.869327 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:26.869446 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:26.871862 (+ 2416us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:03:26.871863 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:03:26.871864 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:03:26.871872 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:03:26.873832 (+ 1960us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:03:26.874312 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:03:26.874314 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:03:26.874314 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:03:26.874387 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:03:26.874704 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:03:26.874705 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:03:26.874706 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:03:26.874858 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:03:26.874932 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0812 00:03:26.875925 (+ 993us) server_negotiation.cc:299] Negotiation successful
0812 00:03:26.876013 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88,"thread_start_us":52,"threads_started":1}
I20260812 00:03:26.877750 32618 heartbeater.cc:347] Connected to a master server at 127.11.206.126:35629
I20260812 00:03:26.877858 32618 heartbeater.cc:464] Registering TS with master...
I20260812 00:03:26.878052 32618 heartbeater.cc:511] Master 127.11.206.126:35629 requested a full tablet report, sending...
I20260812 00:03:26.878593 32222 ts_manager.cc:194] Registered new tserver with Master: a850c79ab36e43dea03f9a5f318e2d01 (127.11.206.65:32791)
I20260812 00:03:26.879179 32222 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.206.65@KRBTEST.COM'} at 127.11.206.65:56159
WARNING: no policy specified for kudu/127.11.206.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.66.keytab.
Entry for principal kudu/127.11.206.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.66.keytab.
I20260812 00:03:26.899560 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.206.84:53303/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.66:0
--local_ip_for_outbound_sockets=127.11.206.66
--webserver_interface=127.11.206.66
--webserver_port=0
--tserver_master_addrs=127.11.206.126:35629
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.66.keytab
--principal=kudu/127.11.206.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:45399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 00:03:27 dist-test-slave-f0tn krb5kdc[31348](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786493007, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260812 00:03:27.056782 32632 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:03:27.057168 32632 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:03:27.057237 32632 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:03:27.059170 32632 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:03:27.059269 32632 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:03:27.059360 32632 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.66
I20260812 00:03:27.061838 32632 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:45399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.11.206.84:53303/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.66.keytab
--principal=kudu/127.11.206.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.206.66
--webserver_port=0
--tserver_master_addrs=127.11.206.126:35629
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32632
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.66
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:03:27.062141 32632 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:03:27.062453 32632 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:03:27.071681 32644 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:03:27.072821 32640 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:03:27.073077 32632 server_base.cc:1034] running on GCE node
W20260812 00:03:27.073338 32641 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:03:27.073841 32632 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:03:27.074168 32632 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:03:27.075342 32632 hybrid_clock.cc:648] HybridClock initialized: now 1786493007075312 us; error 47 us; skew 500 ppm
Aug 12 00:03:27 dist-test-slave-f0tn krb5kdc[31348](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493007, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:03:27.079897 32632 init.cc:377] Logged in from keytab as kudu/127.11.206.66@KRBTEST.COM (short username kudu)
I20260812 00:03:27.080515 32632 webserver.cc:460] Webserver started at http://127.11.206.66:34005/ using document root <none> and password file <none>
I20260812 00:03:27.080848 32632 fs_manager.cc:359] Metadata directory not provided
I20260812 00:03:27.080983 32632 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:03:27.081146 32632 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 00:03:27 dist-test-slave-f0tn krb5kdc[31348](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493007, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.66@KRBTEST.COM for HTTP/127.11.206.84@KRBTEST.COM
I20260812 00:03:27.105471 32632 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/ts-1/data/instance:
uuid: "0f932c672cb94de8aac6f694d713d738"
format_stamp: "Formatted at 2026-08-12 00:03:27 on dist-test-slave-f0tn"
server_key: "e80b15fd6d65330906b5c6d80918595e"
server_key_iv: "126647aaa84e140686416f0a295335e4"
server_key_version: "kuduclusterkey@0"
I20260812 00:03:27.106017 32632 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/ts-1/wal/instance:
uuid: "0f932c672cb94de8aac6f694d713d738"
format_stamp: "Formatted at 2026-08-12 00:03:27 on dist-test-slave-f0tn"
server_key: "e80b15fd6d65330906b5c6d80918595e"
server_key_iv: "126647aaa84e140686416f0a295335e4"
server_key_version: "kuduclusterkey@0"
I20260812 00:03:27.110113 32632 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.002s
I20260812 00:03:27.130326 32655 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:03:27.130556 32632 fs_manager.cc:725] Time spent opening block manager: real 0.007s user 0.001s sys 0.000s
I20260812 00:03:27.130672 32632 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/ts-1/wal
uuid: "0f932c672cb94de8aac6f694d713d738"
format_stamp: "Formatted at 2026-08-12 00:03:27 on dist-test-slave-f0tn"
server_key: "e80b15fd6d65330906b5c6d80918595e"
server_key_iv: "126647aaa84e140686416f0a295335e4"
server_key_version: "kuduclusterkey@0"
I20260812 00:03:27.130793 32632 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:03:27.144310 32632 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:03:27.147264 32632 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:03:27.147467 32632 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:03:27.147800 32632 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:03:27.148248 32632 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:03:27.148298 32632 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:03:27.148329 32632 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:03:27.148351 32632 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:03:27.164069 32632 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.66:40663
I20260812 00:03:27.164683 32632 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
I20260812 00:03:27.166994 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 32632
I20260812 00:03:27.167104 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/ts-1/wal/instance
I20260812 00:03:27.167291 12089 external_mini_cluster.cc:1428] Setting key c2213fd7474f19232c9fecf223327374
I20260812 00:03:27.173938 396 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.66:40663 every 8 connection(s)
Aug 12 00:03:27 dist-test-slave-f0tn krb5kdc[31348](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493007, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.66@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:03:27.188858 32621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:27.175299 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.66:35599 (local address 127.11.206.126:35629)
0812 00:03:27.175351 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0812 00:03:27.175353 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:03:27.177194 (+ 1841us) server_negotiation.cc:407] Connection header received
0812 00:03:27.178209 (+ 1015us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:03:27.178211 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:03:27.178240 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:03:27.178270 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:03:27.179366 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:27.180159 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:27.181807 (+ 1648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:27.182176 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:27.182236 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:27.185243 (+ 3007us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:03:27.185245 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:03:27.185245 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:03:27.185253 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:03:27.187249 (+ 1996us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:03:27.187735 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:03:27.187737 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:03:27.187738 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:03:27.187798 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:03:27.188065 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:03:27.188066 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:03:27.188066 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:03:27.188205 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:03:27.188260 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0812 00:03:27.188639 (+ 379us) server_negotiation.cc:299] Negotiation successful
0812 00:03:27.188733 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 00:03:27.189728 406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:27.174984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:35629 (local address 127.11.206.66:35599)
0812 00:03:27.177049 (+ 2065us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:27.177100 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0812 00:03:27.178079 (+ 979us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:03:27.178467 (+ 388us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:03:27.178472 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:03:27.178938 (+ 466us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:03:27.179254 (+ 316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:03:27.179261 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:03:27.180284 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:03:27.180285 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:03:27.181683 (+ 1398us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:03:27.181687 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:03:27.182337 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:03:27.182338 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:03:27.182539 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:27.183265 (+ 726us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:03:27.183276 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:03:27.185117 (+ 1841us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:03:27.187340 (+ 2223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:03:27.187348 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:03:27.187350 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:03:27.187642 (+ 292us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:03:27.187864 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:03:27.187865 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:03:27.187865 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:03:27.187994 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:03:27.188307 (+ 313us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:03:27.188314 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:03:27.188486 (+ 172us) client_negotiation.cc:769] Sending connection context
0812 00:03:27.189264 (+ 778us) client_negotiation.cc:240] Negotiation successful
0812 00:03:27.189480 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2009,"thread_start_us":107,"threads_started":1}
I20260812 00:03:27.190501 397 heartbeater.cc:347] Connected to a master server at 127.11.206.126:35629
I20260812 00:03:27.190608 397 heartbeater.cc:464] Registering TS with master...
I20260812 00:03:27.190801 397 heartbeater.cc:511] Master 127.11.206.126:35629 requested a full tablet report, sending...
I20260812 00:03:27.191192 32222 ts_manager.cc:194] Registered new tserver with Master: 0f932c672cb94de8aac6f694d713d738 (127.11.206.66:40663)
WARNING: no policy specified for kudu/127.11.206.67@KRBTEST.COM; defaulting to no policy
I20260812 00:03:27.191702 32222 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.206.66@KRBTEST.COM'} at 127.11.206.66:35599
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.67.keytab.
Entry for principal kudu/127.11.206.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.67.keytab.
I20260812 00:03:27.216780 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.206.84:53303/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.67:0
--local_ip_for_outbound_sockets=127.11.206.67
--webserver_interface=127.11.206.67
--webserver_port=0
--tserver_master_addrs=127.11.206.126:35629
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.67.keytab
--principal=kudu/127.11.206.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:45399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:03:27.348304 410 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:03:27.348539 410 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:03:27.348575 410 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:03:27.349987 410 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:03:27.350034 410 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:03:27.350075 410 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.67
I20260812 00:03:27.351769 410 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:45399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.11.206.84:53303/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.67.keytab
--principal=kudu/127.11.206.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.206.67
--webserver_port=0
--tserver_master_addrs=127.11.206.126:35629
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.410
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.67
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:03:27.352025 410 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:03:27.352277 410 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:03:27.360128 421 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:03:27.361136 426 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:03:27.361801 422 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:03:27.362509 410 server_base.cc:1034] running on GCE node
I20260812 00:03:27.362816 410 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:03:27.363152 410 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:03:27.364339 410 hybrid_clock.cc:648] HybridClock initialized: now 1786493007364314 us; error 39 us; skew 500 ppm
Aug 12 00:03:27 dist-test-slave-f0tn krb5kdc[31348](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493007, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:03:27.368749 410 init.cc:377] Logged in from keytab as kudu/127.11.206.67@KRBTEST.COM (short username kudu)
I20260812 00:03:27.369352 410 webserver.cc:460] Webserver started at http://127.11.206.67:33917/ using document root <none> and password file <none>
I20260812 00:03:27.369674 410 fs_manager.cc:359] Metadata directory not provided
I20260812 00:03:27.369776 410 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:03:27.369930 410 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 00:03:27 dist-test-slave-f0tn krb5kdc[31348](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493007, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.67@KRBTEST.COM for HTTP/127.11.206.84@KRBTEST.COM
I20260812 00:03:27.384752 410 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/ts-2/data/instance:
uuid: "7df252c036c84ba1909bc41b8220ebd9"
format_stamp: "Formatted at 2026-08-12 00:03:27 on dist-test-slave-f0tn"
server_key: "2c5527934207e10ca2b1e65f6dc96994"
server_key_iv: "22b3db2d3cd101f5bf1cbed2eca86538"
server_key_version: "kuduclusterkey@0"
I20260812 00:03:27.385229 410 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/ts-2/wal/instance:
uuid: "7df252c036c84ba1909bc41b8220ebd9"
format_stamp: "Formatted at 2026-08-12 00:03:27 on dist-test-slave-f0tn"
server_key: "2c5527934207e10ca2b1e65f6dc96994"
server_key_iv: "22b3db2d3cd101f5bf1cbed2eca86538"
server_key_version: "kuduclusterkey@0"
I20260812 00:03:27.390704 410 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.001s
I20260812 00:03:27.409930 439 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:03:27.410148 410 fs_manager.cc:725] Time spent opening block manager: real 0.008s user 0.001s sys 0.000s
I20260812 00:03:27.410264 410 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/ts-2/wal
uuid: "7df252c036c84ba1909bc41b8220ebd9"
format_stamp: "Formatted at 2026-08-12 00:03:27 on dist-test-slave-f0tn"
server_key: "2c5527934207e10ca2b1e65f6dc96994"
server_key_iv: "22b3db2d3cd101f5bf1cbed2eca86538"
server_key_version: "kuduclusterkey@0"
I20260812 00:03:27.410384 410 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:03:27.461236 410 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:03:27.463436 410 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:03:27.463582 410 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:03:27.463857 410 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:03:27.464262 410 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:03:27.464300 410 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:03:27.464331 410 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:03:27.464358 410 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:03:27.478312 410 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.67:41895
I20260812 00:03:27.478448 659 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.67:41895 every 8 connection(s)
I20260812 00:03:27.478767 410 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
I20260812 00:03:27.486439 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 410
I20260812 00:03:27.486550 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/ts-2/wal/instance
I20260812 00:03:27.486735 12089 external_mini_cluster.cc:1428] Setting key 067f0db9682dcb26889bcc7547e343be
Aug 12 00:03:27 dist-test-slave-f0tn krb5kdc[31348](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493007, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.67@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:03:27.491173 32621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:27.479789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.67:53695 (local address 127.11.206.126:35629)
0812 00:03:27.479857 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0812 00:03:27.479861 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:03:27.480286 (+ 425us) server_negotiation.cc:407] Connection header received
0812 00:03:27.481537 (+ 1251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:03:27.481538 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:03:27.481549 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:03:27.481608 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:03:27.482841 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:27.483404 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:27.485157 (+ 1753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:27.485368 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:27.485474 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:27.488425 (+ 2951us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:03:27.488427 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:03:27.488427 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:03:27.488434 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:03:27.489833 (+ 1399us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:03:27.490239 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:03:27.490241 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:03:27.490241 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:03:27.490300 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:03:27.490532 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:03:27.490533 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:03:27.490533 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:03:27.490658 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:03:27.490716 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0812 00:03:27.490992 (+ 276us) server_negotiation.cc:299] Negotiation successful
0812 00:03:27.491079 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260812 00:03:27.491413 666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:27.479754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:35629 (local address 127.11.206.67:53695)
0812 00:03:27.480089 (+ 335us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:27.480156 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0812 00:03:27.481300 (+ 1144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:03:27.481739 (+ 439us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:03:27.481744 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:03:27.482267 (+ 523us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:03:27.482730 (+ 463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:03:27.482740 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:03:27.483494 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:03:27.483495 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:03:27.485019 (+ 1524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:03:27.485022 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:03:27.485490 (+ 468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:03:27.485491 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:03:27.485709 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:27.486476 (+ 767us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:03:27.486488 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:03:27.488340 (+ 1852us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:03:27.489909 (+ 1569us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:03:27.489916 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:03:27.489919 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:03:27.490170 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:03:27.490356 (+ 186us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:03:27.490357 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:03:27.490357 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:03:27.490477 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:03:27.490717 (+ 240us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:03:27.490724 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:03:27.490874 (+ 150us) client_negotiation.cc:769] Sending connection context
0812 00:03:27.490965 (+ 91us) client_negotiation.cc:240] Negotiation successful
0812 00:03:27.491136 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":185,"threads_started":1}
I20260812 00:03:27.491927 660 heartbeater.cc:347] Connected to a master server at 127.11.206.126:35629
I20260812 00:03:27.492018 660 heartbeater.cc:464] Registering TS with master...
I20260812 00:03:27.492206 660 heartbeater.cc:511] Master 127.11.206.126:35629 requested a full tablet report, sending...
I20260812 00:03:27.492609 32222 ts_manager.cc:194] Registered new tserver with Master: 7df252c036c84ba1909bc41b8220ebd9 (127.11.206.67:41895)
I20260812 00:03:27.493145 32222 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.206.67@KRBTEST.COM'} at 127.11.206.67:53695
I20260812 00:03:27.499007 12089 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:03:27.516785 32621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:27.500878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59484 (local address 127.11.206.126:35629)
0812 00:03:27.500924 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0812 00:03:27.500926 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:03:27.501175 (+ 249us) server_negotiation.cc:407] Connection header received
0812 00:03:27.510639 (+ 9464us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:03:27.510641 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:03:27.510653 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:03:27.510705 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:03:27.511429 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:27.511967 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:27.512716 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:27.512913 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:27.512973 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:27.514391 (+ 1418us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:03:27.514392 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:03:27.514392 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:03:27.514400 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:03:27.515720 (+ 1320us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:03:27.516056 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:03:27.516057 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:03:27.516058 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:03:27.516112 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:03:27.516284 (+ 172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:03:27.516285 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:03:27.516286 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:03:27.516393 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:03:27.516487 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0812 00:03:27.516611 (+ 124us) server_negotiation.cc:299] Negotiation successful
0812 00:03:27.516689 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 00:03:27.518589 32222 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59484:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:03:27.521092 32222 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:03:27.535357 685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:27.524684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.66:40663 (local address 127.0.0.1:50958)
0812 00:03:27.529539 (+ 4855us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:27.529552 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 00:03:27.529618 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:03:27.530230 (+ 612us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:03:27.530234 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:03:27.530237 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:03:27.530318 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:03:27.530320 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:03:27.531929 (+ 1609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:03:27.531931 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:03:27.533658 (+ 1727us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:03:27.533661 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:03:27.535052 (+ 1391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:03:27.535053 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:03:27.535150 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:27.535168 (+ 18us) client_negotiation.cc:769] Sending connection context
0812 00:03:27.535223 (+ 55us) client_negotiation.cc:240] Negotiation successful
0812 00:03:27.535275 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4814,"thread_start_us":682,"threads_started":1}
I20260812 00:03:27.536598 692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:27.525566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50958 (local address 127.11.206.66:40663)
0812 00:03:27.525932 (+ 366us) server_negotiation.cc:206] Beginning negotiation
0812 00:03:27.525937 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:03:27.529631 (+ 3694us) server_negotiation.cc:407] Connection header received
0812 00:03:27.530037 (+ 406us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:03:27.530040 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:03:27.530059 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:03:27.530405 (+ 346us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:03:27.530519 (+ 114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:27.531825 (+ 1306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:27.533902 (+ 2077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:27.534956 (+ 1054us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:27.536228 (+ 1272us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:27.536396 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0812 00:03:27.536426 (+ 30us) server_negotiation.cc:299] Negotiation successful
0812 00:03:27.536468 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":301,"thread_start_us":193,"threads_started":1}
I20260812 00:03:27.537711 32743 tablet_service.cc:1467] Processing CreateTablet for tablet 184b252545f4443c935879394450bd2b (DEFAULT_TABLE table=test-table [id=1fe3e12246324a8cb13fef04ce58e9ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:03:27.538130 32743 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 184b252545f4443c935879394450bd2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:03:27.538630 694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:27.525876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53274 (local address 127.11.206.65:32791)
0812 00:03:27.525998 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0812 00:03:27.526003 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:03:27.529806 (+ 3803us) server_negotiation.cc:407] Connection header received
0812 00:03:27.530257 (+ 451us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:03:27.530259 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:03:27.530274 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:03:27.530325 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:03:27.530527 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:27.531841 (+ 1314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:27.534877 (+ 3036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:27.535797 (+ 920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:27.535847 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:27.535911 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0812 00:03:27.538437 (+ 2526us) server_negotiation.cc:299] Negotiation successful
0812 00:03:27.538525 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94,"thread_start_us":56,"threads_started":1}
I20260812 00:03:27.538856 688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:27.524827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.65:32791 (local address 127.0.0.1:53274)
0812 00:03:27.529742 (+ 4915us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:27.529750 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 00:03:27.530168 (+ 418us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:03:27.530410 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:03:27.530411 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:03:27.530413 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:03:27.530457 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:03:27.530458 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:03:27.531942 (+ 1484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:03:27.531942 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:03:27.534769 (+ 2827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:03:27.534773 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:03:27.535973 (+ 1200us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:03:27.535974 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:03:27.536052 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:27.536056 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:03:27.538737 (+ 2681us) client_negotiation.cc:240] Negotiation successful
0812 00:03:27.538787 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4878,"mutex_wait_us":1581,"thread_start_us":125,"threads_started":1}
I20260812 00:03:27.539340 690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:27.524682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.67:41895 (local address 127.0.0.1:56764)
0812 00:03:27.525571 (+ 889us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:27.525618 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0812 00:03:27.525703 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:03:27.532204 (+ 6501us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:03:27.532205 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:03:27.532207 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:03:27.532244 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:03:27.532246 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:03:27.536143 (+ 3897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:03:27.536144 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:03:27.537210 (+ 1066us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:03:27.537213 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:03:27.539123 (+ 1910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:03:27.539124 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:03:27.539189 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:27.539193 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:03:27.539224 (+ 31us) client_negotiation.cc:240] Negotiation successful
0812 00:03:27.539270 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":824,"thread_start_us":765,"threads_started":1}
I20260812 00:03:27.539853 686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:27.524964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56764 (local address 127.11.206.67:41895)
0812 00:03:27.529975 (+ 5011us) server_negotiation.cc:206] Beginning negotiation
0812 00:03:27.529979 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:03:27.529988 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:03:27.530058 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:03:27.530060 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:03:27.530078 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:03:27.532313 (+ 2235us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:03:27.532448 (+ 135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:27.533648 (+ 1200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:27.537452 (+ 3804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:27.538323 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:27.539522 (+ 1199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:27.539696 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0812 00:03:27.539727 (+ 31us) server_negotiation.cc:299] Negotiation successful
0812 00:03:27.539767 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4955,"thread_start_us":170,"threads_started":1}
I20260812 00:03:27.540539 523 tablet_service.cc:1467] Processing CreateTablet for tablet 184b252545f4443c935879394450bd2b (DEFAULT_TABLE table=test-table [id=1fe3e12246324a8cb13fef04ce58e9ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:03:27.540863 523 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 184b252545f4443c935879394450bd2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:03:27.545621 695 tablet_bootstrap.cc:492] T 184b252545f4443c935879394450bd2b P 7df252c036c84ba1909bc41b8220ebd9: Bootstrap starting.
I20260812 00:03:27.545192 32474 tablet_service.cc:1467] Processing CreateTablet for tablet 184b252545f4443c935879394450bd2b (DEFAULT_TABLE table=test-table [id=1fe3e12246324a8cb13fef04ce58e9ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:03:27.546005 32474 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 184b252545f4443c935879394450bd2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:03:27.547597 695 tablet_bootstrap.cc:654] T 184b252545f4443c935879394450bd2b P 7df252c036c84ba1909bc41b8220ebd9: Neither blocks nor log segments found. Creating new log.
I20260812 00:03:27.548689 695 log.cc:824] T 184b252545f4443c935879394450bd2b P 7df252c036c84ba1909bc41b8220ebd9: Log is configured to *not* fsync() on all Append() calls
I20260812 00:03:27.549162 696 tablet_bootstrap.cc:492] T 184b252545f4443c935879394450bd2b P 0f932c672cb94de8aac6f694d713d738: Bootstrap starting.
I20260812 00:03:27.550797 696 tablet_bootstrap.cc:654] T 184b252545f4443c935879394450bd2b P 0f932c672cb94de8aac6f694d713d738: Neither blocks nor log segments found. Creating new log.
I20260812 00:03:27.551523 696 log.cc:824] T 184b252545f4443c935879394450bd2b P 0f932c672cb94de8aac6f694d713d738: Log is configured to *not* fsync() on all Append() calls
I20260812 00:03:27.552603 695 tablet_bootstrap.cc:492] T 184b252545f4443c935879394450bd2b P 7df252c036c84ba1909bc41b8220ebd9: No bootstrap required, opened a new log
I20260812 00:03:27.552680 695 ts_tablet_manager.cc:1397] T 184b252545f4443c935879394450bd2b P 7df252c036c84ba1909bc41b8220ebd9: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260812 00:03:27.552841 696 tablet_bootstrap.cc:492] T 184b252545f4443c935879394450bd2b P 0f932c672cb94de8aac6f694d713d738: No bootstrap required, opened a new log
I20260812 00:03:27.552903 696 ts_tablet_manager.cc:1397] T 184b252545f4443c935879394450bd2b P 0f932c672cb94de8aac6f694d713d738: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260812 00:03:27.556412 696 raft_consensus.cc:348] T 184b252545f4443c935879394450bd2b P 0f932c672cb94de8aac6f694d713d738 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f932c672cb94de8aac6f694d713d738" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 40663 } } peers { permanent_uuid: "7df252c036c84ba1909bc41b8220ebd9" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 41895 } } peers { permanent_uuid: "a850c79ab36e43dea03f9a5f318e2d01" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 32791 } }
I20260812 00:03:27.556617 696 raft_consensus.cc:374] T 184b252545f4443c935879394450bd2b P 0f932c672cb94de8aac6f694d713d738 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:03:27.556660 696 raft_consensus.cc:729] T 184b252545f4443c935879394450bd2b P 0f932c672cb94de8aac6f694d713d738 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f932c672cb94de8aac6f694d713d738, State: Initialized, Role: FOLLOWER
I20260812 00:03:27.556536 695 raft_consensus.cc:348] T 184b252545f4443c935879394450bd2b P 7df252c036c84ba1909bc41b8220ebd9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f932c672cb94de8aac6f694d713d738" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 40663 } } peers { permanent_uuid: "7df252c036c84ba1909bc41b8220ebd9" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 41895 } } peers { permanent_uuid: "a850c79ab36e43dea03f9a5f318e2d01" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 32791 } }
I20260812 00:03:27.556902 698 tablet_bootstrap.cc:492] T 184b252545f4443c935879394450bd2b P a850c79ab36e43dea03f9a5f318e2d01: Bootstrap starting.
I20260812 00:03:27.557080 695 raft_consensus.cc:374] T 184b252545f4443c935879394450bd2b P 7df252c036c84ba1909bc41b8220ebd9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:03:27.557179 695 raft_consensus.cc:729] T 184b252545f4443c935879394450bd2b P 7df252c036c84ba1909bc41b8220ebd9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7df252c036c84ba1909bc41b8220ebd9, State: Initialized, Role: FOLLOWER
I20260812 00:03:27.557359 695 consensus_queue.cc:260] T 184b252545f4443c935879394450bd2b P 7df252c036c84ba1909bc41b8220ebd9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f932c672cb94de8aac6f694d713d738" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 40663 } } peers { permanent_uuid: "7df252c036c84ba1909bc41b8220ebd9" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 41895 } } peers { permanent_uuid: "a850c79ab36e43dea03f9a5f318e2d01" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 32791 } }
I20260812 00:03:27.558024 695 ts_tablet_manager.cc:1428] T 184b252545f4443c935879394450bd2b P 7df252c036c84ba1909bc41b8220ebd9: Time spent starting tablet: real 0.005s user 0.000s sys 0.004s
I20260812 00:03:27.558231 660 heartbeater.cc:503] Master 127.11.206.126:35629 was elected leader, sending a full tablet report...
I20260812 00:03:27.558542 696 consensus_queue.cc:260] T 184b252545f4443c935879394450bd2b P 0f932c672cb94de8aac6f694d713d738 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f932c672cb94de8aac6f694d713d738" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 40663 } } peers { permanent_uuid: "7df252c036c84ba1909bc41b8220ebd9" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 41895 } } peers { permanent_uuid: "a850c79ab36e43dea03f9a5f318e2d01" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 32791 } }
I20260812 00:03:27.558924 696 ts_tablet_manager.cc:1428] T 184b252545f4443c935879394450bd2b P 0f932c672cb94de8aac6f694d713d738: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260812 00:03:27.559067 397 heartbeater.cc:503] Master 127.11.206.126:35629 was elected leader, sending a full tablet report...
I20260812 00:03:27.559757 698 tablet_bootstrap.cc:654] T 184b252545f4443c935879394450bd2b P a850c79ab36e43dea03f9a5f318e2d01: Neither blocks nor log segments found. Creating new log.
I20260812 00:03:27.560722 698 log.cc:824] T 184b252545f4443c935879394450bd2b P a850c79ab36e43dea03f9a5f318e2d01: Log is configured to *not* fsync() on all Append() calls
I20260812 00:03:27.562587 698 tablet_bootstrap.cc:492] T 184b252545f4443c935879394450bd2b P a850c79ab36e43dea03f9a5f318e2d01: No bootstrap required, opened a new log
I20260812 00:03:27.562669 698 ts_tablet_manager.cc:1397] T 184b252545f4443c935879394450bd2b P a850c79ab36e43dea03f9a5f318e2d01: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.003s
I20260812 00:03:27.566344 698 raft_consensus.cc:348] T 184b252545f4443c935879394450bd2b P a850c79ab36e43dea03f9a5f318e2d01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f932c672cb94de8aac6f694d713d738" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 40663 } } peers { permanent_uuid: "7df252c036c84ba1909bc41b8220ebd9" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 41895 } } peers { permanent_uuid: "a850c79ab36e43dea03f9a5f318e2d01" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 32791 } }
I20260812 00:03:27.566497 698 raft_consensus.cc:374] T 184b252545f4443c935879394450bd2b P a850c79ab36e43dea03f9a5f318e2d01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:03:27.566533 698 raft_consensus.cc:729] T 184b252545f4443c935879394450bd2b P a850c79ab36e43dea03f9a5f318e2d01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a850c79ab36e43dea03f9a5f318e2d01, State: Initialized, Role: FOLLOWER
I20260812 00:03:27.566697 698 consensus_queue.cc:260] T 184b252545f4443c935879394450bd2b P a850c79ab36e43dea03f9a5f318e2d01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f932c672cb94de8aac6f694d713d738" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 40663 } } peers { permanent_uuid: "7df252c036c84ba1909bc41b8220ebd9" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 41895 } } peers { permanent_uuid: "a850c79ab36e43dea03f9a5f318e2d01" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 32791 } }
I20260812 00:03:27.567086 32618 heartbeater.cc:503] Master 127.11.206.126:35629 was elected leader, sending a full tablet report...
I20260812 00:03:27.567332 698 ts_tablet_manager.cc:1428] T 184b252545f4443c935879394450bd2b P a850c79ab36e43dea03f9a5f318e2d01: Time spent starting tablet: real 0.005s user 0.000s sys 0.005s
W20260812 00:03:27.616214 32620 tablet.cc:2369] T 184b252545f4443c935879394450bd2b P a850c79ab36e43dea03f9a5f318e2d01: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 00:03:27.675864 398 tablet.cc:2369] T 184b252545f4443c935879394450bd2b P 0f932c672cb94de8aac6f694d713d738: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 12 00:03:27 dist-test-slave-f0tn krb5kdc[31348](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493007, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.126@KRBTEST.COM for HTTP/127.11.206.84@KRBTEST.COM
I20260812 00:03:27.733657 702 raft_consensus.cc:482] T 184b252545f4443c935879394450bd2b P 0f932c672cb94de8aac6f694d713d738 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 00:03:27.733733 662 tablet.cc:2369] T 184b252545f4443c935879394450bd2b P 7df252c036c84ba1909bc41b8220ebd9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:03:27.733815 702 raft_consensus.cc:504] T 184b252545f4443c935879394450bd2b P 0f932c672cb94de8aac6f694d713d738 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f932c672cb94de8aac6f694d713d738" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 40663 } } peers { permanent_uuid: "7df252c036c84ba1909bc41b8220ebd9" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 41895 } } peers { permanent_uuid: "a850c79ab36e43dea03f9a5f318e2d01" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 32791 } }
I20260812 00:03:27.734247 702 leader_election.cc:288] T 184b252545f4443c935879394450bd2b P 0f932c672cb94de8aac6f694d713d738 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7df252c036c84ba1909bc41b8220ebd9 (127.11.206.67:41895), a850c79ab36e43dea03f9a5f318e2d01 (127.11.206.65:32791)
I20260812 00:03:27.739665 694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:27.735235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.66:45217 (local address 127.11.206.65:32791)
0812 00:03:27.735286 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0812 00:03:27.735288 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:03:27.735493 (+ 205us) server_negotiation.cc:407] Connection header received
0812 00:03:27.735578 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:03:27.735579 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:03:27.735588 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:03:27.735615 (+ 27us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:03:27.735921 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:27.736737 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:27.738342 (+ 1605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:27.739194 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:27.739245 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:27.739255 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0812 00:03:27.739540 (+ 285us) server_negotiation.cc:299] Negotiation successful
0812 00:03:27.739590 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 00:03:27.740136 705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:27.734793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.65:32791 (local address 127.11.206.66:45217)
0812 00:03:27.735446 (+ 653us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:27.735453 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0812 00:03:27.735512 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:03:27.735676 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:03:27.735676 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:03:27.735678 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:03:27.735827 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:03:27.735830 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:03:27.736876 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:03:27.736877 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:03:27.738136 (+ 1259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:03:27.738139 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:03:27.739324 (+ 1185us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:03:27.739325 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:03:27.739452 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:27.739457 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 00:03:27.739980 (+ 523us) client_negotiation.cc:240] Negotiation successful
0812 00:03:27.740032 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":645,"thread_start_us":51,"threads_started":1}
I20260812 00:03:27.740620 32514 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "184b252545f4443c935879394450bd2b" candidate_uuid: "0f932c672cb94de8aac6f694d713d738" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a850c79ab36e43dea03f9a5f318e2d01" is_pre_election: true
I20260812 00:03:27.740787 32514 raft_consensus.cc:2454] T 184b252545f4443c935879394450bd2b P a850c79ab36e43dea03f9a5f318e2d01 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f932c672cb94de8aac6f694d713d738 in term 0.
I20260812 00:03:27.741106 32660 leader_election.cc:302] T 184b252545f4443c935879394450bd2b P 0f932c672cb94de8aac6f694d713d738 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f932c672cb94de8aac6f694d713d738, a850c79ab36e43dea03f9a5f318e2d01; no voters:
I20260812 00:03:27.741247 702 raft_consensus.cc:2781] T 184b252545f4443c935879394450bd2b P 0f932c672cb94de8aac6f694d713d738 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:03:27.741284 702 raft_consensus.cc:482] T 184b252545f4443c935879394450bd2b P 0f932c672cb94de8aac6f694d713d738 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:03:27.741304 702 raft_consensus.cc:3037] T 184b252545f4443c935879394450bd2b P 0f932c672cb94de8aac6f694d713d738 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:03:27.742640 686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:27.735168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.66:36589 (local address 127.11.206.67:41895)
0812 00:03:27.735234 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0812 00:03:27.735236 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:03:27.735362 (+ 126us) server_negotiation.cc:407] Connection header received
0812 00:03:27.735461 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:03:27.735463 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:03:27.735474 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:03:27.735553 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:03:27.735883 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:27.736687 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:27.741503 (+ 4816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:27.742102 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:27.742161 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:27.742173 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0812 00:03:27.742482 (+ 309us) server_negotiation.cc:299] Negotiation successful
0812 00:03:27.742564 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260812 00:03:27.742865 702 raft_consensus.cc:504] T 184b252545f4443c935879394450bd2b P 0f932c672cb94de8aac6f694d713d738 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f932c672cb94de8aac6f694d713d738" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 40663 } } peers { permanent_uuid: "7df252c036c84ba1909bc41b8220ebd9" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 41895 } } peers { permanent_uuid: "a850c79ab36e43dea03f9a5f318e2d01" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 32791 } }
I20260812 00:03:27.743012 702 leader_election.cc:288] T 184b252545f4443c935879394450bd2b P 0f932c672cb94de8aac6f694d713d738 [CANDIDATE]: Term 1 election: Requested vote from peers 7df252c036c84ba1909bc41b8220ebd9 (127.11.206.67:41895), a850c79ab36e43dea03f9a5f318e2d01 (127.11.206.65:32791)
I20260812 00:03:27.743315 32514 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "184b252545f4443c935879394450bd2b" candidate_uuid: "0f932c672cb94de8aac6f694d713d738" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a850c79ab36e43dea03f9a5f318e2d01"
I20260812 00:03:27.743395 32514 raft_consensus.cc:3037] T 184b252545f4443c935879394450bd2b P a850c79ab36e43dea03f9a5f318e2d01 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:03:27.744704 32514 raft_consensus.cc:2454] T 184b252545f4443c935879394450bd2b P a850c79ab36e43dea03f9a5f318e2d01 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f932c672cb94de8aac6f694d713d738 in term 1.
I20260812 00:03:27.744927 32660 leader_election.cc:302] T 184b252545f4443c935879394450bd2b P 0f932c672cb94de8aac6f694d713d738 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f932c672cb94de8aac6f694d713d738, a850c79ab36e43dea03f9a5f318e2d01; no voters:
I20260812 00:03:27.745137 702 raft_consensus.cc:2781] T 184b252545f4443c935879394450bd2b P 0f932c672cb94de8aac6f694d713d738 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:03:27.745309 702 raft_consensus.cc:686] T 184b252545f4443c935879394450bd2b P 0f932c672cb94de8aac6f694d713d738 [term 1 LEADER]: Becoming Leader. State: Replica: 0f932c672cb94de8aac6f694d713d738, State: Running, Role: LEADER
I20260812 00:03:27.745416 702 consensus_queue.cc:237] T 184b252545f4443c935879394450bd2b P 0f932c672cb94de8aac6f694d713d738 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f932c672cb94de8aac6f694d713d738" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 40663 } } peers { permanent_uuid: "7df252c036c84ba1909bc41b8220ebd9" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 41895 } } peers { permanent_uuid: "a850c79ab36e43dea03f9a5f318e2d01" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 32791 } }
I20260812 00:03:27.746313 32222 catalog_manager.cc:5495] T 184b252545f4443c935879394450bd2b P 0f932c672cb94de8aac6f694d713d738 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f932c672cb94de8aac6f694d713d738 (127.11.206.66). New cstate: current_term: 1 leader_uuid: "0f932c672cb94de8aac6f694d713d738" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f932c672cb94de8aac6f694d713d738" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 40663 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7df252c036c84ba1909bc41b8220ebd9" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 41895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a850c79ab36e43dea03f9a5f318e2d01" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 32791 } health_report { overall_health: UNKNOWN } } }
I20260812 00:03:27.747069 710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:27.734517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.67:41895 (local address 127.11.206.66:36589)
0812 00:03:27.735298 (+ 781us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:27.735310 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 00:03:27.735379 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:03:27.735621 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:03:27.735622 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:03:27.735625 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:03:27.735784 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:03:27.735787 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:03:27.736934 (+ 1147us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:03:27.736935 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:03:27.738298 (+ 1363us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:03:27.738301 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:03:27.742262 (+ 3961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:03:27.742263 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:03:27.742376 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:27.742381 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 00:03:27.742934 (+ 553us) client_negotiation.cc:240] Negotiation successful
0812 00:03:27.742988 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":763,"thread_start_us":137,"threads_started":1}
I20260812 00:03:27.747928 568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "184b252545f4443c935879394450bd2b" candidate_uuid: "0f932c672cb94de8aac6f694d713d738" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7df252c036c84ba1909bc41b8220ebd9" is_pre_election: true
I20260812 00:03:27.748108 568 raft_consensus.cc:2454] T 184b252545f4443c935879394450bd2b P 7df252c036c84ba1909bc41b8220ebd9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f932c672cb94de8aac6f694d713d738 in term 0.
I20260812 00:03:27.748304 567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "184b252545f4443c935879394450bd2b" candidate_uuid: "0f932c672cb94de8aac6f694d713d738" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7df252c036c84ba1909bc41b8220ebd9"
I20260812 00:03:27.748420 567 raft_consensus.cc:3037] T 184b252545f4443c935879394450bd2b P 7df252c036c84ba1909bc41b8220ebd9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:03:27.750010 567 raft_consensus.cc:2454] T 184b252545f4443c935879394450bd2b P 7df252c036c84ba1909bc41b8220ebd9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f932c672cb94de8aac6f694d713d738 in term 1.
I20260812 00:03:27.754436 692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:27.750885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50960 (local address 127.11.206.66:40663)
0812 00:03:27.750936 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0812 00:03:27.750938 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:03:27.751037 (+ 99us) server_negotiation.cc:407] Connection header received
0812 00:03:27.751114 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:03:27.751114 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:03:27.751135 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:03:27.751213 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:03:27.751379 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:27.752103 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:27.753182 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:03:27.753505 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:03:27.753560 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:03:27.753750 (+ 190us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:03:27.753875 (+ 125us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:03:27.753942 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0812 00:03:27.754220 (+ 278us) server_negotiation.cc:299] Negotiation successful
0812 00:03:27.754241 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260812 00:03:27.756932 32514 raft_consensus.cc:1261] T 184b252545f4443c935879394450bd2b P a850c79ab36e43dea03f9a5f318e2d01 [term 1 FOLLOWER]: Refusing update from remote peer 0f932c672cb94de8aac6f694d713d738: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:03:27.756944 567 raft_consensus.cc:1261] T 184b252545f4443c935879394450bd2b P 7df252c036c84ba1909bc41b8220ebd9 [term 1 FOLLOWER]: Refusing update from remote peer 0f932c672cb94de8aac6f694d713d738: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:03:27.757287 702 consensus_queue.cc:1035] T 184b252545f4443c935879394450bd2b P 0f932c672cb94de8aac6f694d713d738 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7df252c036c84ba1909bc41b8220ebd9" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 41895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:03:27.757500 702 consensus_queue.cc:1035] T 184b252545f4443c935879394450bd2b P 0f932c672cb94de8aac6f694d713d738 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a850c79ab36e43dea03f9a5f318e2d01" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 32791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:03:27.762187 718 mvcc.cc:205] Tried to move back new op lower bound from 7317475359769423872 to 7317475359725768704. Current Snapshot: MvccSnapshot[applied={T|T < 7317475359769423872}]
I20260812 00:03:27.763360 720 mvcc.cc:205] Tried to move back new op lower bound from 7317475359769423872 to 7317475359725768704. Current Snapshot: MvccSnapshot[applied={T|T < 7317475359769423872}]
I20260812 00:03:27.770010 719 mvcc.cc:205] Tried to move back new op lower bound from 7317475359769423872 to 7317475359725768704. Current Snapshot: MvccSnapshot[applied={T|T < 7317475359769423872}]
I20260812 00:03:27.773231 32222 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59484:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:03:27.773334 32222 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59484:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:03:27.774286 32222 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7f6ec4e888f643b58bc932df4afc3c4a: Sending DeleteTablet for 3 replicas of tablet 184b252545f4443c935879394450bd2b
I20260812 00:03:27.774843 32743 tablet_service.cc:1514] Processing DeleteTablet for tablet 184b252545f4443c935879394450bd2b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:03:27 UTC) from {username='kudu', principal='kudu/127.11.206.126@KRBTEST.COM'} at 127.0.0.1:50958
I20260812 00:03:27.774945 32474 tablet_service.cc:1514] Processing DeleteTablet for tablet 184b252545f4443c935879394450bd2b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:03:27 UTC) from {username='kudu', principal='kudu/127.11.206.126@KRBTEST.COM'} at 127.0.0.1:53274
I20260812 00:03:27.774971 523 tablet_service.cc:1514] Processing DeleteTablet for tablet 184b252545f4443c935879394450bd2b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:03:27 UTC) from {username='kudu', principal='kudu/127.11.206.126@KRBTEST.COM'} at 127.0.0.1:56764
I20260812 00:03:27.775727 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 32359
I20260812 00:03:27.785573 731 tablet_replica.cc:330] T 184b252545f4443c935879394450bd2b P 0f932c672cb94de8aac6f694d713d738: stopping tablet replica
I20260812 00:03:27.785725 731 raft_consensus.cc:2229] T 184b252545f4443c935879394450bd2b P 0f932c672cb94de8aac6f694d713d738 [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:03:27.785873 731 raft_consensus.cc:2258] T 184b252545f4443c935879394450bd2b P 0f932c672cb94de8aac6f694d713d738 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:03:27.786415 731 ts_tablet_manager.cc:1905] T 184b252545f4443c935879394450bd2b P 0f932c672cb94de8aac6f694d713d738: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:03:27.788733 731 ts_tablet_manager.cc:1918] T 184b252545f4443c935879394450bd2b P 0f932c672cb94de8aac6f694d713d738: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:03:27.788806 731 log.cc:1196] T 184b252545f4443c935879394450bd2b P 0f932c672cb94de8aac6f694d713d738: Deleting WAL directory at /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/ts-1/wal/wals/184b252545f4443c935879394450bd2b
I20260812 00:03:27.789048 731 ts_tablet_manager.cc:1939] T 184b252545f4443c935879394450bd2b P 0f932c672cb94de8aac6f694d713d738: Deleting consensus metadata
I20260812 00:03:27.789510 32198 catalog_manager.cc:4841] TS 0f932c672cb94de8aac6f694d713d738 (127.11.206.66:40663): tablet 184b252545f4443c935879394450bd2b (table test-table [id=1fe3e12246324a8cb13fef04ce58e9ee]) successfully deleted
I20260812 00:03:27.800999 736 tablet_replica.cc:330] T 184b252545f4443c935879394450bd2b P 7df252c036c84ba1909bc41b8220ebd9: stopping tablet replica
I20260812 00:03:27.801180 736 raft_consensus.cc:2229] T 184b252545f4443c935879394450bd2b P 7df252c036c84ba1909bc41b8220ebd9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:03:27.801316 736 raft_consensus.cc:2258] T 184b252545f4443c935879394450bd2b P 7df252c036c84ba1909bc41b8220ebd9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:03:27.801925 736 ts_tablet_manager.cc:1905] T 184b252545f4443c935879394450bd2b P 7df252c036c84ba1909bc41b8220ebd9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:03:27.804368 736 ts_tablet_manager.cc:1918] T 184b252545f4443c935879394450bd2b P 7df252c036c84ba1909bc41b8220ebd9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:03:27.804448 736 log.cc:1196] T 184b252545f4443c935879394450bd2b P 7df252c036c84ba1909bc41b8220ebd9: Deleting WAL directory at /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786492899949492-12089-0/minicluster-data/ts-2/wal/wals/184b252545f4443c935879394450bd2b
I20260812 00:03:27.804787 736 ts_tablet_manager.cc:1939] T 184b252545f4443c935879394450bd2b P 7df252c036c84ba1909bc41b8220ebd9: Deleting consensus metadata
I20260812 00:03:27.805495 32194 catalog_manager.cc:4841] TS 7df252c036c84ba1909bc41b8220ebd9 (127.11.206.67:41895): tablet 184b252545f4443c935879394450bd2b (table test-table [id=1fe3e12246324a8cb13fef04ce58e9ee]) successfully deleted
W20260812 00:03:27.806026 32197 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.206.65:32791 (error 108)
I20260812 00:03:27.807010 690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:03:27.806892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.65:32791 (local address 127.0.0.1:53286)
0812 00:03:27.806943 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0812 00:03:27.806977 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.65:32791: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260812 00:03:27.807237 32197 catalog_manager.cc:4584] TS a850c79ab36e43dea03f9a5f318e2d01 (127.11.206.65:32791): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 184b252545f4443c935879394450bd2b: Network error: Client connection negotiation failed: client connection to 127.11.206.65:32791: connect: Connection refused (error 111)
I20260812 00:03:27.807513 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 32632
I20260812 00:03:27.840930 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 410
I20260812 00:03:27.854146 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 32171
I20260812 00:03:27.865134 12089 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260812 00:03:28.209137 12089 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260812 00:03:28.209254 12089 mini_ranger.cc:66] Stopping Ranger...
I20260812 00:03:28.553303 12089 mini_ranger.cc:68] Stopped Ranger
2026-08-12 00:03:28.553 UTC [31400] LOG: received smart shutdown request
2026-08-12 00:03:28.556 UTC [31400] LOG: background worker "logical replication launcher" (PID 31418) exited with exit code 1
2026-08-12 00:03:28.557 UTC [31404] LOG: shutting down
2026-08-12 00:03:28.697 UTC [31400] LOG: database system is shut down
2026-08-12T00:03:28Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (49728 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:03:28 dist-test-slave-f0tn krb5kdc[757](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:03:28 dist-test-slave-f0tn krb5kdc[757](info): set up 2 sockets
Aug 12 00:03:28 dist-test-slave-f0tn krb5kdc[757](info): commencing operation
krb5kdc: starting...
W20260812 00:03:29.990338 12089 mini_kdc.cc:121] Time spent starting KDC: real 1.179s user 0.001s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/krb5kdc/test-user.keytab.
Aug 12 00:03:30 dist-test-slave-f0tn krb5kdc[757](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493010, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:03:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:03:30Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.11.206.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.11.206.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.11.206.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/krb5kdc/rangeradmin_127.11.206.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.11.206.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/krb5kdc/rangeradmin_127.11.206.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.11.206.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.11.206.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.11.206.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/krb5kdc/rangerlookup_127.11.206.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.11.206.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/krb5kdc/rangerlookup_127.11.206.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.11.206.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.11.206.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.11.206.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/krb5kdc/HTTP_127.11.206.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.11.206.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/krb5kdc/HTTP_127.11.206.84@KRBTEST.COM.keytab.
I20260812 00:03:30.148429 12089 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-tasksssay4/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/postgres -l logfile start
2026-08-12 00:03:32.313 UTC [815] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-12 00:03:32.313 UTC [815] LOG: listening on IPv4 address "127.11.206.84", port 57855
2026-08-12 00:03:32.316 UTC [815] LOG: listening on Unix socket "/tmp/.s.PGSQL.57855"
2026-08-12 00:03:32.343 UTC [822] LOG: database system was shut down at 2026-08-12 00:03:31 UTC
2026-08-12 00:03:32.347 UTC [815] LOG: database system is ready to accept connections
I20260812 00:03:33.433900 12089 mini_postgres.cc:96] Postgres bound to 57855
2026-08-12 00:03:33.440 UTC [835] FATAL: database "slave" does not exist
127.11.206.84:57855 - accepting connections
I20260812 00:03:33.440912 12089 mini_ranger.cc:161] Starting Ranger...
I20260812 00:03:33.455269 12089 mini_ranger.cc:84] Created miniranger Postgres user
I20260812 00:03:33.853991 12089 mini_ranger.cc:87] Created ranger Postgres database
I20260812 00:03:33.854063 12089 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ranger-admin
2026-08-12 00:03:34,124 [I] DB FLAVOR :POSTGRES
2026-08-12 00:03:34,124 [I] --------- Verifying Ranger DB connection ---------
2026-08-12 00:03:34,124 [I] Checking connection..
2026-08-12 00:03:34,124 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksssay4/build/release/bin/postgresql.jar:/tmp/dist-test-tasksssay4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.206.84:57855/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-12 00:03:34,357 [I] Checking connection passed.
2026-08-12 00:03:34,357 [I] --------- Verifying version history table ---------
2026-08-12 00:03:34,357 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksssay4/build/release/bin/postgresql.jar:/tmp/dist-test-tasksssay4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.206.84:57855/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 00:03:34,615 [I] Table x_db_version_h does not exist in database ranger
2026-08-12 00:03:34,616 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksssay4/build/release/bin/postgresql.jar:/tmp/dist-test-tasksssay4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.206.84:57855/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 00:03:34,876 [I] Table x_db_version_h does not exist in database ranger
2026-08-12 00:03:34,877 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-12 00:03:34,877 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksssay4/build/release/bin/postgresql.jar:/tmp/dist-test-tasksssay4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.206.84:57855/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-tasksssay4/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-12 00:03:35.126 UTC [950] WARNING: there is no transaction in progress
2026-08-12 00:03:35,134 [I] create_dbversion_catalog.sql file imported successfully
2026-08-12 00:03:35,135 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksssay4/build/release/bin/postgresql.jar:/tmp/dist-test-tasksssay4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.206.84:57855/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 00:03:35,394 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-12 00:03:35,395 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-12 00:03:35,395 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksssay4/build/release/bin/postgresql.jar:/tmp/dist-test-tasksssay4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.206.84:57855/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-12 00:03:35,637 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksssay4/build/release/bin/postgresql.jar:/tmp/dist-test-tasksssay4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.206.84:57855/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-12 00:03:35,902 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksssay4/build/release/bin/postgresql.jar:/tmp/dist-test-tasksssay4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.206.84:57855/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-f0tn.c.gcp-upstream.internal','N') ;"
2026-08-12 00:03:36,135 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksssay4/build/release/bin/postgresql.jar:/tmp/dist-test-tasksssay4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.206.84:57855/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-12 00:03:36,403 [I] Table x_portal_user does not exist in database ranger
2026-08-12 00:03:36,403 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksssay4/build/release/bin/postgresql.jar:/tmp/dist-test-tasksssay4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.206.84:57855/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-12 00:03:36,655 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-12 00:03:36,655 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksssay4/build/release/bin/postgresql.jar:/tmp/dist-test-tasksssay4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.206.84:57855/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-12 00:03:36,899 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksssay4/build/release/bin/postgresql.jar:/tmp/dist-test-tasksssay4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.206.84:57855/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-12 00:03:37,160 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-12 00:03:37,160 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksssay4/build/release/bin/postgresql.jar:/tmp/dist-test-tasksssay4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.206.84:57855/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-tasksssay4/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-12 00:03:38.107 UTC [1167] WARNING: there is no transaction in progress
2026-08-12 00:03:38.123 UTC [1167] WARNING: there is no transaction in progress
2026-08-12 00:03:38.137 UTC [1167] WARNING: there is no transaction in progress
2026-08-12 00:03:38.151 UTC [1167] WARNING: there is no transaction in progress
2026-08-12 00:03:38.169 UTC [1167] WARNING: there is no transaction in progress
2026-08-12 00:03:38.188 UTC [1167] WARNING: there is no transaction in progress
2026-08-12 00:03:38.252 UTC [1167] WARNING: there is no transaction in progress
2026-08-12 00:03:38.258 UTC [1167] WARNING: there is no transaction in progress
2026-08-12 00:03:38.271 UTC [1167] WARNING: there is no transaction in progress
2026-08-12 00:03:38.280 UTC [1167] WARNING: there is no transaction in progress
2026-08-12 00:03:38.289 UTC [1167] WARNING: there is no transaction in progress
2026-08-12 00:03:38.302 UTC [1167] WARNING: there is no transaction in progress
2026-08-12 00:03:38.310 UTC [1167] WARNING: there is no transaction in progress
2026-08-12 00:03:38.317 UTC [1167] WARNING: there is no transaction in progress
2026-08-12 00:03:38.323 UTC [1167] WARNING: there is no transaction in progress
2026-08-12 00:03:38.328 UTC [1167] WARNING: there is no transaction in progress
2026-08-12 00:03:38,873 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-12 00:03:38,873 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksssay4/build/release/bin/postgresql.jar:/tmp/dist-test-tasksssay4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.206.84:57855/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-12 00:03:39,119 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-12 00:03:39,119 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksssay4/build/release/bin/postgresql.jar:/tmp/dist-test-tasksssay4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.206.84:57855/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-12 00:03:39,380 [I] Table x_portal_user already exists in database 'ranger'
2026-08-12 00:03:39,380 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksssay4/build/release/bin/postgresql.jar:/tmp/dist-test-tasksssay4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.206.84:57855/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-12 00:03:39,617 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-12 00:03:39,618 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksssay4/build/release/bin/postgresql.jar:/tmp/dist-test-tasksssay4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.206.84:57855/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-12 00:03:39,869 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksssay4/build/release/bin/postgresql.jar:/tmp/dist-test-tasksssay4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.206.84:57855/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-12 00:03:40,123 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksssay4/build/release/bin/postgresql.jar:/tmp/dist-test-tasksssay4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.206.84:57855/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-f0tn.c.gcp-upstream.internal';"
2026-08-12 00:03:40,372 [I] CORE_DB_SCHEMA import status has been updated
2026-08-12 00:03:40,373 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksssay4/build/release/bin/postgresql.jar:/tmp/dist-test-tasksssay4/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.206.84:57855/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-12 00:03:40,631 [I] DB_PATCHES have already been applied
I20260812 00:03:40.637326 12089 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ranger-admin:/tmp/dist-test-tasksssay4/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-tasksssay4/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-tasksssay4/build/release/bin/postgresql.jar:/tmp/dist-test-tasksssay4/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260812 00:03:40.637414 12089 mini_ranger.cc:193] Using host: 127.11.206.84
I20260812 00:03:40.640846 12089 mini_ranger.cc:227] Ranger admin URL: http://127.11.206.84:60367
Aug 12, 2026 12:03:40 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 12, 2026 12:03:40 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 12, 2026 12:03:41 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ranger-admin/ews/webapp
Aug 12, 2026 12:03:41 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 12, 2026 12:03:41 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 12, 2026 12:03:41 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ranger-admin/ews/webapp].
Aug 12, 2026 12:03:41 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260812 00:03:41.935120 12089 mini_ranger.cc:160] Time spent starting Ranger: real 8.494s user 0.000s sys 0.009s
Aug 12, 2026 12:04:02 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 12, 2026 12:04:02 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 12, 2026 12:04:02 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 12, 2026 12:04:02 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 12, 2026 12:04:02 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 12, 2026 12:04:02 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 12, 2026 12:04:02 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 12, 2026 12:04:02 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 12, 2026 12:04:02 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 12, 2026 12:04:02 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 12, 2026 12:04:02 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 12, 2026 12:04:02 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 12, 2026 12:04:02 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 12, 2026 12:04:02 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 12, 2026 12:04:02 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 12, 2026 12:04:02 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 12, 2026 12:04:02 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 12, 2026 12:04:03 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260812 00:04:04.017108 12089 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.11.206.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.11.206.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.11.206.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/krb5kdc/rangerkms_127.11.206.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.11.206.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/krb5kdc/rangerkms_127.11.206.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.11.206.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.11.206.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.11.206.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/krb5kdc/HTTP_127.11.206.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.11.206.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/krb5kdc/HTTP_127.11.206.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 12 00:04:04 dist-test-slave-f0tn krb5kdc[757](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493044, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260812 00:04:04.098531 12089 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260812 00:04:04.108170 12089 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260812 00:04:04.903013 12089 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260812 00:04:04.903084 12089 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ranger-kms
I20260812 00:04:04.903102 12089 mini_ranger_kms.cc:227] Using postgres at 127.11.206.84:57855
2026-08-12 00:04:05,070 [I] DB FLAVOR :POSTGRES
2026-08-12 00:04:05,071 [I] --------- Verifying Ranger DB connection ---------
2026-08-12 00:04:05,071 [I] Checking connection
2026-08-12 00:04:05,071 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksssay4/build/release/bin/postgresql.jar:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.206.84:57855/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-12 00:04:05,397 [I] connection success
2026-08-12 00:04:05,397 [I] --------- Verifying Ranger DB tables ---------
2026-08-12 00:04:05,397 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-12 00:04:05,398 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksssay4/build/release/bin/postgresql.jar:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.206.84:57855/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-12 00:04:05,692 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-12 00:04:05,693 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-12 00:04:05,693 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-12 00:04:05,693 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksssay4/build/release/bin/postgresql.jar:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.206.84:57855/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-12 00:04:05,971 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260812 00:04:06.457904 12089 mini_ranger_kms.cc:310] Created kms service
I20260812 00:04:06.714414 12089 mini_ranger_kms.cc:326] Created kudu user
I20260812 00:04:06.756158 12089 mini_ranger_kms.cc:343] Created rangerkms user
Aug 12 00:04:06 dist-test-slave-f0tn krb5kdc[757](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493044, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.11.206.84@KRBTEST.COM
I20260812 00:04:07.129204 12089 mini_ranger_kms.cc:384] Added ranger policy
I20260812 00:04:07.129632 12089 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ranger-kms:/tmp/dist-test-tasksssay4/build/release/bin/postgresql.jar:/tmp/dist-test-tasksssay4/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-tasksssay4/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260812 00:04:07.129674 12089 mini_ranger_kms.cc:240] Using host: 127.11.206.84
I20260812 00:04:07.133304 12089 mini_ranger_kms.cc:276] Ranger KMS PID: 1503
I20260812 00:04:07.133402 12089 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.11.206.84:38277
Aug 12, 2026 12:04:08 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 12, 2026 12:04:08 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 12, 2026 12:04:08 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 12, 2026 12:04:08 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 12, 2026 12:04:08 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ranger-kms/ews/webapp].
Aug 12, 2026 12:04:08 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 12 00:04:09 dist-test-slave-f0tn krb5kdc[757](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786493049, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.11.206.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:04:09.846577 12089 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.748s user 0.011s sys 0.139s
I20260812 00:04:09.846666 12089 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260812 00:04:09.846714 12089 mini_ranger_kms.cc:401] 127.11.206.84:38277/kms/v1/keys
Aug 12 00:04:10 dist-test-slave-f0tn krb5kdc[757](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493049, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.11.206.84@KRBTEST.COM for HTTP/127.11.206.84@KRBTEST.COM
Aug 12 00:04:10 dist-test-slave-f0tn krb5kdc[757](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493049, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.11.206.84@KRBTEST.COM for HTTP/127.11.206.84@KRBTEST.COM
Aug 12 00:04:12 dist-test-slave-f0tn krb5kdc[757](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493052, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.11.206.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab.
Entry for principal kudu/127.11.206.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab.
I20260812 00:04:12.968191 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:38897
--webserver_interface=127.11.206.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab
--principal=kudu/127.11.206.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:42823
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.206.126:38897
--ranger_config_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.206.84:38277/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:04:13.095450 1585 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:04:13.095708 1585 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:04:13.095731 1585 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:04:13.097167 1585 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:04:13.097229 1585 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:04:13.097244 1585 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:04:13.097255 1585 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:04:13.097266 1585 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:04:13.099690 1585 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:42823
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/master-0/wal
--ranger_kms_url=127.11.206.84:38277/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.11.206.126:38897
--ranger_config_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab
--principal=kudu/127.11.206.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:38897
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.206.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1585
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:04:13.099987 1585 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:04:13.100258 1585 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:04:13.106734 1592 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:13.106798 1591 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:13.106798 1596 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:13.107069 1585 server_base.cc:1034] running on GCE node
I20260812 00:04:13.107307 1585 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:04:13.107590 1585 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:04:13.108758 1585 hybrid_clock.cc:648] HybridClock initialized: now 1786493053108740 us; error 34 us; skew 500 ppm
Aug 12 00:04:13 dist-test-slave-f0tn krb5kdc[757](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493053, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:04:13.112040 1585 init.cc:377] Logged in from keytab as kudu/127.11.206.126@KRBTEST.COM (short username kudu)
I20260812 00:04:13.112501 1585 webserver.cc:460] Webserver started at http://127.11.206.126:43849/ using document root <none> and password file <none>
I20260812 00:04:13.112732 1585 fs_manager.cc:359] Metadata directory not provided
I20260812 00:04:13.112772 1585 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:04:13.112895 1585 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 00:04:13 dist-test-slave-f0tn krb5kdc[757](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493053, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.126@KRBTEST.COM for HTTP/127.11.206.84@KRBTEST.COM
I20260812 00:04:13.164484 1585 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/master-0/data/instance:
uuid: "1293b96c45954fcca9fe0fcfeb68b978"
format_stamp: "Formatted at 2026-08-12 00:04:13 on dist-test-slave-f0tn"
server_key: "4a2c12cc0f16a52511a212ba584016e3"
server_key_iv: "03438b7042b36fc760013ab4b6c63729"
server_key_version: "kuduclusterkey@0"
I20260812 00:04:13.164981 1585 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/master-0/wal/instance:
uuid: "1293b96c45954fcca9fe0fcfeb68b978"
format_stamp: "Formatted at 2026-08-12 00:04:13 on dist-test-slave-f0tn"
server_key: "4a2c12cc0f16a52511a212ba584016e3"
server_key_iv: "03438b7042b36fc760013ab4b6c63729"
server_key_version: "kuduclusterkey@0"
I20260812 00:04:13.166999 1585 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.000s
I20260812 00:04:13.179836 1616 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:13.180070 1585 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260812 00:04:13.180171 1585 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/master-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/master-0/wal
uuid: "1293b96c45954fcca9fe0fcfeb68b978"
format_stamp: "Formatted at 2026-08-12 00:04:13 on dist-test-slave-f0tn"
server_key: "4a2c12cc0f16a52511a212ba584016e3"
server_key_iv: "03438b7042b36fc760013ab4b6c63729"
server_key_version: "kuduclusterkey@0"
I20260812 00:04:13.180274 1585 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:04:13.197283 1585 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:04:13.199589 1585 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:04:13.199749 1585 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:04:13.211803 1585 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.126:38897
I20260812 00:04:13.211905 1708 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.126:38897 every 8 connection(s)
I20260812 00:04:13.212352 1585 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
I20260812 00:04:13.213506 1709 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:04:13.215945 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 1585
I20260812 00:04:13.216045 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/master-0/wal/instance
I20260812 00:04:13.216213 12089 external_mini_cluster.cc:1428] Setting key 600638e6253c8f0f3b883890726a3cc9
I20260812 00:04:13.217517 1709 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1293b96c45954fcca9fe0fcfeb68b978: Bootstrap starting.
I20260812 00:04:13.218628 1709 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1293b96c45954fcca9fe0fcfeb68b978: Neither blocks nor log segments found. Creating new log.
I20260812 00:04:13.219627 1709 log.cc:824] T 00000000000000000000000000000000 P 1293b96c45954fcca9fe0fcfeb68b978: Log is configured to *not* fsync() on all Append() calls
I20260812 00:04:13.220547 1709 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1293b96c45954fcca9fe0fcfeb68b978: No bootstrap required, opened a new log
I20260812 00:04:13.224690 1709 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1293b96c45954fcca9fe0fcfeb68b978 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1293b96c45954fcca9fe0fcfeb68b978" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 38897 } }
I20260812 00:04:13.224857 1709 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1293b96c45954fcca9fe0fcfeb68b978 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:04:13.224893 1709 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1293b96c45954fcca9fe0fcfeb68b978 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1293b96c45954fcca9fe0fcfeb68b978, State: Initialized, Role: FOLLOWER
I20260812 00:04:13.225060 1709 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1293b96c45954fcca9fe0fcfeb68b978 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1293b96c45954fcca9fe0fcfeb68b978" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 38897 } }
Aug 12 00:04:13 dist-test-slave-f0tn krb5kdc[757](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493052, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:04:13.225143 1709 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1293b96c45954fcca9fe0fcfeb68b978 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:04:13.225179 1709 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1293b96c45954fcca9fe0fcfeb68b978 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:04:13.225251 1709 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1293b96c45954fcca9fe0fcfeb68b978 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:04:13.226253 1709 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1293b96c45954fcca9fe0fcfeb68b978 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1293b96c45954fcca9fe0fcfeb68b978" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 38897 } }
I20260812 00:04:13.226372 1709 leader_election.cc:302] T 00000000000000000000000000000000 P 1293b96c45954fcca9fe0fcfeb68b978 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1293b96c45954fcca9fe0fcfeb68b978; no voters:
I20260812 00:04:13.226619 1709 leader_election.cc:288] T 00000000000000000000000000000000 P 1293b96c45954fcca9fe0fcfeb68b978 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:04:13.226688 1719 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1293b96c45954fcca9fe0fcfeb68b978 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:04:13.227061 1709 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1293b96c45954fcca9fe0fcfeb68b978 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:04:13.227272 1719 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1293b96c45954fcca9fe0fcfeb68b978 [term 1 LEADER]: Becoming Leader. State: Replica: 1293b96c45954fcca9fe0fcfeb68b978, State: Running, Role: LEADER
I20260812 00:04:13.227449 1719 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1293b96c45954fcca9fe0fcfeb68b978 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1293b96c45954fcca9fe0fcfeb68b978" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 38897 } }
I20260812 00:04:13.227878 1719 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1293b96c45954fcca9fe0fcfeb68b978 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1293b96c45954fcca9fe0fcfeb68b978" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1293b96c45954fcca9fe0fcfeb68b978" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 38897 } } }
I20260812 00:04:13.228045 1719 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1293b96c45954fcca9fe0fcfeb68b978 [sys.catalog]: This master's current role is: LEADER
I20260812 00:04:13.228220 1721 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1293b96c45954fcca9fe0fcfeb68b978 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1293b96c45954fcca9fe0fcfeb68b978. Latest consensus state: current_term: 1 leader_uuid: "1293b96c45954fcca9fe0fcfeb68b978" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1293b96c45954fcca9fe0fcfeb68b978" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 38897 } } }
I20260812 00:04:13.228471 1721 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1293b96c45954fcca9fe0fcfeb68b978 [sys.catalog]: This master's current role is: LEADER
I20260812 00:04:13.230149 1732 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:04:13.230731 1732 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:04:13.232161 1709 ranger_client.cc:318] Using new properties file: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260812 00:04:13.232161 1715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:13.216963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56206 (local address 127.11.206.126:38897)
0812 00:04:13.217219 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:13.217230 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:13.217280 (+ 50us) server_negotiation.cc:407] Connection header received
0812 00:04:13.217899 (+ 619us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:13.217910 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:13.217982 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:13.218191 (+ 209us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:13.219158 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:13.220583 (+ 1425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:13.221792 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:13.222444 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:13.222568 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:13.225750 (+ 3182us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:13.225756 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:13.225757 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:04:13.225771 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:13.229754 (+ 3983us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:13.230203 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:13.230208 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:13.230208 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:13.230304 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:13.230517 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:13.230518 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:13.230519 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:13.230871 (+ 352us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:13.231181 (+ 310us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:13.231752 (+ 571us) server_negotiation.cc:299] Negotiation successful
0812 00:04:13.231890 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":192,"thread_start_us":134,"threads_started":1}
I20260812 00:04:13.233976 1732 catalog_manager.cc:1347] Generated new cluster ID: e0868ebb4d8c4a90a83b1cbacf34bed4
I20260812 00:04:13.234046 1732 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:04:13.275497 1732 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:04:13.276469 1732 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:04:13.287796 1732 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1293b96c45954fcca9fe0fcfeb68b978: Generated new TSK 0
I20260812 00:04:13.288129 1732 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.206.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.65.keytab.
Entry for principal kudu/127.11.206.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.65.keytab.
I20260812 00:04:14.203756 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.206.84:38277/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.65:0
--local_ip_for_outbound_sockets=127.11.206.65
--webserver_interface=127.11.206.65
--webserver_port=0
--tserver_master_addrs=127.11.206.126:38897
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.65.keytab
--principal=kudu/127.11.206.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:42823
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:04:14.360369 1787 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:04:14.360685 1787 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:04:14.360749 1787 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:04:14.362637 1787 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:04:14.362709 1787 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:04:14.362757 1787 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.65
I20260812 00:04:14.365126 1787 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:42823
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.11.206.84:38277/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.65.keytab
--principal=kudu/127.11.206.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.206.65
--webserver_port=0
--tserver_master_addrs=127.11.206.126:38897
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1787
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.65
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:04:14.365554 1787 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:04:14.365840 1787 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:04:14.372551 1802 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:14.372627 1803 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:14.372788 1787 server_base.cc:1034] running on GCE node
W20260812 00:04:14.372649 1807 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:14.373109 1787 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:04:14.373453 1787 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:04:14.374634 1787 hybrid_clock.cc:648] HybridClock initialized: now 1786493054374618 us; error 30 us; skew 500 ppm
Aug 12 00:04:14 dist-test-slave-f0tn krb5kdc[757](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493054, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:04:14.381699 1787 init.cc:377] Logged in from keytab as kudu/127.11.206.65@KRBTEST.COM (short username kudu)
I20260812 00:04:14.382330 1787 webserver.cc:460] Webserver started at http://127.11.206.65:33795/ using document root <none> and password file <none>
I20260812 00:04:14.382628 1787 fs_manager.cc:359] Metadata directory not provided
I20260812 00:04:14.382704 1787 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:04:14.382859 1787 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 00:04:14 dist-test-slave-f0tn krb5kdc[757](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493054, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.65@KRBTEST.COM for HTTP/127.11.206.84@KRBTEST.COM
I20260812 00:04:14.401454 1787 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-0/data/instance:
uuid: "dc8c279da2eb4105ba90dec8ed266591"
format_stamp: "Formatted at 2026-08-12 00:04:14 on dist-test-slave-f0tn"
server_key: "c4d3ee5cbae5b06dd277d62bb55fe852"
server_key_iv: "ac36b0bbaa7b8d9cf59711b32d9510ba"
server_key_version: "kuduclusterkey@0"
I20260812 00:04:14.402061 1787 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-0/wal/instance:
uuid: "dc8c279da2eb4105ba90dec8ed266591"
format_stamp: "Formatted at 2026-08-12 00:04:14 on dist-test-slave-f0tn"
server_key: "c4d3ee5cbae5b06dd277d62bb55fe852"
server_key_iv: "ac36b0bbaa7b8d9cf59711b32d9510ba"
server_key_version: "kuduclusterkey@0"
I20260812 00:04:14.404019 1787 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.000s
I20260812 00:04:14.417695 1824 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:14.417966 1787 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:04:14.418066 1787 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-0/wal
uuid: "dc8c279da2eb4105ba90dec8ed266591"
format_stamp: "Formatted at 2026-08-12 00:04:14 on dist-test-slave-f0tn"
server_key: "c4d3ee5cbae5b06dd277d62bb55fe852"
server_key_iv: "ac36b0bbaa7b8d9cf59711b32d9510ba"
server_key_version: "kuduclusterkey@0"
I20260812 00:04:14.418165 1787 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:04:14.436648 1787 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:04:14.439513 1787 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:04:14.439828 1787 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:04:14.440296 1787 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:04:14.440833 1787 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:04:14.440929 1787 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:14.441036 1787 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:04:14.441118 1787 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:14.455461 1787 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.65:35709
I20260812 00:04:14.455538 2016 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.65:35709 every 8 connection(s)
I20260812 00:04:14.456066 1787 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
I20260812 00:04:14.462661 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 1787
I20260812 00:04:14.462781 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-0/wal/instance
I20260812 00:04:14.462990 12089 external_mini_cluster.cc:1428] Setting key eef9c47690cf9a47f85dfc019f75c278
Aug 12 00:04:14 dist-test-slave-f0tn krb5kdc[757](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493054, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.65@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:04:14.469883 2021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:14.456988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:38897 (local address 127.11.206.65:34455)
0812 00:04:14.457295 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:14.457337 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:14.458122 (+ 785us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:14.458481 (+ 359us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:14.458487 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:14.458784 (+ 297us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:04:14.459126 (+ 342us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:14.459133 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:14.460190 (+ 1057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:14.460191 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:14.462585 (+ 2394us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:14.462589 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:14.463330 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:14.463332 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:14.463549 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:14.464235 (+ 686us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:04:14.464246 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:04:14.466071 (+ 1825us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:04:14.468060 (+ 1989us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:14.468068 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:14.468070 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:14.468359 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:14.468592 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:14.468593 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:14.468593 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:14.468743 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:14.469064 (+ 321us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:04:14.469072 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:04:14.469277 (+ 205us) client_negotiation.cc:769] Sending connection context
0812 00:04:14.469422 (+ 145us) client_negotiation.cc:240] Negotiation successful
0812 00:04:14.469602 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":108,"threads_started":1}
I20260812 00:04:14.470332 2020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:14.457024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.65:34455 (local address 127.11.206.126:38897)
0812 00:04:14.457140 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:14.457142 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:14.457438 (+ 296us) server_negotiation.cc:407] Connection header received
0812 00:04:14.458269 (+ 831us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:14.458271 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:14.458288 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:14.458380 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:14.459242 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:14.460080 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:14.462729 (+ 2649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:14.463044 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:14.463095 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:14.466170 (+ 3075us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:14.466172 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:14.466172 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:04:14.466180 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:14.467966 (+ 1786us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:14.468446 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:14.468447 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:14.468448 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:14.468521 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:14.468821 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:14.468821 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:14.468822 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:14.468978 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:14.469036 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:14.470118 (+ 1082us) server_negotiation.cc:299] Negotiation successful
0812 00:04:14.470228 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92,"thread_start_us":56,"threads_started":1}
I20260812 00:04:14.471035 2018 heartbeater.cc:347] Connected to a master server at 127.11.206.126:38897
I20260812 00:04:14.471144 2018 heartbeater.cc:464] Registering TS with master...
I20260812 00:04:14.471349 2018 heartbeater.cc:511] Master 127.11.206.126:38897 requested a full tablet report, sending...
I20260812 00:04:14.471964 1649 ts_manager.cc:194] Registered new tserver with Master: dc8c279da2eb4105ba90dec8ed266591 (127.11.206.65:35709)
I20260812 00:04:14.472882 1649 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.206.65@KRBTEST.COM'} at 127.11.206.65:34455
WARNING: no policy specified for kudu/127.11.206.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.66.keytab.
Entry for principal kudu/127.11.206.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.66.keytab.
I20260812 00:04:14.500856 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.206.84:38277/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.66:0
--local_ip_for_outbound_sockets=127.11.206.66
--webserver_interface=127.11.206.66
--webserver_port=0
--tserver_master_addrs=127.11.206.126:38897
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.66.keytab
--principal=kudu/127.11.206.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:42823
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:04:14.665097 2028 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:04:14.665508 2028 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:04:14.665647 2028 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:04:14.667614 2028 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:04:14.667750 2028 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:04:14.667845 2028 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.66
I20260812 00:04:14.670419 2028 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:42823
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.11.206.84:38277/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.66.keytab
--principal=kudu/127.11.206.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.206.66
--webserver_port=0
--tserver_master_addrs=127.11.206.126:38897
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2028
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.66
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:04:14.670985 2028 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:04:14.671350 2028 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:04:14.681221 2036 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:14.681190 2037 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:14.681885 2041 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:14.689682 2028 server_base.cc:1034] running on GCE node
I20260812 00:04:14.690137 2028 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:04:14.690485 2028 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:04:14.691676 2028 hybrid_clock.cc:648] HybridClock initialized: now 1786493054691649 us; error 44 us; skew 500 ppm
Aug 12 00:04:14 dist-test-slave-f0tn krb5kdc[757](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493054, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:04:14.695981 2028 init.cc:377] Logged in from keytab as kudu/127.11.206.66@KRBTEST.COM (short username kudu)
I20260812 00:04:14.696653 2028 webserver.cc:460] Webserver started at http://127.11.206.66:35343/ using document root <none> and password file <none>
I20260812 00:04:14.697065 2028 fs_manager.cc:359] Metadata directory not provided
I20260812 00:04:14.697224 2028 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:04:14.697499 2028 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 00:04:14 dist-test-slave-f0tn krb5kdc[757](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493054, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.66@KRBTEST.COM for HTTP/127.11.206.84@KRBTEST.COM
I20260812 00:04:14.718462 2028 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-1/data/instance:
uuid: "5c4cf6dcd7e642abb49a592ddc6a3691"
format_stamp: "Formatted at 2026-08-12 00:04:14 on dist-test-slave-f0tn"
server_key: "02cd637fae4702d344fe615e1b21ed16"
server_key_iv: "c896c60f71f583f33d1c4846f2115f2f"
server_key_version: "kuduclusterkey@0"
I20260812 00:04:14.718953 2028 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-1/wal/instance:
uuid: "5c4cf6dcd7e642abb49a592ddc6a3691"
format_stamp: "Formatted at 2026-08-12 00:04:14 on dist-test-slave-f0tn"
server_key: "02cd637fae4702d344fe615e1b21ed16"
server_key_iv: "c896c60f71f583f33d1c4846f2115f2f"
server_key_version: "kuduclusterkey@0"
I20260812 00:04:14.724207 2028 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.001s
I20260812 00:04:14.741425 2049 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:14.741717 2028 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.001s
I20260812 00:04:14.741869 2028 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-1/wal
uuid: "5c4cf6dcd7e642abb49a592ddc6a3691"
format_stamp: "Formatted at 2026-08-12 00:04:14 on dist-test-slave-f0tn"
server_key: "02cd637fae4702d344fe615e1b21ed16"
server_key_iv: "c896c60f71f583f33d1c4846f2115f2f"
server_key_version: "kuduclusterkey@0"
I20260812 00:04:14.741989 2028 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
Aug 12 00:04:14 dist-test-slave-f0tn krb5kdc[757](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786493054, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:04:14.756244 2028 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:04:14.759763 2028 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:04:14.760001 2028 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:04:14.769357 2028 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:04:14.769956 2028 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:04:14.770071 2028 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:14.770172 2028 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:04:14.770239 2028 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:14.784842 2250 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.66:37021 every 8 connection(s)
I20260812 00:04:14.784914 2028 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.66:37021
I20260812 00:04:14.785599 2028 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
I20260812 00:04:14.786378 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 2028
I20260812 00:04:14.786487 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-1/wal/instance
I20260812 00:04:14.786705 12089 external_mini_cluster.cc:1428] Setting key 28e74955846d28f96ed44b74310bc73c
Aug 12 00:04:14 dist-test-slave-f0tn krb5kdc[757](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493054, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.66@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:04:14.807633 2020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:14.796035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.66:40385 (local address 127.11.206.126:38897)
0812 00:04:14.796084 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:14.796086 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:14.796433 (+ 347us) server_negotiation.cc:407] Connection header received
0812 00:04:14.797352 (+ 919us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:14.797353 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:14.797370 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:14.797432 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:14.798525 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:14.799360 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:14.801043 (+ 1683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:14.801393 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:14.801438 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:14.804195 (+ 2757us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:14.804197 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:14.804197 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:04:14.804205 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:14.805938 (+ 1733us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:14.806466 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:14.806467 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:14.806468 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:14.806536 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:14.806830 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:14.806831 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:14.806832 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:14.806975 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:14.807021 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:14.807435 (+ 414us) server_negotiation.cc:299] Negotiation successful
0812 00:04:14.807531 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 00:04:14.808415 2257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:14.795676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:38897 (local address 127.11.206.66:40385)
0812 00:04:14.796299 (+ 623us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:14.796347 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:14.797219 (+ 872us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:14.797650 (+ 431us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:14.797655 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:14.798011 (+ 356us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:04:14.798410 (+ 399us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:14.798417 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:14.799478 (+ 1061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:14.799479 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:14.800939 (+ 1460us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:14.800942 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:14.801543 (+ 601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:14.801544 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:14.801702 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:14.802333 (+ 631us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:04:14.802344 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:04:14.804026 (+ 1682us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:04:14.806038 (+ 2012us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:14.806046 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:14.806049 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:14.806372 (+ 323us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:14.806606 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:14.806607 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:14.806607 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:14.806753 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:14.807064 (+ 311us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:04:14.807071 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:04:14.807262 (+ 191us) client_negotiation.cc:769] Sending connection context
0812 00:04:14.807976 (+ 714us) client_negotiation.cc:240] Negotiation successful
0812 00:04:14.808164 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":581,"thread_start_us":134,"threads_started":1}
I20260812 00:04:14.809324 2253 heartbeater.cc:347] Connected to a master server at 127.11.206.126:38897
I20260812 00:04:14.809466 2253 heartbeater.cc:464] Registering TS with master...
I20260812 00:04:14.809762 2253 heartbeater.cc:511] Master 127.11.206.126:38897 requested a full tablet report, sending...
I20260812 00:04:14.810338 1649 ts_manager.cc:194] Registered new tserver with Master: 5c4cf6dcd7e642abb49a592ddc6a3691 (127.11.206.66:37021)
I20260812 00:04:14.810782 1649 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.206.66@KRBTEST.COM'} at 127.11.206.66:40385
WARNING: no policy specified for kudu/127.11.206.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.67.keytab.
Entry for principal kudu/127.11.206.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.67.keytab.
I20260812 00:04:14.832166 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.206.84:38277/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.67:0
--local_ip_for_outbound_sockets=127.11.206.67
--webserver_interface=127.11.206.67
--webserver_port=0
--tserver_master_addrs=127.11.206.126:38897
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.67.keytab
--principal=kudu/127.11.206.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:42823
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:04:14.982378 2262 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:04:14.982746 2262 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:04:14.982831 2262 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:04:14.984710 2262 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:04:14.984822 2262 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:04:14.984906 2262 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.67
I20260812 00:04:14.987358 2262 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:42823
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.11.206.84:38277/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.67.keytab
--principal=kudu/127.11.206.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.206.67
--webserver_port=0
--tserver_master_addrs=127.11.206.126:38897
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2262
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.67
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:04:14.987828 2262 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:04:14.988205 2262 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:04:14.995435 2271 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:14.995544 2278 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:14.995999 2269 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:14.996409 2262 server_base.cc:1034] running on GCE node
I20260812 00:04:14.996628 2262 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:04:14.996927 2262 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:04:14.998118 2262 hybrid_clock.cc:648] HybridClock initialized: now 1786493054998091 us; error 42 us; skew 500 ppm
Aug 12 00:04:14 dist-test-slave-f0tn krb5kdc[757](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493054, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:04:15.002254 2262 init.cc:377] Logged in from keytab as kudu/127.11.206.67@KRBTEST.COM (short username kudu)
I20260812 00:04:15.002878 2262 webserver.cc:460] Webserver started at http://127.11.206.67:42771/ using document root <none> and password file <none>
I20260812 00:04:15.003188 2262 fs_manager.cc:359] Metadata directory not provided
I20260812 00:04:15.003263 2262 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:04:15.003404 2262 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 00:04:15 dist-test-slave-f0tn krb5kdc[757](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493054, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.67@KRBTEST.COM for HTTP/127.11.206.84@KRBTEST.COM
I20260812 00:04:15.020288 2262 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-2/data/instance:
uuid: "10c7aa06605d4ff8a3116342649ac785"
format_stamp: "Formatted at 2026-08-12 00:04:15 on dist-test-slave-f0tn"
server_key: "2dd185df7999e04e070ce8b2f53514ee"
server_key_iv: "3baed51b6a8c96b24d39ac7db4c1dbf6"
server_key_version: "kuduclusterkey@0"
I20260812 00:04:15.020715 2262 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-2/wal/instance:
uuid: "10c7aa06605d4ff8a3116342649ac785"
format_stamp: "Formatted at 2026-08-12 00:04:15 on dist-test-slave-f0tn"
server_key: "2dd185df7999e04e070ce8b2f53514ee"
server_key_iv: "3baed51b6a8c96b24d39ac7db4c1dbf6"
server_key_version: "kuduclusterkey@0"
I20260812 00:04:15.025769 2262 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.000s
I20260812 00:04:15.043678 2287 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:15.043907 2262 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260812 00:04:15.044018 2262 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-2/wal
uuid: "10c7aa06605d4ff8a3116342649ac785"
format_stamp: "Formatted at 2026-08-12 00:04:15 on dist-test-slave-f0tn"
server_key: "2dd185df7999e04e070ce8b2f53514ee"
server_key_iv: "3baed51b6a8c96b24d39ac7db4c1dbf6"
server_key_version: "kuduclusterkey@0"
I20260812 00:04:15.044112 2262 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:04:15.060779 2262 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:04:15.063045 2262 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:04:15.063299 2262 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:04:15.063638 2262 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:04:15.064175 2262 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:04:15.064267 2262 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:15.064350 2262 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:04:15.064409 2262 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:15.078169 2262 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.67:42163
I20260812 00:04:15.081707 2479 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.67:42163 every 8 connection(s)
I20260812 00:04:15.083966 2262 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
I20260812 00:04:15.084201 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 2262
I20260812 00:04:15.084386 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-2/wal/instance
I20260812 00:04:15.084697 12089 external_mini_cluster.cc:1428] Setting key 07fbaff553b3ca642d26c298df1f3ec4
Aug 12 00:04:15 dist-test-slave-f0tn krb5kdc[757](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493054, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.67@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:04:15.099726 2020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:15.085731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.67:55261 (local address 127.11.206.126:38897)
0812 00:04:15.085779 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:15.085781 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:15.087816 (+ 2035us) server_negotiation.cc:407] Connection header received
0812 00:04:15.088863 (+ 1047us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:15.088864 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:15.088875 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:15.088919 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:15.090129 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:15.090896 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:15.092612 (+ 1716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:15.092959 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:15.093038 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:15.096134 (+ 3096us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:15.096136 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:15.096136 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:04:15.096146 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:15.098095 (+ 1949us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:15.098553 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:15.098555 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:15.098556 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:15.098632 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:15.098971 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:15.098972 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:15.098973 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:15.099131 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:15.099214 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:15.099518 (+ 304us) server_negotiation.cc:299] Negotiation successful
0812 00:04:15.099629 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 00:04:15.099786 2486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:15.085321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:38897 (local address 127.11.206.67:55261)
0812 00:04:15.087619 (+ 2298us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:15.087677 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:15.088731 (+ 1054us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:15.089010 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:15.089015 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:15.089506 (+ 491us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:04:15.089986 (+ 480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:15.089994 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:15.091038 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:15.091039 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:15.092493 (+ 1454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:15.092496 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:15.093138 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:15.093140 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:15.093353 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:15.094131 (+ 778us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:04:15.094142 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:04:15.096029 (+ 1887us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:04:15.098195 (+ 2166us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:15.098202 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:15.098205 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:15.098448 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:15.098731 (+ 283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:15.098732 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:15.098733 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:15.098876 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:15.099213 (+ 337us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:04:15.099219 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:04:15.099362 (+ 143us) client_negotiation.cc:769] Sending connection context
0812 00:04:15.099451 (+ 89us) client_negotiation.cc:240] Negotiation successful
0812 00:04:15.099576 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2218,"thread_start_us":197,"threads_started":1}
I20260812 00:04:15.100356 2484 heartbeater.cc:347] Connected to a master server at 127.11.206.126:38897
I20260812 00:04:15.100450 2484 heartbeater.cc:464] Registering TS with master...
I20260812 00:04:15.100634 2484 heartbeater.cc:511] Master 127.11.206.126:38897 requested a full tablet report, sending...
I20260812 00:04:15.101012 1649 ts_manager.cc:194] Registered new tserver with Master: 10c7aa06605d4ff8a3116342649ac785 (127.11.206.67:42163)
I20260812 00:04:15.101410 1649 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.206.67@KRBTEST.COM'} at 127.11.206.67:55261
I20260812 00:04:15.107575 12089 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:04:15.108312 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 1787
I20260812 00:04:15.120383 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 2028
I20260812 00:04:15.128114 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 2262
I20260812 00:04:15.162930 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 1585
I20260812 00:04:15.191419 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:38897
--webserver_interface=127.11.206.126
--webserver_port=43849
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab
--principal=kudu/127.11.206.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:42823
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.206.126:38897
--ranger_config_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.206.84:38277/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.11.206.84:38277/kms with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:04:15.274562 2488 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:04:15.274801 2488 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:04:15.274824 2488 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:04:15.276005 2488 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:04:15.276050 2488 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:04:15.276063 2488 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:04:15.276074 2488 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:04:15.276085 2488 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:04:15.277762 2488 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:42823
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.11.206.84:38277/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.11.206.126:38897
--ranger_config_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab
--principal=kudu/127.11.206.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:38897
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.206.126
--webserver_port=43849
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2488
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:04:15.277998 2488 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:04:15.278219 2488 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:04:15.283241 2499 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:15.283305 2488 server_base.cc:1034] running on GCE node
W20260812 00:04:15.283286 2497 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:15.283279 2496 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:15.283696 2488 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:04:15.283998 2488 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:04:15.285154 2488 hybrid_clock.cc:648] HybridClock initialized: now 1786493055285129 us; error 39 us; skew 500 ppm
Aug 12 00:04:15 dist-test-slave-f0tn krb5kdc[757](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493055, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:04:15.287930 2488 init.cc:377] Logged in from keytab as kudu/127.11.206.126@KRBTEST.COM (short username kudu)
I20260812 00:04:15.288419 2488 webserver.cc:460] Webserver started at http://127.11.206.126:43849/ using document root <none> and password file <none>
I20260812 00:04:15.288630 2488 fs_manager.cc:359] Metadata directory not provided
I20260812 00:04:15.288694 2488 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 12 00:04:15 dist-test-slave-f0tn krb5kdc[757](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493055, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.126@KRBTEST.COM for HTTP/127.11.206.84@KRBTEST.COM
I20260812 00:04:15.355741 2488 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:04:15.356490 2516 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:15.356694 2488 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:04:15.356801 2488 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/master-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/master-0/wal
uuid: "1293b96c45954fcca9fe0fcfeb68b978"
format_stamp: "Formatted at 2026-08-12 00:04:13 on dist-test-slave-f0tn"
server_key: "4a2c12cc0f16a52511a212ba584016e3"
server_key_iv: "03438b7042b36fc760013ab4b6c63729"
server_key_version: "kuduclusterkey@0"
I20260812 00:04:15.357177 2488 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:04:15.389707 2488 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:04:15.391669 2488 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:04:15.391808 2488 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:04:15.396225 2488 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.126:38897
I20260812 00:04:15.396241 2601 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.126:38897 every 8 connection(s)
I20260812 00:04:15.396636 2488 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
I20260812 00:04:15.397529 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 2488
I20260812 00:04:15.397830 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.206.84:38277/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.65:35709
--local_ip_for_outbound_sockets=127.11.206.65
--tserver_master_addrs=127.11.206.126:38897
--webserver_port=33795
--webserver_interface=127.11.206.65
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.65.keytab
--principal=kudu/127.11.206.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:42823
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.11.206.84:38277/kms with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:04:15.398010 2602 sys_catalog.cc:263] Verifying existing consensus state
I20260812 00:04:15.398666 2602 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1293b96c45954fcca9fe0fcfeb68b978: Bootstrap starting.
I20260812 00:04:15.409068 2602 log.cc:824] T 00000000000000000000000000000000 P 1293b96c45954fcca9fe0fcfeb68b978: Log is configured to *not* fsync() on all Append() calls
I20260812 00:04:15.411334 2602 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1293b96c45954fcca9fe0fcfeb68b978: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 00:04:15.411634 2602 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1293b96c45954fcca9fe0fcfeb68b978: Bootstrap complete.
I20260812 00:04:15.414932 2602 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1293b96c45954fcca9fe0fcfeb68b978 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1293b96c45954fcca9fe0fcfeb68b978" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 38897 } }
I20260812 00:04:15.415252 2602 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1293b96c45954fcca9fe0fcfeb68b978 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1293b96c45954fcca9fe0fcfeb68b978, State: Initialized, Role: FOLLOWER
I20260812 00:04:15.415416 2602 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1293b96c45954fcca9fe0fcfeb68b978 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1293b96c45954fcca9fe0fcfeb68b978" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 38897 } }
I20260812 00:04:15.415478 2602 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1293b96c45954fcca9fe0fcfeb68b978 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:04:15.415520 2602 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1293b96c45954fcca9fe0fcfeb68b978 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:04:15.415563 2602 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1293b96c45954fcca9fe0fcfeb68b978 [term 1 FOLLOWER]: Advancing to term 2
I20260812 00:04:15.416807 2602 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1293b96c45954fcca9fe0fcfeb68b978 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1293b96c45954fcca9fe0fcfeb68b978" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 38897 } }
I20260812 00:04:15.416913 2602 leader_election.cc:302] T 00000000000000000000000000000000 P 1293b96c45954fcca9fe0fcfeb68b978 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1293b96c45954fcca9fe0fcfeb68b978; no voters:
I20260812 00:04:15.417071 2602 leader_election.cc:288] T 00000000000000000000000000000000 P 1293b96c45954fcca9fe0fcfeb68b978 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260812 00:04:15.417167 2611 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1293b96c45954fcca9fe0fcfeb68b978 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 00:04:15.417315 2602 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1293b96c45954fcca9fe0fcfeb68b978 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:04:15.417366 2611 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1293b96c45954fcca9fe0fcfeb68b978 [term 2 LEADER]: Becoming Leader. State: Replica: 1293b96c45954fcca9fe0fcfeb68b978, State: Running, Role: LEADER
I20260812 00:04:15.417516 2611 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1293b96c45954fcca9fe0fcfeb68b978 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1293b96c45954fcca9fe0fcfeb68b978" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 38897 } }
I20260812 00:04:15.417793 2611 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1293b96c45954fcca9fe0fcfeb68b978 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1293b96c45954fcca9fe0fcfeb68b978. Latest consensus state: current_term: 2 leader_uuid: "1293b96c45954fcca9fe0fcfeb68b978" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1293b96c45954fcca9fe0fcfeb68b978" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 38897 } } }
I20260812 00:04:15.417862 2611 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1293b96c45954fcca9fe0fcfeb68b978 [sys.catalog]: This master's current role is: LEADER
I20260812 00:04:15.417968 2612 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1293b96c45954fcca9fe0fcfeb68b978 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "1293b96c45954fcca9fe0fcfeb68b978" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1293b96c45954fcca9fe0fcfeb68b978" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 38897 } } }
I20260812 00:04:15.418104 2612 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1293b96c45954fcca9fe0fcfeb68b978 [sys.catalog]: This master's current role is: LEADER
I20260812 00:04:15.418263 2618 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:04:15.418864 2618 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:04:15.419051 2618 catalog_manager.cc:1259] Loaded cluster ID: e0868ebb4d8c4a90a83b1cbacf34bed4
I20260812 00:04:15.419130 2618 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:04:15.419198 2602 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260812 00:04:15.423514 2618 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:04:15.423964 2618 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 1293b96c45954fcca9fe0fcfeb68b978: Loaded TSK: 0
I20260812 00:04:15.424276 2618 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 00:04:15.515053 2606 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:04:15.515345 2606 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:04:15.515385 2606 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:04:15.517128 2606 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:04:15.517199 2606 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:04:15.517252 2606 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.65
I20260812 00:04:15.519559 2606 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:42823
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.11.206.84:38277/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.65.keytab
--principal=kudu/127.11.206.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.65:35709
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.206.65
--webserver_port=33795
--tserver_master_addrs=127.11.206.126:38897
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2606
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.65
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:04:15.520040 2606 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:04:15.520345 2606 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:04:15.527688 2666 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:15.527688 2667 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:15.528918 2672 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:15.529008 2606 server_base.cc:1034] running on GCE node
I20260812 00:04:15.529295 2606 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:04:15.529592 2606 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:04:15.530769 2606 hybrid_clock.cc:648] HybridClock initialized: now 1786493055530745 us; error 38 us; skew 500 ppm
Aug 12 00:04:15 dist-test-slave-f0tn krb5kdc[757](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493055, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:04:15.534274 2606 init.cc:377] Logged in from keytab as kudu/127.11.206.65@KRBTEST.COM (short username kudu)
I20260812 00:04:15.534826 2606 webserver.cc:460] Webserver started at http://127.11.206.65:33795/ using document root <none> and password file <none>
I20260812 00:04:15.535101 2606 fs_manager.cc:359] Metadata directory not provided
I20260812 00:04:15.535175 2606 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 12 00:04:15 dist-test-slave-f0tn krb5kdc[757](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493055, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.65@KRBTEST.COM for HTTP/127.11.206.84@KRBTEST.COM
I20260812 00:04:15.565644 2606 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.001s sys 0.000s
I20260812 00:04:15.567468 2687 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:15.567708 2606 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 00:04:15.567795 2606 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-0/wal
uuid: "dc8c279da2eb4105ba90dec8ed266591"
format_stamp: "Formatted at 2026-08-12 00:04:14 on dist-test-slave-f0tn"
server_key: "c4d3ee5cbae5b06dd277d62bb55fe852"
server_key_iv: "ac36b0bbaa7b8d9cf59711b32d9510ba"
server_key_version: "kuduclusterkey@0"
I20260812 00:04:15.568296 2606 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:04:15.584825 2606 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:04:15.587316 2606 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:04:15.587538 2606 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:04:15.587826 2606 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:04:15.588299 2606 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:04:15.588397 2606 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:15.588501 2606 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:04:15.588577 2606 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:15.595572 2606 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.65:35709
I20260812 00:04:15.595674 2876 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.65:35709 every 8 connection(s)
I20260812 00:04:15.596081 2606 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
I20260812 00:04:15.597602 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 2606
I20260812 00:04:15.597887 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.206.84:38277/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.66:37021
--local_ip_for_outbound_sockets=127.11.206.66
--tserver_master_addrs=127.11.206.126:38897
--webserver_port=35343
--webserver_interface=127.11.206.66
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.66.keytab
--principal=kudu/127.11.206.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:42823
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.11.206.84:38277/kms with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 00:04:15 dist-test-slave-f0tn krb5kdc[757](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493055, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.65@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:04:15.610769 2883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:15.597046 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.65:42059 (local address 127.11.206.126:38897)
0812 00:04:15.597247 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:15.597258 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:15.597508 (+ 250us) server_negotiation.cc:407] Connection header received
0812 00:04:15.598365 (+ 857us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:15.598374 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:15.598435 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:15.598557 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:15.599406 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:15.600804 (+ 1398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:15.603107 (+ 2303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:15.603735 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:15.603818 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:15.606490 (+ 2672us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:15.606496 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:15.606496 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:04:15.606509 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:15.608434 (+ 1925us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:15.608967 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:15.608971 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:15.608971 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:15.609092 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:15.609415 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:15.609416 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:15.609416 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:15.609748 (+ 332us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:15.609821 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:15.610244 (+ 423us) server_negotiation.cc:299] Negotiation successful
0812 00:04:15.610515 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":70,"threads_started":1}
I20260812 00:04:15.611764 2882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:15.596977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:38897 (local address 127.11.206.65:42059)
0812 00:04:15.597332 (+ 355us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:15.597367 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:15.598108 (+ 741us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:15.598768 (+ 660us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:15.598771 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:15.598990 (+ 219us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:04:15.599262 (+ 272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:15.599269 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:15.600935 (+ 1666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:15.600936 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:15.602997 (+ 2061us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:15.603000 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:15.603970 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:15.603971 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:15.604109 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:15.604714 (+ 605us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:04:15.604724 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:04:15.606356 (+ 1632us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:04:15.608537 (+ 2181us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:15.608557 (+ 20us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:15.608560 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:15.608864 (+ 304us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:15.609170 (+ 306us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:15.609171 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:15.609171 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:15.609307 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:15.609860 (+ 553us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:04:15.609866 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:04:15.610031 (+ 165us) client_negotiation.cc:769] Sending connection context
0812 00:04:15.611315 (+ 1284us) client_negotiation.cc:240] Negotiation successful
0812 00:04:15.611508 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":317,"thread_start_us":102,"threads_started":1}
I20260812 00:04:15.612875 2877 heartbeater.cc:347] Connected to a master server at 127.11.206.126:38897
I20260812 00:04:15.612983 2877 heartbeater.cc:464] Registering TS with master...
I20260812 00:04:15.613179 2877 heartbeater.cc:511] Master 127.11.206.126:38897 requested a full tablet report, sending...
W20260812 00:04:15.614166 2877 heartbeater.cc:644] Failed to heartbeat to 127.11.206.126:38897 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260812 00:04:15.614238 2877 heartbeater.cc:464] Registering TS with master...
I20260812 00:04:15.614300 2877 heartbeater.cc:511] Master 127.11.206.126:38897 requested a full tablet report, sending...
I20260812 00:04:15.614717 2877 heartbeater.cc:464] Registering TS with master...
I20260812 00:04:15.614787 2877 heartbeater.cc:511] Master 127.11.206.126:38897 requested a full tablet report, sending...
W20260812 00:04:15.615118 2877 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 00:04:15.726598 2884 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:04:15.726889 2884 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:04:15.726941 2884 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:04:15.728602 2884 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:04:15.728664 2884 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:04:15.728703 2884 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.66
I20260812 00:04:15.730921 2884 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:42823
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.11.206.84:38277/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.66.keytab
--principal=kudu/127.11.206.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.66:37021
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.206.66
--webserver_port=35343
--tserver_master_addrs=127.11.206.126:38897
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2884
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.66
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:04:15.731175 2884 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:04:15.731515 2884 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:04:15.736891 2891 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:15.737010 2884 server_base.cc:1034] running on GCE node
W20260812 00:04:15.736902 2893 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:15.737082 2895 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:15.737398 2884 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:04:15.737706 2884 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:04:15.738894 2884 hybrid_clock.cc:648] HybridClock initialized: now 1786493055738875 us; error 33 us; skew 500 ppm
Aug 12 00:04:15 dist-test-slave-f0tn krb5kdc[757](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493055, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:04:15.742214 2884 init.cc:377] Logged in from keytab as kudu/127.11.206.66@KRBTEST.COM (short username kudu)
I20260812 00:04:15.742774 2884 webserver.cc:460] Webserver started at http://127.11.206.66:35343/ using document root <none> and password file <none>
I20260812 00:04:15.743054 2884 fs_manager.cc:359] Metadata directory not provided
I20260812 00:04:15.743136 2884 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 12 00:04:15 dist-test-slave-f0tn krb5kdc[757](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493055, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.66@KRBTEST.COM for HTTP/127.11.206.84@KRBTEST.COM
I20260812 00:04:15.758761 2884 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:04:15.760819 2911 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:15.761044 2884 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 00:04:15.761143 2884 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-1/wal
uuid: "5c4cf6dcd7e642abb49a592ddc6a3691"
format_stamp: "Formatted at 2026-08-12 00:04:14 on dist-test-slave-f0tn"
server_key: "02cd637fae4702d344fe615e1b21ed16"
server_key_iv: "c896c60f71f583f33d1c4846f2115f2f"
server_key_version: "kuduclusterkey@0"
I20260812 00:04:15.761571 2884 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:04:15.790020 2884 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:04:15.792079 2884 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:04:15.792217 2884 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:04:15.792457 2884 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:04:15.792824 2884 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:04:15.792862 2884 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:15.792894 2884 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:04:15.792914 2884 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:15.800123 2884 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.66:37021
I20260812 00:04:15.800268 3086 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.66:37021 every 8 connection(s)
I20260812 00:04:15.800554 2884 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
I20260812 00:04:15.800920 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 2884
I20260812 00:04:15.801182 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.206.84:38277/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.67:42163
--local_ip_for_outbound_sockets=127.11.206.67
--tserver_master_addrs=127.11.206.126:38897
--webserver_port=42771
--webserver_interface=127.11.206.67
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.67.keytab
--principal=kudu/127.11.206.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:42823
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.11.206.84:38277/kms with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 00:04:15 dist-test-slave-f0tn krb5kdc[757](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493055, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.66@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:04:15.813542 2883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:15.803575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.66:60877 (local address 127.11.206.126:38897)
0812 00:04:15.803632 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:15.803634 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:15.803647 (+ 13us) server_negotiation.cc:407] Connection header received
0812 00:04:15.804262 (+ 615us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:15.804264 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:15.804277 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:15.804344 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:15.805061 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:15.805859 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:15.807354 (+ 1495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:15.807650 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:15.807728 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:15.810119 (+ 2391us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:15.810120 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:15.810121 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:04:15.810129 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:15.811819 (+ 1690us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:15.812351 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:15.812353 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:15.812354 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:15.812424 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:15.812734 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:15.812735 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:15.812735 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:15.812880 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:15.812923 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:15.813328 (+ 405us) server_negotiation.cc:299] Negotiation successful
0812 00:04:15.813444 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260812 00:04:15.814078 3094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:15.803259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:38897 (local address 127.11.206.66:60877)
0812 00:04:15.803442 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:15.803497 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:15.804118 (+ 621us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:15.804423 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:15.804428 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:15.804661 (+ 233us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:04:15.804939 (+ 278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:15.804945 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:15.805969 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:15.805970 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:15.807249 (+ 1279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:15.807252 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:15.807759 (+ 507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:15.807760 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:15.807904 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:15.808488 (+ 584us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:04:15.808498 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:04:15.809998 (+ 1500us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:04:15.811903 (+ 1905us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:15.811911 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:15.811913 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:15.812249 (+ 336us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:15.812498 (+ 249us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:15.812499 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:15.812499 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:15.812642 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:15.812972 (+ 330us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:04:15.812979 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:04:15.813164 (+ 185us) client_negotiation.cc:769] Sending connection context
0812 00:04:15.813653 (+ 489us) client_negotiation.cc:240] Negotiation successful
0812 00:04:15.813824 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":86,"threads_started":1}
I20260812 00:04:15.814553 3087 heartbeater.cc:347] Connected to a master server at 127.11.206.126:38897
I20260812 00:04:15.814646 3087 heartbeater.cc:464] Registering TS with master...
I20260812 00:04:15.814834 3087 heartbeater.cc:511] Master 127.11.206.126:38897 requested a full tablet report, sending...
W20260812 00:04:15.815582 3087 heartbeater.cc:644] Failed to heartbeat to 127.11.206.126:38897 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260812 00:04:15.815649 3087 heartbeater.cc:464] Registering TS with master...
I20260812 00:04:15.815711 3087 heartbeater.cc:511] Master 127.11.206.126:38897 requested a full tablet report, sending...
I20260812 00:04:15.816066 3087 heartbeater.cc:464] Registering TS with master...
I20260812 00:04:15.816143 3087 heartbeater.cc:511] Master 127.11.206.126:38897 requested a full tablet report, sending...
W20260812 00:04:15.816417 3087 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 00:04:15.906550 3092 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:04:15.906855 3092 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:04:15.906898 3092 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:04:15.908110 3092 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:04:15.908156 3092 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:04:15.908192 3092 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.67
I20260812 00:04:15.909924 3092 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:42823
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.11.206.84:38277/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.67.keytab
--principal=kudu/127.11.206.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.67:42163
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.206.67
--webserver_port=42771
--tserver_master_addrs=127.11.206.126:38897
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3092
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.67
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:04:15.910167 3092 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:04:15.910390 3092 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:04:15.915654 3115 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:15.915684 3108 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:15.915654 3105 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:15.915970 3092 server_base.cc:1034] running on GCE node
I20260812 00:04:15.916175 3092 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:04:15.916417 3092 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:04:15.917567 3092 hybrid_clock.cc:648] HybridClock initialized: now 1786493055917549 us; error 32 us; skew 500 ppm
Aug 12 00:04:15 dist-test-slave-f0tn krb5kdc[757](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493055, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:04:15.920228 3092 init.cc:377] Logged in from keytab as kudu/127.11.206.67@KRBTEST.COM (short username kudu)
I20260812 00:04:15.920682 3092 webserver.cc:460] Webserver started at http://127.11.206.67:42771/ using document root <none> and password file <none>
I20260812 00:04:15.920926 3092 fs_manager.cc:359] Metadata directory not provided
I20260812 00:04:15.921003 3092 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 12 00:04:15 dist-test-slave-f0tn krb5kdc[757](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493055, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.67@KRBTEST.COM for HTTP/127.11.206.84@KRBTEST.COM
I20260812 00:04:15.947975 3092 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.001s sys 0.000s
I20260812 00:04:15.949098 3131 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:15.949295 3092 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:04:15.949368 3092 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-2/wal
uuid: "10c7aa06605d4ff8a3116342649ac785"
format_stamp: "Formatted at 2026-08-12 00:04:15 on dist-test-slave-f0tn"
server_key: "2dd185df7999e04e070ce8b2f53514ee"
server_key_iv: "3baed51b6a8c96b24d39ac7db4c1dbf6"
server_key_version: "kuduclusterkey@0"
I20260812 00:04:15.949862 3092 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:04:15.975790 3092 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:04:15.977805 3092 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:04:15.977960 3092 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:04:15.978179 3092 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:04:15.978559 3092 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:04:15.978601 3092 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:15.978631 3092 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:04:15.978657 3092 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:15.985607 3092 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.67:42163
I20260812 00:04:15.985654 3335 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.67:42163 every 8 connection(s)
I20260812 00:04:15.986027 3092 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
I20260812 00:04:15.988277 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 3092
Aug 12 00:04:15 dist-test-slave-f0tn krb5kdc[757](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493055, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.67@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:04:15.999761 2883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:15.986806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.67:58243 (local address 127.11.206.126:38897)
0812 00:04:15.986876 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:15.986878 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:15.987114 (+ 236us) server_negotiation.cc:407] Connection header received
0812 00:04:15.987634 (+ 520us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:15.987635 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:15.987650 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:15.987699 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:15.988300 (+ 601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:15.989013 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:15.990604 (+ 1591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:15.990891 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:15.990960 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:15.996540 (+ 5580us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:15.996542 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:15.996542 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:04:15.996551 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:15.998164 (+ 1613us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:15.998715 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:15.998716 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:15.998716 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:15.998775 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:15.999088 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:15.999089 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:15.999089 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:15.999223 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:15.999263 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:15.999584 (+ 321us) server_negotiation.cc:299] Negotiation successful
0812 00:04:15.999665 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260812 00:04:15.999963 3340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:15.986784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:38897 (local address 127.11.206.67:58243)
0812 00:04:15.986963 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:15.987008 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:15.987531 (+ 523us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:15.987792 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:15.987796 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:15.987986 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:04:15.988206 (+ 220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:15.988212 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:15.989118 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:15.989120 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:15.990499 (+ 1379us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:15.990503 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:15.991062 (+ 559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:15.991064 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:15.991232 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:15.991795 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:04:15.991806 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:04:15.996414 (+ 4608us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:04:15.998266 (+ 1852us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:15.998278 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:15.998280 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:15.998620 (+ 340us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:15.998849 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:15.998850 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:15.998851 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:15.999011 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:15.999307 (+ 296us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:04:15.999314 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:04:15.999456 (+ 142us) client_negotiation.cc:769] Sending connection context
0812 00:04:15.999547 (+ 91us) client_negotiation.cc:240] Negotiation successful
0812 00:04:15.999722 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":102,"threads_started":1}
I20260812 00:04:16.000607 3336 heartbeater.cc:347] Connected to a master server at 127.11.206.126:38897
I20260812 00:04:16.000725 3336 heartbeater.cc:464] Registering TS with master...
I20260812 00:04:16.000933 3336 heartbeater.cc:511] Master 127.11.206.126:38897 requested a full tablet report, sending...
W20260812 00:04:16.001659 3336 heartbeater.cc:644] Failed to heartbeat to 127.11.206.126:38897 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260812 00:04:16.001741 3336 heartbeater.cc:464] Registering TS with master...
I20260812 00:04:16.001827 3336 heartbeater.cc:511] Master 127.11.206.126:38897 requested a full tablet report, sending...
I20260812 00:04:16.002149 3336 heartbeater.cc:464] Registering TS with master...
I20260812 00:04:16.002270 3336 heartbeater.cc:511] Master 127.11.206.126:38897 requested a full tablet report, sending...
W20260812 00:04:16.002683 3336 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260812 00:04:16.003057 3342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:15.988871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59154 (local address 127.11.206.126:38897)
0812 00:04:15.989166 (+ 295us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:15.989167 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:15.989172 (+ 5us) server_negotiation.cc:407] Connection header received
0812 00:04:15.989189 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:15.989189 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:15.989199 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:15.989253 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:15.989909 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:15.990432 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:15.995328 (+ 4896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:15.995558 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:15.995628 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:15.997634 (+ 2006us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:15.997635 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:15.997636 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:04:15.997644 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:15.999194 (+ 1550us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:16.000606 (+ 1412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:16.000607 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:16.000607 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:16.000668 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:16.001355 (+ 687us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:16.001356 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:16.001356 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:16.001516 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:16.001670 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:16.002830 (+ 1160us) server_negotiation.cc:299] Negotiation successful
0812 00:04:16.002930 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":277,"thread_start_us":62,"threads_started":1}
I20260812 00:04:16.615299 2877 heartbeater.cc:464] Registering TS with master...
I20260812 00:04:16.615483 2877 heartbeater.cc:511] Master 127.11.206.126:38897 requested a full tablet report, sending...
I20260812 00:04:16.615970 2551 ts_manager.cc:194] Registered new tserver with Master: dc8c279da2eb4105ba90dec8ed266591 (127.11.206.65:35709)
I20260812 00:04:16.617040 2551 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.206.65@KRBTEST.COM'} at 127.11.206.65:42059
Aug 12 00:04:16 dist-test-slave-f0tn krb5kdc[757](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786493056, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:04:16.816614 3087 heartbeater.cc:464] Registering TS with master...
I20260812 00:04:16.816798 3087 heartbeater.cc:511] Master 127.11.206.126:38897 requested a full tablet report, sending...
I20260812 00:04:16.817425 2551 ts_manager.cc:194] Registered new tserver with Master: 5c4cf6dcd7e642abb49a592ddc6a3691 (127.11.206.66:37021)
I20260812 00:04:16.817984 2551 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.206.66@KRBTEST.COM'} at 127.11.206.66:60877
I20260812 00:04:17.002882 3336 heartbeater.cc:464] Registering TS with master...
I20260812 00:04:17.003044 3336 heartbeater.cc:511] Master 127.11.206.126:38897 requested a full tablet report, sending...
I20260812 00:04:17.003403 2551 ts_manager.cc:194] Registered new tserver with Master: 10c7aa06605d4ff8a3116342649ac785 (127.11.206.67:42163)
I20260812 00:04:17.003803 2551 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.206.67@KRBTEST.COM'} at 127.11.206.67:58243
I20260812 00:04:17.006623 12089 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:04:17.013967 3375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:17.007569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59168 (local address 127.11.206.126:38897)
0812 00:04:17.007717 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:17.007719 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:17.007774 (+ 55us) server_negotiation.cc:407] Connection header received
0812 00:04:17.007824 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:17.007825 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:17.007836 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:17.007897 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:17.008497 (+ 600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:17.008994 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:17.009736 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:17.009945 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:17.010000 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:17.011282 (+ 1282us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:17.011283 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:17.011284 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:04:17.011291 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:17.012686 (+ 1395us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:17.013056 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:17.013058 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:17.013058 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:17.013152 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:17.013337 (+ 185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:17.013337 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:17.013338 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:17.013527 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:17.013650 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:17.013745 (+ 95us) server_negotiation.cc:299] Negotiation successful
0812 00:04:17.013853 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":94,"threads_started":1}
I20260812 00:04:17.016054 2551 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59168:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:04:17.018846 2551 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:04:17.038722 3391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:17.022131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.65:35709 (local address 127.0.0.1:33274)
0812 00:04:17.033135 (+ 11004us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:17.033205 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:17.033305 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:17.033829 (+ 524us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:17.033834 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:17.033837 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:04:17.033928 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:17.033931 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:17.035242 (+ 1311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:17.035243 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:17.036588 (+ 1345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:17.036592 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:17.037868 (+ 1276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:17.037869 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:17.037957 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:17.038472 (+ 515us) client_negotiation.cc:769] Sending connection context
0812 00:04:17.038554 (+ 82us) client_negotiation.cc:240] Negotiation successful
0812 00:04:17.038622 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10939,"mutex_wait_us":475,"thread_start_us":8654,"threads_started":1}
I20260812 00:04:17.041232 3385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:17.022365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48588 (local address 127.11.206.66:37021)
0812 00:04:17.022513 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:17.022519 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:17.035365 (+ 12846us) server_negotiation.cc:407] Connection header received
0812 00:04:17.035627 (+ 262us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:17.035631 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:17.035651 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:17.035714 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:04:17.036638 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:17.037692 (+ 1054us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:17.039974 (+ 2282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:17.040754 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:17.040834 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:17.040889 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:17.041097 (+ 208us) server_negotiation.cc:299] Negotiation successful
0812 00:04:17.041140 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":74,"threads_started":1}
I20260812 00:04:17.041682 3392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:17.022155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.66:37021 (local address 127.0.0.1:48588)
0812 00:04:17.035263 (+ 13108us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:17.035277 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:17.035500 (+ 223us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:17.036321 (+ 821us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:17.036322 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:17.036325 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:04:17.036513 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:17.036516 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:17.037811 (+ 1295us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:17.037812 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:17.039879 (+ 2067us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:17.039883 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:17.040926 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:17.040927 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:17.041001 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:17.041006 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 00:04:17.041539 (+ 533us) client_negotiation.cc:240] Negotiation successful
0812 00:04:17.041586 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13061,"thread_start_us":8879,"threads_started":1}
I20260812 00:04:17.042539 2991 tablet_service.cc:1467] Processing CreateTablet for tablet a66e1b68230c418daf1a5f1475720da1 (DEFAULT_TABLE table=test-table [id=b7f98a0bc05a4380a59f017420b78286]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:04:17.042968 2991 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a66e1b68230c418daf1a5f1475720da1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:04:17.047340 3397 tablet_bootstrap.cc:492] T a66e1b68230c418daf1a5f1475720da1 P 5c4cf6dcd7e642abb49a592ddc6a3691: Bootstrap starting.
I20260812 00:04:17.048223 3397 tablet_bootstrap.cc:654] T a66e1b68230c418daf1a5f1475720da1 P 5c4cf6dcd7e642abb49a592ddc6a3691: Neither blocks nor log segments found. Creating new log.
I20260812 00:04:17.048691 3397 log.cc:824] T a66e1b68230c418daf1a5f1475720da1 P 5c4cf6dcd7e642abb49a592ddc6a3691: Log is configured to *not* fsync() on all Append() calls
I20260812 00:04:17.049687 3386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:17.022534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33274 (local address 127.11.206.65:35709)
0812 00:04:17.022691 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:17.022695 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:17.033437 (+ 10742us) server_negotiation.cc:407] Connection header received
0812 00:04:17.033554 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:17.033557 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:17.033577 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:17.033656 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:04:17.034029 (+ 373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:17.035136 (+ 1107us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:17.036690 (+ 1554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:17.037658 (+ 968us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:17.037731 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:17.037800 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:17.049471 (+ 11671us) server_negotiation.cc:299] Negotiation successful
0812 00:04:17.049554 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":66,"threads_started":1}
I20260812 00:04:17.049697 3397 tablet_bootstrap.cc:492] T a66e1b68230c418daf1a5f1475720da1 P 5c4cf6dcd7e642abb49a592ddc6a3691: No bootstrap required, opened a new log
I20260812 00:04:17.049778 3397 ts_tablet_manager.cc:1397] T a66e1b68230c418daf1a5f1475720da1 P 5c4cf6dcd7e642abb49a592ddc6a3691: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 00:04:17.049887 3389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:17.031388 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.67:42163 (local address 127.0.0.1:54314)
0812 00:04:17.039249 (+ 7861us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:17.039262 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:17.039329 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:17.039979 (+ 650us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:17.039980 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:17.039982 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:04:17.040017 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:17.040018 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:17.041193 (+ 1175us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:17.041194 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:17.048221 (+ 7027us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:17.048227 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:17.049598 (+ 1371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:17.049600 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:17.049675 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:17.049682 (+ 7us) client_negotiation.cc:769] Sending connection context
0812 00:04:17.049745 (+ 63us) client_negotiation.cc:240] Negotiation successful
0812 00:04:17.049801 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7814,"thread_start_us":115,"threads_started":1}
I20260812 00:04:17.050254 3395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:17.031655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54314 (local address 127.11.206.67:42163)
0812 00:04:17.035462 (+ 3807us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:17.035468 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:17.039404 (+ 3936us) server_negotiation.cc:407] Connection header received
0812 00:04:17.039450 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:17.039453 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:17.039471 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:17.039556 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:04:17.040122 (+ 566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:17.041105 (+ 983us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:17.048356 (+ 7251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:17.049371 (+ 1015us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:17.049477 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:17.049548 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:17.050070 (+ 522us) server_negotiation.cc:299] Negotiation successful
0812 00:04:17.050123 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3764,"thread_start_us":65,"threads_started":1}
I20260812 00:04:17.050627 2761 tablet_service.cc:1467] Processing CreateTablet for tablet a66e1b68230c418daf1a5f1475720da1 (DEFAULT_TABLE table=test-table [id=b7f98a0bc05a4380a59f017420b78286]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:04:17.051070 2761 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a66e1b68230c418daf1a5f1475720da1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:04:17.052500 3397 raft_consensus.cc:348] T a66e1b68230c418daf1a5f1475720da1 P 5c4cf6dcd7e642abb49a592ddc6a3691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc8c279da2eb4105ba90dec8ed266591" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 35709 } } peers { permanent_uuid: "5c4cf6dcd7e642abb49a592ddc6a3691" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37021 } } peers { permanent_uuid: "10c7aa06605d4ff8a3116342649ac785" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 42163 } }
I20260812 00:04:17.052647 3397 raft_consensus.cc:374] T a66e1b68230c418daf1a5f1475720da1 P 5c4cf6dcd7e642abb49a592ddc6a3691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:04:17.052670 3397 raft_consensus.cc:729] T a66e1b68230c418daf1a5f1475720da1 P 5c4cf6dcd7e642abb49a592ddc6a3691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c4cf6dcd7e642abb49a592ddc6a3691, State: Initialized, Role: FOLLOWER
I20260812 00:04:17.052774 3397 consensus_queue.cc:260] T a66e1b68230c418daf1a5f1475720da1 P 5c4cf6dcd7e642abb49a592ddc6a3691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc8c279da2eb4105ba90dec8ed266591" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 35709 } } peers { permanent_uuid: "5c4cf6dcd7e642abb49a592ddc6a3691" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37021 } } peers { permanent_uuid: "10c7aa06605d4ff8a3116342649ac785" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 42163 } }
I20260812 00:04:17.053100 3397 ts_tablet_manager.cc:1428] T a66e1b68230c418daf1a5f1475720da1 P 5c4cf6dcd7e642abb49a592ddc6a3691: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 00:04:17.053212 3087 heartbeater.cc:503] Master 127.11.206.126:38897 was elected leader, sending a full tablet report...
W20260812 00:04:17.053831 3088 tablet.cc:2369] T a66e1b68230c418daf1a5f1475720da1 P 5c4cf6dcd7e642abb49a592ddc6a3691: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:04:17.053913 3213 tablet_service.cc:1467] Processing CreateTablet for tablet a66e1b68230c418daf1a5f1475720da1 (DEFAULT_TABLE table=test-table [id=b7f98a0bc05a4380a59f017420b78286]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:04:17.054347 3213 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a66e1b68230c418daf1a5f1475720da1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:04:17.057619 3408 tablet_bootstrap.cc:492] T a66e1b68230c418daf1a5f1475720da1 P dc8c279da2eb4105ba90dec8ed266591: Bootstrap starting.
I20260812 00:04:17.058676 3408 tablet_bootstrap.cc:654] T a66e1b68230c418daf1a5f1475720da1 P dc8c279da2eb4105ba90dec8ed266591: Neither blocks nor log segments found. Creating new log.
I20260812 00:04:17.058676 3409 tablet_bootstrap.cc:492] T a66e1b68230c418daf1a5f1475720da1 P 10c7aa06605d4ff8a3116342649ac785: Bootstrap starting.
I20260812 00:04:17.059542 3408 log.cc:824] T a66e1b68230c418daf1a5f1475720da1 P dc8c279da2eb4105ba90dec8ed266591: Log is configured to *not* fsync() on all Append() calls
I20260812 00:04:17.059839 3409 tablet_bootstrap.cc:654] T a66e1b68230c418daf1a5f1475720da1 P 10c7aa06605d4ff8a3116342649ac785: Neither blocks nor log segments found. Creating new log.
I20260812 00:04:17.060523 3408 tablet_bootstrap.cc:492] T a66e1b68230c418daf1a5f1475720da1 P dc8c279da2eb4105ba90dec8ed266591: No bootstrap required, opened a new log
I20260812 00:04:17.060599 3408 ts_tablet_manager.cc:1397] T a66e1b68230c418daf1a5f1475720da1 P dc8c279da2eb4105ba90dec8ed266591: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 00:04:17.060622 3409 log.cc:824] T a66e1b68230c418daf1a5f1475720da1 P 10c7aa06605d4ff8a3116342649ac785: Log is configured to *not* fsync() on all Append() calls
I20260812 00:04:17.065131 3408 raft_consensus.cc:348] T a66e1b68230c418daf1a5f1475720da1 P dc8c279da2eb4105ba90dec8ed266591 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc8c279da2eb4105ba90dec8ed266591" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 35709 } } peers { permanent_uuid: "5c4cf6dcd7e642abb49a592ddc6a3691" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37021 } } peers { permanent_uuid: "10c7aa06605d4ff8a3116342649ac785" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 42163 } }
I20260812 00:04:17.065341 3408 raft_consensus.cc:374] T a66e1b68230c418daf1a5f1475720da1 P dc8c279da2eb4105ba90dec8ed266591 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:04:17.065425 3408 raft_consensus.cc:729] T a66e1b68230c418daf1a5f1475720da1 P dc8c279da2eb4105ba90dec8ed266591 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc8c279da2eb4105ba90dec8ed266591, State: Initialized, Role: FOLLOWER
I20260812 00:04:17.065558 3408 consensus_queue.cc:260] T a66e1b68230c418daf1a5f1475720da1 P dc8c279da2eb4105ba90dec8ed266591 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc8c279da2eb4105ba90dec8ed266591" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 35709 } } peers { permanent_uuid: "5c4cf6dcd7e642abb49a592ddc6a3691" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37021 } } peers { permanent_uuid: "10c7aa06605d4ff8a3116342649ac785" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 42163 } }
I20260812 00:04:17.065902 3408 ts_tablet_manager.cc:1428] T a66e1b68230c418daf1a5f1475720da1 P dc8c279da2eb4105ba90dec8ed266591: Time spent starting tablet: real 0.005s user 0.002s sys 0.004s
I20260812 00:04:17.066038 2877 heartbeater.cc:503] Master 127.11.206.126:38897 was elected leader, sending a full tablet report...
I20260812 00:04:17.067531 3409 tablet_bootstrap.cc:492] T a66e1b68230c418daf1a5f1475720da1 P 10c7aa06605d4ff8a3116342649ac785: No bootstrap required, opened a new log
I20260812 00:04:17.067607 3409 ts_tablet_manager.cc:1397] T a66e1b68230c418daf1a5f1475720da1 P 10c7aa06605d4ff8a3116342649ac785: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20260812 00:04:17.071292 3409 raft_consensus.cc:348] T a66e1b68230c418daf1a5f1475720da1 P 10c7aa06605d4ff8a3116342649ac785 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc8c279da2eb4105ba90dec8ed266591" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 35709 } } peers { permanent_uuid: "5c4cf6dcd7e642abb49a592ddc6a3691" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37021 } } peers { permanent_uuid: "10c7aa06605d4ff8a3116342649ac785" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 42163 } }
I20260812 00:04:17.071439 3409 raft_consensus.cc:374] T a66e1b68230c418daf1a5f1475720da1 P 10c7aa06605d4ff8a3116342649ac785 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:04:17.071470 3409 raft_consensus.cc:729] T a66e1b68230c418daf1a5f1475720da1 P 10c7aa06605d4ff8a3116342649ac785 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c7aa06605d4ff8a3116342649ac785, State: Initialized, Role: FOLLOWER
I20260812 00:04:17.071594 3409 consensus_queue.cc:260] T a66e1b68230c418daf1a5f1475720da1 P 10c7aa06605d4ff8a3116342649ac785 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc8c279da2eb4105ba90dec8ed266591" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 35709 } } peers { permanent_uuid: "5c4cf6dcd7e642abb49a592ddc6a3691" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37021 } } peers { permanent_uuid: "10c7aa06605d4ff8a3116342649ac785" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 42163 } }
I20260812 00:04:17.071933 3409 ts_tablet_manager.cc:1428] T a66e1b68230c418daf1a5f1475720da1 P 10c7aa06605d4ff8a3116342649ac785: Time spent starting tablet: real 0.004s user 0.005s sys 0.000s
I20260812 00:04:17.072055 3336 heartbeater.cc:503] Master 127.11.206.126:38897 was elected leader, sending a full tablet report...
W20260812 00:04:17.098253 2879 tablet.cc:2369] T a66e1b68230c418daf1a5f1475720da1 P dc8c279da2eb4105ba90dec8ed266591: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 12 00:04:17 dist-test-slave-f0tn krb5kdc[757](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493056, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.126@KRBTEST.COM for HTTP/127.11.206.84@KRBTEST.COM
W20260812 00:04:17.237211 3339 tablet.cc:2369] T a66e1b68230c418daf1a5f1475720da1 P 10c7aa06605d4ff8a3116342649ac785: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:04:17.443049 3403 raft_consensus.cc:482] T a66e1b68230c418daf1a5f1475720da1 P 5c4cf6dcd7e642abb49a592ddc6a3691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:04:17.443222 3403 raft_consensus.cc:504] T a66e1b68230c418daf1a5f1475720da1 P 5c4cf6dcd7e642abb49a592ddc6a3691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc8c279da2eb4105ba90dec8ed266591" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 35709 } } peers { permanent_uuid: "5c4cf6dcd7e642abb49a592ddc6a3691" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37021 } } peers { permanent_uuid: "10c7aa06605d4ff8a3116342649ac785" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 42163 } }
I20260812 00:04:17.443775 3403 leader_election.cc:288] T a66e1b68230c418daf1a5f1475720da1 P 5c4cf6dcd7e642abb49a592ddc6a3691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc8c279da2eb4105ba90dec8ed266591 (127.11.206.65:35709), 10c7aa06605d4ff8a3116342649ac785 (127.11.206.67:42163)
I20260812 00:04:17.445802 3413 raft_consensus.cc:482] T a66e1b68230c418daf1a5f1475720da1 P dc8c279da2eb4105ba90dec8ed266591 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:04:17.445921 3413 raft_consensus.cc:504] T a66e1b68230c418daf1a5f1475720da1 P dc8c279da2eb4105ba90dec8ed266591 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc8c279da2eb4105ba90dec8ed266591" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 35709 } } peers { permanent_uuid: "5c4cf6dcd7e642abb49a592ddc6a3691" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37021 } } peers { permanent_uuid: "10c7aa06605d4ff8a3116342649ac785" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 42163 } }
I20260812 00:04:17.446420 3413 leader_election.cc:288] T a66e1b68230c418daf1a5f1475720da1 P dc8c279da2eb4105ba90dec8ed266591 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c4cf6dcd7e642abb49a592ddc6a3691 (127.11.206.66:37021), 10c7aa06605d4ff8a3116342649ac785 (127.11.206.67:42163)
I20260812 00:04:17.448212 3395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:17.444432 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.66:43273 (local address 127.11.206.67:42163)
0812 00:04:17.444476 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:17.444478 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:17.444634 (+ 156us) server_negotiation.cc:407] Connection header received
0812 00:04:17.444748 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:17.444749 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:17.444757 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:17.444785 (+ 28us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:04:17.444987 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:17.445708 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:17.447222 (+ 1514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:17.447793 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:17.447844 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:17.447854 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:17.448096 (+ 242us) server_negotiation.cc:299] Negotiation successful
0812 00:04:17.448141 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 00:04:17.448498 3418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:17.444242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.67:42163 (local address 127.11.206.66:43273)
0812 00:04:17.444570 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:17.444580 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:17.444661 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:17.444849 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:17.444849 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:17.444851 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:04:17.444918 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:17.444920 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:17.445808 (+ 888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:17.445809 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:17.447120 (+ 1311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:17.447123 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:17.447937 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:17.447938 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:17.448015 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:17.448020 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 00:04:17.448354 (+ 334us) client_negotiation.cc:240] Negotiation successful
0812 00:04:17.448403 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":311,"thread_start_us":86,"threads_started":1}
I20260812 00:04:17.448861 3267 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a66e1b68230c418daf1a5f1475720da1" candidate_uuid: "5c4cf6dcd7e642abb49a592ddc6a3691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c7aa06605d4ff8a3116342649ac785" is_pre_election: true
I20260812 00:04:17.449044 3267 raft_consensus.cc:2454] T a66e1b68230c418daf1a5f1475720da1 P 10c7aa06605d4ff8a3116342649ac785 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c4cf6dcd7e642abb49a592ddc6a3691 in term 0.
I20260812 00:04:17.449280 2913 leader_election.cc:302] T a66e1b68230c418daf1a5f1475720da1 P 5c4cf6dcd7e642abb49a592ddc6a3691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c7aa06605d4ff8a3116342649ac785, 5c4cf6dcd7e642abb49a592ddc6a3691; no voters:
I20260812 00:04:17.449435 3403 raft_consensus.cc:2781] T a66e1b68230c418daf1a5f1475720da1 P 5c4cf6dcd7e642abb49a592ddc6a3691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:04:17.449479 3403 raft_consensus.cc:482] T a66e1b68230c418daf1a5f1475720da1 P 5c4cf6dcd7e642abb49a592ddc6a3691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:04:17.449501 3403 raft_consensus.cc:3037] T a66e1b68230c418daf1a5f1475720da1 P 5c4cf6dcd7e642abb49a592ddc6a3691 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:04:17.450055 3386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:17.444059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.66:52803 (local address 127.11.206.65:35709)
0812 00:04:17.444108 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:17.444111 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:17.444343 (+ 232us) server_negotiation.cc:407] Connection header received
0812 00:04:17.444468 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:17.444469 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:17.444479 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:17.444507 (+ 28us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:04:17.444878 (+ 371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:17.445604 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:17.448805 (+ 3201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:17.449446 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:17.449496 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:17.449504 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:17.449941 (+ 437us) server_negotiation.cc:299] Negotiation successful
0812 00:04:17.449990 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 00:04:17.450459 3403 raft_consensus.cc:504] T a66e1b68230c418daf1a5f1475720da1 P 5c4cf6dcd7e642abb49a592ddc6a3691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc8c279da2eb4105ba90dec8ed266591" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 35709 } } peers { permanent_uuid: "5c4cf6dcd7e642abb49a592ddc6a3691" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37021 } } peers { permanent_uuid: "10c7aa06605d4ff8a3116342649ac785" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 42163 } }
I20260812 00:04:17.450649 3403 leader_election.cc:288] T a66e1b68230c418daf1a5f1475720da1 P 5c4cf6dcd7e642abb49a592ddc6a3691 [CANDIDATE]: Term 1 election: Requested vote from peers dc8c279da2eb4105ba90dec8ed266591 (127.11.206.65:35709), 10c7aa06605d4ff8a3116342649ac785 (127.11.206.67:42163)
I20260812 00:04:17.450863 3267 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a66e1b68230c418daf1a5f1475720da1" candidate_uuid: "5c4cf6dcd7e642abb49a592ddc6a3691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c7aa06605d4ff8a3116342649ac785"
I20260812 00:04:17.450951 3267 raft_consensus.cc:3037] T a66e1b68230c418daf1a5f1475720da1 P 10c7aa06605d4ff8a3116342649ac785 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:04:17.451894 3267 raft_consensus.cc:2454] T a66e1b68230c418daf1a5f1475720da1 P 10c7aa06605d4ff8a3116342649ac785 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c4cf6dcd7e642abb49a592ddc6a3691 in term 1.
I20260812 00:04:17.452097 2913 leader_election.cc:302] T a66e1b68230c418daf1a5f1475720da1 P 5c4cf6dcd7e642abb49a592ddc6a3691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c7aa06605d4ff8a3116342649ac785, 5c4cf6dcd7e642abb49a592ddc6a3691; no voters:
I20260812 00:04:17.452179 3403 raft_consensus.cc:2781] T a66e1b68230c418daf1a5f1475720da1 P 5c4cf6dcd7e642abb49a592ddc6a3691 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:04:17.452327 3403 raft_consensus.cc:686] T a66e1b68230c418daf1a5f1475720da1 P 5c4cf6dcd7e642abb49a592ddc6a3691 [term 1 LEADER]: Becoming Leader. State: Replica: 5c4cf6dcd7e642abb49a592ddc6a3691, State: Running, Role: LEADER
I20260812 00:04:17.452433 3403 consensus_queue.cc:237] T a66e1b68230c418daf1a5f1475720da1 P 5c4cf6dcd7e642abb49a592ddc6a3691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc8c279da2eb4105ba90dec8ed266591" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 35709 } } peers { permanent_uuid: "5c4cf6dcd7e642abb49a592ddc6a3691" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37021 } } peers { permanent_uuid: "10c7aa06605d4ff8a3116342649ac785" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 42163 } }
I20260812 00:04:17.453336 2551 catalog_manager.cc:5495] T a66e1b68230c418daf1a5f1475720da1 P 5c4cf6dcd7e642abb49a592ddc6a3691 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5c4cf6dcd7e642abb49a592ddc6a3691 (127.11.206.66). New cstate: current_term: 1 leader_uuid: "5c4cf6dcd7e642abb49a592ddc6a3691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc8c279da2eb4105ba90dec8ed266591" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 35709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c4cf6dcd7e642abb49a592ddc6a3691" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37021 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c7aa06605d4ff8a3116342649ac785" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 42163 } health_report { overall_health: UNKNOWN } } }
I20260812 00:04:17.450465 3417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:17.443986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.65:35709 (local address 127.11.206.66:52803)
0812 00:04:17.444253 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:17.444266 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:17.444376 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:17.444587 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:17.444589 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:17.444591 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:04:17.444788 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:17.444790 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:17.447070 (+ 2280us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:17.447070 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:17.448701 (+ 1631us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:17.448705 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:17.449758 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:17.449759 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:17.449855 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:17.449863 (+ 8us) client_negotiation.cc:769] Sending connection context
0812 00:04:17.450291 (+ 428us) client_negotiation.cc:240] Negotiation successful
0812 00:04:17.450339 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":128,"threads_started":1}
I20260812 00:04:17.454584 2798 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a66e1b68230c418daf1a5f1475720da1" candidate_uuid: "5c4cf6dcd7e642abb49a592ddc6a3691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc8c279da2eb4105ba90dec8ed266591" is_pre_election: true
I20260812 00:04:17.454722 2798 raft_consensus.cc:2454] T a66e1b68230c418daf1a5f1475720da1 P dc8c279da2eb4105ba90dec8ed266591 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c4cf6dcd7e642abb49a592ddc6a3691 in term 0.
I20260812 00:04:17.454906 2797 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a66e1b68230c418daf1a5f1475720da1" candidate_uuid: "5c4cf6dcd7e642abb49a592ddc6a3691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc8c279da2eb4105ba90dec8ed266591"
I20260812 00:04:17.455009 2797 raft_consensus.cc:3037] T a66e1b68230c418daf1a5f1475720da1 P dc8c279da2eb4105ba90dec8ed266591 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:04:17.456481 2797 raft_consensus.cc:2454] T a66e1b68230c418daf1a5f1475720da1 P dc8c279da2eb4105ba90dec8ed266591 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c4cf6dcd7e642abb49a592ddc6a3691 in term 1.
I20260812 00:04:17.458412 3395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:17.446763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.65:43617 (local address 127.11.206.67:42163)
0812 00:04:17.448301 (+ 1538us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:17.448303 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:17.450925 (+ 2622us) server_negotiation.cc:407] Connection header received
0812 00:04:17.451108 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:17.451109 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:17.451118 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:17.451143 (+ 25us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:04:17.451490 (+ 347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:17.452179 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:17.457330 (+ 5151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:17.457894 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:17.457942 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:17.457949 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:17.458292 (+ 343us) server_negotiation.cc:299] Negotiation successful
0812 00:04:17.458338 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1523,"thread_start_us":107,"threads_started":1}
I20260812 00:04:17.458748 3420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:17.446552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.67:42163 (local address 127.11.206.65:43617)
0812 00:04:17.450853 (+ 4301us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:17.450866 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:17.450996 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:17.451198 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:17.451198 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:17.451200 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:04:17.451408 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:17.451410 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:17.452345 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:17.452346 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:17.457244 (+ 4898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:17.457246 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:17.458087 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:17.458088 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:17.458198 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:17.458204 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 00:04:17.458532 (+ 328us) client_negotiation.cc:240] Negotiation successful
0812 00:04:17.458589 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4259,"thread_start_us":115,"threads_started":1}
I20260812 00:04:17.458969 3267 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a66e1b68230c418daf1a5f1475720da1" candidate_uuid: "dc8c279da2eb4105ba90dec8ed266591" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c7aa06605d4ff8a3116342649ac785" is_pre_election: true
I20260812 00:04:17.459082 3267 raft_consensus.cc:2379] T a66e1b68230c418daf1a5f1475720da1 P 10c7aa06605d4ff8a3116342649ac785 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dc8c279da2eb4105ba90dec8ed266591 in current term 1: Already voted for candidate 5c4cf6dcd7e642abb49a592ddc6a3691 in this term.
I20260812 00:04:17.459666 3385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:17.446948 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.65:37993 (local address 127.11.206.66:37021)
0812 00:04:17.446995 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:17.446996 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:17.453839 (+ 6843us) server_negotiation.cc:407] Connection header received
0812 00:04:17.454383 (+ 544us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:17.454384 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:17.454394 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:17.454426 (+ 32us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:04:17.454890 (+ 464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:17.455520 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:17.457078 (+ 1558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:17.457650 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:17.457729 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:17.457738 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:17.459559 (+ 1821us) server_negotiation.cc:299] Negotiation successful
0812 00:04:17.459607 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 00:04:17.459887 3419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:17.446637 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.66:37021 (local address 127.11.206.65:37993)
0812 00:04:17.453764 (+ 7127us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:17.453777 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:17.453866 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:17.454492 (+ 626us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:17.454493 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:17.454554 (+ 61us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:04:17.454790 (+ 236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:17.454793 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:17.455633 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:17.455634 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:17.456975 (+ 1341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:17.456978 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:17.459390 (+ 2412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:17.459392 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:17.459463 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:17.459467 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:04:17.459761 (+ 294us) client_negotiation.cc:240] Negotiation successful
0812 00:04:17.459809 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7082,"thread_start_us":132,"threads_started":1}
I20260812 00:04:17.460263 3023 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a66e1b68230c418daf1a5f1475720da1" candidate_uuid: "dc8c279da2eb4105ba90dec8ed266591" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c4cf6dcd7e642abb49a592ddc6a3691" is_pre_election: true
I20260812 00:04:17.460599 2688 leader_election.cc:302] T a66e1b68230c418daf1a5f1475720da1 P dc8c279da2eb4105ba90dec8ed266591 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc8c279da2eb4105ba90dec8ed266591; no voters: 10c7aa06605d4ff8a3116342649ac785, 5c4cf6dcd7e642abb49a592ddc6a3691
I20260812 00:04:17.460769 3413 raft_consensus.cc:2726] T a66e1b68230c418daf1a5f1475720da1 P dc8c279da2eb4105ba90dec8ed266591 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 00:04:17.479346 3385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:17.476987 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48592 (local address 127.11.206.66:37021)
0812 00:04:17.477027 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:17.477030 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:17.477038 (+ 8us) server_negotiation.cc:407] Connection header received
0812 00:04:17.477116 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:17.477117 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:17.477139 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:17.477205 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:04:17.477330 (+ 125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:17.477851 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:17.478589 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:17.478802 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:17.478856 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:17.479007 (+ 151us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:04:17.479125 (+ 118us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:04:17.479197 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:17.479248 (+ 51us) server_negotiation.cc:299] Negotiation successful
0812 00:04:17.479268 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 00:04:17.481482 3267 raft_consensus.cc:1261] T a66e1b68230c418daf1a5f1475720da1 P 10c7aa06605d4ff8a3116342649ac785 [term 1 FOLLOWER]: Refusing update from remote peer 5c4cf6dcd7e642abb49a592ddc6a3691: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:04:17.481621 2797 raft_consensus.cc:1261] T a66e1b68230c418daf1a5f1475720da1 P dc8c279da2eb4105ba90dec8ed266591 [term 1 FOLLOWER]: Refusing update from remote peer 5c4cf6dcd7e642abb49a592ddc6a3691: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:04:17.481899 3422 consensus_queue.cc:1035] T a66e1b68230c418daf1a5f1475720da1 P 5c4cf6dcd7e642abb49a592ddc6a3691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c7aa06605d4ff8a3116342649ac785" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 42163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:04:17.482023 3403 consensus_queue.cc:1035] T a66e1b68230c418daf1a5f1475720da1 P 5c4cf6dcd7e642abb49a592ddc6a3691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc8c279da2eb4105ba90dec8ed266591" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 35709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:04:17.485013 3431 mvcc.cc:205] Tried to move back new op lower bound from 7317475563441754112 to 7317475563325829120. Current Snapshot: MvccSnapshot[applied={T|T < 7317475563441754112}]
I20260812 00:04:17.486163 3435 mvcc.cc:205] Tried to move back new op lower bound from 7317475563441754112 to 7317475563325829120. Current Snapshot: MvccSnapshot[applied={T|T < 7317475563441754112}]
I20260812 00:04:17.488468 3433 mvcc.cc:205] Tried to move back new op lower bound from 7317475563441754112 to 7317475563325829120. Current Snapshot: MvccSnapshot[applied={T|T < 7317475563441754112 or (T in {7317475563441754112})}]
I20260812 00:04:17.491534 2550 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59168:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:04:17.491636 2550 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59168:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:04:17.492507 2550 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1293b96c45954fcca9fe0fcfeb68b978: Sending DeleteTablet for 3 replicas of tablet a66e1b68230c418daf1a5f1475720da1
I20260812 00:04:17.492986 2761 tablet_service.cc:1514] Processing DeleteTablet for tablet a66e1b68230c418daf1a5f1475720da1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:04:17 UTC) from {username='kudu', principal='kudu/127.11.206.126@KRBTEST.COM'} at 127.0.0.1:33274
I20260812 00:04:17.493211 3213 tablet_service.cc:1514] Processing DeleteTablet for tablet a66e1b68230c418daf1a5f1475720da1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:04:17 UTC) from {username='kudu', principal='kudu/127.11.206.126@KRBTEST.COM'} at 127.0.0.1:54314
I20260812 00:04:17.493561 3449 tablet_replica.cc:330] T a66e1b68230c418daf1a5f1475720da1 P dc8c279da2eb4105ba90dec8ed266591: stopping tablet replica
I20260812 00:04:17.493664 2991 tablet_service.cc:1514] Processing DeleteTablet for tablet a66e1b68230c418daf1a5f1475720da1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:04:17 UTC) from {username='kudu', principal='kudu/127.11.206.126@KRBTEST.COM'} at 127.0.0.1:48588
I20260812 00:04:17.494472 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 2606
I20260812 00:04:17.541558 3450 tablet_replica.cc:330] T a66e1b68230c418daf1a5f1475720da1 P 10c7aa06605d4ff8a3116342649ac785: stopping tablet replica
I20260812 00:04:17.541728 3450 raft_consensus.cc:2229] T a66e1b68230c418daf1a5f1475720da1 P 10c7aa06605d4ff8a3116342649ac785 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:04:17.541882 3450 raft_consensus.cc:2258] T a66e1b68230c418daf1a5f1475720da1 P 10c7aa06605d4ff8a3116342649ac785 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:04:17.542969 3450 ts_tablet_manager.cc:1905] T a66e1b68230c418daf1a5f1475720da1 P 10c7aa06605d4ff8a3116342649ac785: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260812 00:04:17.544050 2520 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.206.65:35709 (error 108)
I20260812 00:04:17.544369 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 2884
I20260812 00:04:17.544648 3389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:17.544529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.65:35709 (local address 127.0.0.1:33288)
0812 00:04:17.544579 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:17.544612 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.65:35709: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260812 00:04:17.544752 2520 catalog_manager.cc:4584] TS dc8c279da2eb4105ba90dec8ed266591 (127.11.206.65:35709): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a66e1b68230c418daf1a5f1475720da1: Network error: Client connection negotiation failed: client connection to 127.11.206.65:35709: connect: Connection refused (error 111)
I20260812 00:04:17.547578 3450 ts_tablet_manager.cc:1918] T a66e1b68230c418daf1a5f1475720da1 P 10c7aa06605d4ff8a3116342649ac785: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:04:17.547657 3450 log.cc:1196] T a66e1b68230c418daf1a5f1475720da1 P 10c7aa06605d4ff8a3116342649ac785: Deleting WAL directory at /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786492899949492-12089-0/minicluster-data/ts-2/wal/wals/a66e1b68230c418daf1a5f1475720da1
I20260812 00:04:17.547904 3450 ts_tablet_manager.cc:1939] T a66e1b68230c418daf1a5f1475720da1 P 10c7aa06605d4ff8a3116342649ac785: Deleting consensus metadata
I20260812 00:04:17.549268 2520 catalog_manager.cc:4841] TS 10c7aa06605d4ff8a3116342649ac785 (127.11.206.67:42163): tablet a66e1b68230c418daf1a5f1475720da1 (table test-table [id=b7f98a0bc05a4380a59f017420b78286]) successfully deleted
W20260812 00:04:17.554138 3389 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:04:17.553859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.66:37021 (local address 127.0.0.1:48598)
0812 00:04:17.553928 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:17.553940 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:17.553985 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:17.554081 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.66:37021: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":31}
I20260812 00:04:17.554423 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 3092
I20260812 00:04:17.569188 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 2488
Aug 12 00:04:17 dist-test-slave-f0tn krb5kdc[757](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493056, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.126@KRBTEST.COM for HTTP/127.11.206.84@KRBTEST.COM
I20260812 00:04:17.588325 12089 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260812 00:04:17.933916 12089 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260812 00:04:17.934026 12089 mini_ranger.cc:66] Stopping Ranger...
I20260812 00:04:18.278227 12089 mini_ranger.cc:68] Stopped Ranger
2026-08-12 00:04:18.278 UTC [815] LOG: received smart shutdown request
2026-08-12 00:04:18.282 UTC [815] LOG: background worker "logical replication launcher" (PID 833) exited with exit code 1
2026-08-12 00:04:18.282 UTC [824] LOG: shutting down
2026-08-12 00:04:18.427 UTC [815] LOG: database system is shut down
2026-08-12T00:04:18Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (49727 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492899949492-12089-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:04:18 dist-test-slave-f0tn krb5kdc[3464](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:04:18 dist-test-slave-f0tn krb5kdc[3464](info): set up 2 sockets
Aug 12 00:04:18 dist-test-slave-f0tn krb5kdc[3464](info): commencing operation
krb5kdc: starting...
W20260812 00:04:19.755539 12089 mini_kdc.cc:121] Time spent starting KDC: real 1.217s user 0.001s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492899949492-12089-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492899949492-12089-0/krb5kdc/test-user.keytab.
Aug 12 00:04:19 dist-test-slave-f0tn krb5kdc[3464](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493059, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:04:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:04:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.206.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab.
Entry for principal kudu/127.11.206.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab.
I20260812 00:04:19.874475 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492899949492-12089-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492899949492-12089-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492899949492-12089-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:33333
--webserver_interface=127.11.206.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab
--principal=kudu/127.11.206.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:41561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.206.126:33333,127.11.206.125:46445,127.11.206.124:35987
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:04:19.958834 3489 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:04:19.959059 3489 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:04:19.959082 3489 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:04:19.960210 3489 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:04:19.960256 3489 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:04:19.960271 3489 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:04:19.960285 3489 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:04:19.960299 3489 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:04:19.962047 3489 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:41561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492899949492-12089-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492899949492-12089-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.206.126:33333,127.11.206.125:46445,127.11.206.124:35987
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab
--principal=kudu/127.11.206.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:33333
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.206.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3489
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492899949492-12089-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:04:19.962306 3489 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:04:19.962533 3489 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:04:19.967517 3496 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:19.967535 3489 server_base.cc:1034] running on GCE node
W20260812 00:04:19.967517 3499 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:19.967535 3497 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:19.967952 3489 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:04:19.968242 3489 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:04:19.969413 3489 hybrid_clock.cc:648] HybridClock initialized: now 1786493059969395 us; error 29 us; skew 500 ppm
Aug 12 00:04:19 dist-test-slave-f0tn krb5kdc[3464](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493059, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:04:19.971884 3489 init.cc:377] Logged in from keytab as kudu/127.11.206.126@KRBTEST.COM (short username kudu)
I20260812 00:04:19.972288 3489 webserver.cc:460] Webserver started at http://127.11.206.126:34037/ using document root <none> and password file <none>
I20260812 00:04:19.972483 3489 fs_manager.cc:359] Metadata directory not provided
I20260812 00:04:19.972530 3489 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:04:19.972666 3489 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:04:19.973784 3489 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492899949492-12089-0/minicluster-data/master-0/data/instance:
uuid: "9aca7e9a24a742dc8ded546568d8f28c"
format_stamp: "Formatted at 2026-08-12 00:04:19 on dist-test-slave-f0tn"
server_key: "536ca6690069679bc2d4449baf6fc4b7"
server_key_iv: "3aadfdf4d8e2176461c5b6a56cb7cac7"
server_key_version: "encryptionkey@0"
I20260812 00:04:19.974126 3489 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492899949492-12089-0/minicluster-data/master-0/wal/instance:
uuid: "9aca7e9a24a742dc8ded546568d8f28c"
format_stamp: "Formatted at 2026-08-12 00:04:19 on dist-test-slave-f0tn"
server_key: "536ca6690069679bc2d4449baf6fc4b7"
server_key_iv: "3aadfdf4d8e2176461c5b6a56cb7cac7"
server_key_version: "encryptionkey@0"
I20260812 00:04:19.975382 3489 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 00:04:19.976045 3509 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:19.976193 3489 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:04:19.976276 3489 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492899949492-12089-0/minicluster-data/master-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492899949492-12089-0/minicluster-data/master-0/wal
uuid: "9aca7e9a24a742dc8ded546568d8f28c"
format_stamp: "Formatted at 2026-08-12 00:04:19 on dist-test-slave-f0tn"
server_key: "536ca6690069679bc2d4449baf6fc4b7"
server_key_iv: "3aadfdf4d8e2176461c5b6a56cb7cac7"
server_key_version: "encryptionkey@0"
I20260812 00:04:19.976334 3489 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492899949492-12089-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492899949492-12089-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492899949492-12089-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:04:19.989109 3489 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:04:19.991129 3489 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:04:19.991259 3489 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:04:19.995113 3489 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.126:33333
I20260812 00:04:19.995183 3608 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.126:33333 every 8 connection(s)
I20260812 00:04:19.995510 3489 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
I20260812 00:04:19.996379 3610 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:04:19.998003 3610 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.206.126" port: 33333 } has no permanent_uuid. Determining permanent_uuid...
I20260812 00:04:19.999230 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 3489
I20260812 00:04:19.999357 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492899949492-12089-0/minicluster-data/master-0/wal/instance
I20260812 00:04:19.999527 12089 external_mini_cluster.cc:1428] Setting key 79468c432a434db1e8fe6eb18545ee9d
Aug 12 00:04:19 dist-test-slave-f0tn krb5kdc[3464](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493059, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.126@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.206.125@KRBTEST.COM; defaulting to no policy
I20260812 00:04:20.008412 3612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:19.998646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:33333 (local address 127.0.0.1:33482)
0812 00:04:19.998860 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:19.998906 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:19.999433 (+ 527us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:19.999711 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:19.999713 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:19.999995 (+ 282us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:04:20.000163 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:20.000168 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:20.001171 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:20.001173 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:20.002036 (+ 863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:20.002039 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:20.002511 (+ 472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:20.002512 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:20.002576 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:20.003070 (+ 494us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:04:20.003079 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:04:20.004792 (+ 1713us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:04:20.006715 (+ 1923us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:20.006723 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:20.006726 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:20.006991 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:20.007243 (+ 252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:20.007244 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:20.007244 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:20.007360 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:20.007788 (+ 428us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:04:20.007793 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:04:20.007889 (+ 96us) client_negotiation.cc:769] Sending connection context
0812 00:04:20.007980 (+ 91us) client_negotiation.cc:240] Negotiation successful
0812 00:04:20.008207 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166,"mutex_wait_us":80,"thread_start_us":82,"threads_started":1}
I20260812 00:04:20.008414 3615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:19.998705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33482 (local address 127.11.206.126:33333)
0812 00:04:19.998873 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:19.998883 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:19.998997 (+ 114us) server_negotiation.cc:407] Connection header received
0812 00:04:19.999595 (+ 598us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:19.999598 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:19.999619 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:19.999698 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:20.000254 (+ 556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:20.001084 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:20.002125 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:20.002436 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:20.002533 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:20.004910 (+ 2377us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:20.004919 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:20.004919 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:04:20.004926 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:20.006620 (+ 1694us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:20.007074 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:20.007077 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:20.007077 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:20.007189 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:20.007455 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:20.007457 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:20.007457 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:20.007710 (+ 253us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:20.007785 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:20.008022 (+ 237us) server_negotiation.cc:299] Negotiation successful
0812 00:04:20.008133 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":69,"threads_started":1}
I20260812 00:04:20.009287 3610 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.206.125" port: 46445 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.125@KRBTEST.COM" created.
I20260812 00:04:20.009717 3612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:20.009582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.125:46445 (local address 127.0.0.1:54742)
0812 00:04:20.009647 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:20.009696 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.125:46445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260812 00:04:20.009858 3511 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.206.125:46445: connect: Connection refused (error 111)
I20260812 00:04:20.010294 3612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:20.010206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.125:46445 (local address 127.0.0.1:54750)
0812 00:04:20.010245 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:20.010270 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.125:46445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260812 00:04:20.010406 3610 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.206.125:46445: Network error: Client connection negotiation failed: client connection to 127.11.206.125:46445: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.125.keytab.
Entry for principal kudu/127.11.206.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.125.keytab.
I20260812 00:04:20.024735 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492899949492-12089-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492899949492-12089-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492899949492-12089-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492899949492-12089-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.125:46445
--webserver_interface=127.11.206.125
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.125.keytab
--principal=kudu/127.11.206.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:41561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.206.126:33333,127.11.206.125:46445,127.11.206.124:35987
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:04:20.059675 3610 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.206.125" port: 46445 } attempt: 1
I20260812 00:04:20.060204 3612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:20.060065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.125:46445 (local address 127.0.0.1:54760)
0812 00:04:20.060132 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:20.060169 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.125:46445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260812 00:04:20.060644 3612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:20.060534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.125:46445 (local address 127.0.0.1:54762)
0812 00:04:20.060587 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:20.060620 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.125:46445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260812 00:04:20.060791 3610 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.206.125:46445: Network error: Client connection negotiation failed: client connection to 127.11.206.125:46445: connect: Connection refused (error 111)
W20260812 00:04:20.107064 3622 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:04:20.107276 3622 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:04:20.107297 3622 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:04:20.108403 3622 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:04:20.108436 3622 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:04:20.108449 3622 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:04:20.108460 3622 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:04:20.108471 3622 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:04:20.110008 3622 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:41561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492899949492-12089-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492899949492-12089-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.11.206.126:33333,127.11.206.125:46445,127.11.206.124:35987
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.125.keytab
--principal=kudu/127.11.206.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.125:46445
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492899949492-12089-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.11.206.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3622
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492899949492-12089-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:04:20.110216 3622 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:04:20.110395 3622 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:04:20.115170 3634 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:20.115131 3635 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:20.115149 3622 server_base.cc:1034] running on GCE node
W20260812 00:04:20.115131 3637 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:20.115655 3622 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:04:20.115954 3622 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:04:20.117115 3622 hybrid_clock.cc:648] HybridClock initialized: now 1786493060117096 us; error 30 us; skew 500 ppm
Aug 12 00:04:20 dist-test-slave-f0tn krb5kdc[3464](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493060, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:04:20.119767 3622 init.cc:377] Logged in from keytab as kudu/127.11.206.125@KRBTEST.COM (short username kudu)
I20260812 00:04:20.120208 3622 webserver.cc:460] Webserver started at http://127.11.206.125:38803/ using document root <none> and password file <none>
I20260812 00:04:20.120415 3622 fs_manager.cc:359] Metadata directory not provided
I20260812 00:04:20.120455 3622 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:04:20.120556 3622 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:04:20.121608 3622 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492899949492-12089-0/minicluster-data/master-1/data/instance:
uuid: "0a01e68bc2da44c9a6d64124800a4edd"
format_stamp: "Formatted at 2026-08-12 00:04:20 on dist-test-slave-f0tn"
server_key: "706313946e7ab9b828c9923591cedcaf"
server_key_iv: "dfc712d5f169682d3e9853f2156b6d3a"
server_key_version: "encryptionkey@0"
I20260812 00:04:20.121927 3622 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492899949492-12089-0/minicluster-data/master-1/wal/instance:
uuid: "0a01e68bc2da44c9a6d64124800a4edd"
format_stamp: "Formatted at 2026-08-12 00:04:20 on dist-test-slave-f0tn"
server_key: "706313946e7ab9b828c9923591cedcaf"
server_key_iv: "dfc712d5f169682d3e9853f2156b6d3a"
server_key_version: "encryptionkey@0"
I20260812 00:04:20.123163 3622 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:04:20.123893 3645 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:20.124094 3622 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:04:20.124189 3622 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492899949492-12089-0/minicluster-data/master-1/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492899949492-12089-0/minicluster-data/master-1/wal
uuid: "0a01e68bc2da44c9a6d64124800a4edd"
format_stamp: "Formatted at 2026-08-12 00:04:20 on dist-test-slave-f0tn"
server_key: "706313946e7ab9b828c9923591cedcaf"
server_key_iv: "dfc712d5f169682d3e9853f2156b6d3a"
server_key_version: "encryptionkey@0"
I20260812 00:04:20.124253 3622 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492899949492-12089-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492899949492-12089-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492899949492-12089-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:04:20.128959 3610 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.206.125" port: 46445 } attempt: 2
I20260812 00:04:20.129372 3612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:20.129252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.125:46445 (local address 127.0.0.1:54764)
0812 00:04:20.129309 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:20.129346 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.125:46445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260812 00:04:20.129670 3612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:20.129583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.125:46445 (local address 127.0.0.1:54768)
0812 00:04:20.129620 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:20.129648 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.125:46445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
W20260812 00:04:20.129747 3610 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.206.125:46445: Network error: Client connection negotiation failed: client connection to 127.11.206.125:46445: connect: Connection refused (error 111)
I20260812 00:04:20.133631 3622 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:04:20.135715 3622 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:04:20.135847 3622 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:04:20.139725 3622 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.125:46445
I20260812 00:04:20.139782 3731 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.125:46445 every 8 connection(s)
I20260812 00:04:20.140161 3622 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492899949492-12089-0/minicluster-data/master-1/data/info.pb
I20260812 00:04:20.141052 3733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:04:20.142719 3733 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.206.126" port: 33333 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 00:04:20 dist-test-slave-f0tn krb5kdc[3464](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493060, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.125@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:04:20.150046 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 3622
I20260812 00:04:20.150163 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492899949492-12089-0/minicluster-data/master-1/wal/instance
I20260812 00:04:20.150390 12089 external_mini_cluster.cc:1428] Setting key 5a4939be4450939202e3b81fbbe4f685
I20260812 00:04:20.151654 3615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:20.143435 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33494 (local address 127.11.206.126:33333)
0812 00:04:20.143494 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:20.143496 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:20.143685 (+ 189us) server_negotiation.cc:407] Connection header received
0812 00:04:20.144128 (+ 443us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:20.144130 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:20.144140 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:20.144199 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:20.144832 (+ 633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:20.145329 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:20.146364 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:20.146584 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:20.146658 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:20.148756 (+ 2098us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:20.148757 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:20.148757 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:04:20.148766 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:20.150226 (+ 1460us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:20.150645 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:20.150646 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:20.150647 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:20.150786 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:20.150993 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:20.150994 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:20.150994 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:20.151174 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:20.151238 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:20.151477 (+ 239us) server_negotiation.cc:299] Negotiation successful
0812 00:04:20.151565 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260812 00:04:20.151821 3738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:20.143384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:33333 (local address 127.0.0.1:33494)
0812 00:04:20.143567 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:20.143611 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:20.144049 (+ 438us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:20.144288 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:20.144293 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:20.144546 (+ 253us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:04:20.144743 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:20.144747 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:20.145434 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:20.145435 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:20.146230 (+ 795us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:20.146232 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:20.146664 (+ 432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:20.146664 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:20.146767 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:20.147274 (+ 507us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:04:20.147282 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:04:20.148634 (+ 1352us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:04:20.150301 (+ 1667us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:20.150308 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:20.150310 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:20.150558 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:20.150845 (+ 287us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:20.150846 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:20.150846 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:20.150941 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:20.151226 (+ 285us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:04:20.151229 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:04:20.151366 (+ 137us) client_negotiation.cc:769] Sending connection context
0812 00:04:20.151446 (+ 80us) client_negotiation.cc:240] Negotiation successful
0812 00:04:20.151567 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":96,"threads_started":1}
I20260812 00:04:20.152545 3733 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.206.125" port: 46445 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 00:04:20 dist-test-slave-f0tn krb5kdc[3464](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493060, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.125@KRBTEST.COM for kudu/127.11.206.125@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.206.124@KRBTEST.COM; defaulting to no policy
I20260812 00:04:20.159436 3738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:20.152796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.125:46445 (local address 127.0.0.1:54778)
0812 00:04:20.152848 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:20.152861 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:20.152911 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:20.153116 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:20.153117 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:20.153248 (+ 131us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:04:20.153295 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:20.153296 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:20.154140 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:20.154141 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:20.154642 (+ 501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:20.154644 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:20.155072 (+ 428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:20.155073 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:20.155136 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:20.155554 (+ 418us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:04:20.155559 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:04:20.156906 (+ 1347us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:04:20.158546 (+ 1640us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:20.158547 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:20.158548 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:20.158771 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:20.158926 (+ 155us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:20.158927 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:20.158927 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:20.158973 (+ 46us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:20.159204 (+ 231us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:04:20.159205 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:04:20.159247 (+ 42us) client_negotiation.cc:769] Sending connection context
0812 00:04:20.159294 (+ 47us) client_negotiation.cc:240] Negotiation successful
0812 00:04:20.159370 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260812 00:04:20.159546 3741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:20.152833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54778 (local address 127.11.206.125:46445)
0812 00:04:20.152985 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:20.152990 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:20.153005 (+ 15us) server_negotiation.cc:407] Connection header received
0812 00:04:20.153024 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:20.153025 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:20.153036 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:20.153103 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:20.153356 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:20.154062 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:20.154711 (+ 649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:20.155011 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:20.155068 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:20.156985 (+ 1917us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:20.156992 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:20.156992 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:04:20.156998 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:20.158475 (+ 1477us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:20.158831 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:20.158833 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:20.158834 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:20.158882 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:20.159006 (+ 124us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:20.159006 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:20.159006 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:20.159158 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:20.159211 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:20.159325 (+ 114us) server_negotiation.cc:299] Negotiation successful
0812 00:04:20.159428 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":31,"server-negotiator.queue_time_us":124,"thread_start_us":90,"threads_started":1}
I20260812 00:04:20.160018 3733 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.206.124" port: 35987 } has no permanent_uuid. Determining permanent_uuid...
I20260812 00:04:20.160356 3738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:20.160255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.124:35987 (local address 127.0.0.1:40420)
0812 00:04:20.160294 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:20.160337 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.124:35987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
W20260812 00:04:20.160475 3646 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.206.124:35987: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.124@KRBTEST.COM" created.
I20260812 00:04:20.160946 3738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:20.160856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.124:35987 (local address 127.0.0.1:40436)
0812 00:04:20.160899 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:20.160928 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.124:35987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260812 00:04:20.161041 3733 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.206.124:35987: Network error: Client connection negotiation failed: client connection to 127.11.206.124:35987: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.124.keytab.
Entry for principal kudu/127.11.206.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.124.keytab.
I20260812 00:04:20.174222 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492899949492-12089-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492899949492-12089-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492899949492-12089-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492899949492-12089-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.124:35987
--webserver_interface=127.11.206.124
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.124.keytab
--principal=kudu/127.11.206.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:41561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.206.126:33333,127.11.206.125:46445,127.11.206.124:35987
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:04:20.210287 3733 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.206.124" port: 35987 } attempt: 1
I20260812 00:04:20.210783 3738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:20.210644 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.124:35987 (local address 127.0.0.1:40440)
0812 00:04:20.210705 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:20.210739 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.124:35987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260812 00:04:20.211162 3738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:20.211075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.124:35987 (local address 127.0.0.1:40442)
0812 00:04:20.211117 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:20.211143 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.124:35987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260812 00:04:20.211239 3733 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.206.124:35987: Network error: Client connection negotiation failed: client connection to 127.11.206.124:35987: connect: Connection refused (error 111)
I20260812 00:04:20.220875 3610 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.206.125" port: 46445 } attempt: 3
Aug 12 00:04:20 dist-test-slave-f0tn krb5kdc[3464](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493059, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.126@KRBTEST.COM for kudu/127.11.206.125@KRBTEST.COM
I20260812 00:04:20.227774 3612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:20.221219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.125:46445 (local address 127.0.0.1:54784)
0812 00:04:20.221294 (+ 75us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:20.221304 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:20.221354 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:20.221497 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:20.221499 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:20.221667 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:04:20.221735 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:20.221737 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:20.222415 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:20.222417 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:20.222931 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:20.222933 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:20.223283 (+ 350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:20.223284 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:20.223354 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:20.223838 (+ 484us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:04:20.223844 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:04:20.225232 (+ 1388us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:04:20.226792 (+ 1560us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:20.226793 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:20.226793 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:20.226960 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:20.227127 (+ 167us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:20.227128 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:20.227128 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:20.227186 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:20.227407 (+ 221us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:04:20.227408 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:04:20.227459 (+ 51us) client_negotiation.cc:769] Sending connection context
0812 00:04:20.227522 (+ 63us) client_negotiation.cc:240] Negotiation successful
0812 00:04:20.227614 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52}
I20260812 00:04:20.228080 3741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:20.221304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54784 (local address 127.11.206.125:46445)
0812 00:04:20.221369 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:20.221371 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:20.221399 (+ 28us) server_negotiation.cc:407] Connection header received
0812 00:04:20.221427 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:20.221428 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:20.221439 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:20.221486 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:20.221820 (+ 334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:20.222332 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:20.223004 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:20.223215 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:20.223273 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:20.225320 (+ 2047us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:20.225322 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:20.225322 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:04:20.225329 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:20.226719 (+ 1390us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:20.227021 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:20.227023 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:20.227023 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:20.227077 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:20.227235 (+ 158us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:20.227236 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:20.227236 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:20.227355 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:20.227412 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:20.227909 (+ 497us) server_negotiation.cc:299] Negotiation successful
0812 00:04:20.227996 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260812 00:04:20.228448 3610 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.206.124" port: 35987 } has no permanent_uuid. Determining permanent_uuid...
I20260812 00:04:20.228770 3612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:20.228672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.124:35987 (local address 127.0.0.1:40458)
0812 00:04:20.228711 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:20.228737 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.124:35987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
I20260812 00:04:20.229023 3612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:20.228952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.124:35987 (local address 127.0.0.1:40474)
0812 00:04:20.228983 (+ 31us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:20.229004 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.124:35987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
W20260812 00:04:20.229102 3610 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.206.124:35987: Network error: Client connection negotiation failed: client connection to 127.11.206.124:35987: connect: Connection refused (error 111)
W20260812 00:04:20.257442 3744 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:04:20.257649 3744 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:04:20.257678 3744 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:04:20.258805 3744 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:04:20.258845 3744 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:04:20.258864 3744 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:04:20.258879 3744 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:04:20.258895 3744 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:04:20.260245 3610 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.206.124" port: 35987 } attempt: 1
I20260812 00:04:20.260421 3744 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:41561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492899949492-12089-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492899949492-12089-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.11.206.126:33333,127.11.206.125:46445,127.11.206.124:35987
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.124.keytab
--principal=kudu/127.11.206.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.124:35987
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492899949492-12089-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.11.206.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3744
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492899949492-12089-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:04:20.260689 3744 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:04:20.260708 3612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:20.260583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.124:35987 (local address 127.0.0.1:40488)
0812 00:04:20.260646 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:20.260677 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.124:35987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260812 00:04:20.260946 3744 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 00:04:20.261041 3612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:20.260954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.124:35987 (local address 127.0.0.1:40494)
0812 00:04:20.260990 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:20.261017 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.124:35987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
W20260812 00:04:20.261147 3610 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.206.124:35987: Network error: Client connection negotiation failed: client connection to 127.11.206.124:35987: connect: Connection refused (error 111)
W20260812 00:04:20.265863 3754 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:20.265870 3752 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:20.265870 3759 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:20.266227 3744 server_base.cc:1034] running on GCE node
I20260812 00:04:20.266469 3744 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:04:20.266753 3744 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:04:20.267903 3744 hybrid_clock.cc:648] HybridClock initialized: now 1786493060267890 us; error 29 us; skew 500 ppm
Aug 12 00:04:20 dist-test-slave-f0tn krb5kdc[3464](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493060, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:04:20.270403 3744 init.cc:377] Logged in from keytab as kudu/127.11.206.124@KRBTEST.COM (short username kudu)
I20260812 00:04:20.270852 3744 webserver.cc:460] Webserver started at http://127.11.206.124:35945/ using document root <none> and password file <none>
I20260812 00:04:20.271061 3744 fs_manager.cc:359] Metadata directory not provided
I20260812 00:04:20.271107 3744 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:04:20.271232 3744 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:04:20.272274 3744 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492899949492-12089-0/minicluster-data/master-2/data/instance:
uuid: "b693d9af02924bf8aa3a87671c6a360d"
format_stamp: "Formatted at 2026-08-12 00:04:20 on dist-test-slave-f0tn"
server_key: "a06407c6caf906069a882a5c69f73eba"
server_key_iv: "cc1bcb2b70267c1a205a0eb3e7d358bb"
server_key_version: "encryptionkey@0"
I20260812 00:04:20.272608 3744 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492899949492-12089-0/minicluster-data/master-2/wal/instance:
uuid: "b693d9af02924bf8aa3a87671c6a360d"
format_stamp: "Formatted at 2026-08-12 00:04:20 on dist-test-slave-f0tn"
server_key: "a06407c6caf906069a882a5c69f73eba"
server_key_iv: "cc1bcb2b70267c1a205a0eb3e7d358bb"
server_key_version: "encryptionkey@0"
I20260812 00:04:20.273912 3744 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 00:04:20.274616 3770 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:20.274775 3744 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 00:04:20.274854 3744 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492899949492-12089-0/minicluster-data/master-2/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492899949492-12089-0/minicluster-data/master-2/wal
uuid: "b693d9af02924bf8aa3a87671c6a360d"
format_stamp: "Formatted at 2026-08-12 00:04:20 on dist-test-slave-f0tn"
server_key: "a06407c6caf906069a882a5c69f73eba"
server_key_iv: "cc1bcb2b70267c1a205a0eb3e7d358bb"
server_key_version: "encryptionkey@0"
I20260812 00:04:20.274920 3744 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492899949492-12089-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492899949492-12089-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492899949492-12089-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:04:20.279361 3733 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.206.124" port: 35987 } attempt: 2
I20260812 00:04:20.279736 3738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:20.279603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.124:35987 (local address 127.0.0.1:40502)
0812 00:04:20.279659 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:20.279702 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.124:35987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260812 00:04:20.280045 3738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:20.279969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.124:35987 (local address 127.0.0.1:40518)
0812 00:04:20.280005 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:20.280028 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.124:35987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260812 00:04:20.280126 3733 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.206.124:35987: Network error: Client connection negotiation failed: client connection to 127.11.206.124:35987: connect: Connection refused (error 111)
I20260812 00:04:20.294836 3744 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:04:20.297137 3744 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:04:20.297283 3744 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:04:20.301173 3744 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.124:35987
I20260812 00:04:20.301213 3857 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.124:35987 every 8 connection(s)
I20260812 00:04:20.301597 3744 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492899949492-12089-0/minicluster-data/master-2/data/info.pb
I20260812 00:04:20.302532 3859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:04:20.304147 3859 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.206.126" port: 33333 } has no permanent_uuid. Determining permanent_uuid...
I20260812 00:04:20.309285 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 3744
I20260812 00:04:20.309437 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786492899949492-12089-0/minicluster-data/master-2/wal/instance
I20260812 00:04:20.309636 12089 external_mini_cluster.cc:1428] Setting key 8a4e2dece0d32c2cb0a2007643dd1490
Aug 12 00:04:20 dist-test-slave-f0tn krb5kdc[3464](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493060, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.124@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:04:20.313359 3865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:20.304836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:33333 (local address 127.0.0.1:33502)
0812 00:04:20.305012 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:20.305057 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:20.305565 (+ 508us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:20.305799 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:20.305803 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:20.306058 (+ 255us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:04:20.306277 (+ 219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:20.306281 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:20.306896 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:20.306896 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:20.307723 (+ 827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:20.307726 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:20.308114 (+ 388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:20.308114 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:20.308237 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:20.308759 (+ 522us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:04:20.308770 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:04:20.310377 (+ 1607us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:04:20.311949 (+ 1572us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:20.311957 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:20.311959 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:20.312179 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:20.312363 (+ 184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:20.312364 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:20.312364 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:20.312471 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:20.312698 (+ 227us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:04:20.312705 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:04:20.312858 (+ 153us) client_negotiation.cc:769] Sending connection context
0812 00:04:20.312952 (+ 94us) client_negotiation.cc:240] Negotiation successful
0812 00:04:20.313114 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":85,"threads_started":1}
I20260812 00:04:20.313421 3615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:20.304881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33502 (local address 127.11.206.126:33333)
0812 00:04:20.304925 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:20.304927 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:20.305160 (+ 233us) server_negotiation.cc:407] Connection header received
0812 00:04:20.305656 (+ 496us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:20.305657 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:20.305667 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:20.305731 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:20.306354 (+ 623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:20.306835 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:20.307813 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:20.308025 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:20.308091 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:20.310475 (+ 2384us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:20.310477 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:20.310477 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:04:20.310485 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:20.311861 (+ 1376us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:20.312252 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:20.312254 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:20.312254 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:20.312308 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:20.312528 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:20.312529 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:20.312529 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:20.312643 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:20.312700 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:20.313223 (+ 523us) server_negotiation.cc:299] Negotiation successful
0812 00:04:20.313316 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 00:04:20.314316 3859 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.206.125" port: 46445 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 00:04:20 dist-test-slave-f0tn krb5kdc[3464](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493059, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.206.124@KRBTEST.COM
I20260812 00:04:20.317679 3871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:20.310039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40526 (local address 127.11.206.124:35987)
0812 00:04:20.310203 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:20.310210 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:20.310240 (+ 30us) server_negotiation.cc:407] Connection header received
0812 00:04:20.310302 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:20.310306 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:20.310328 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:20.310391 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:20.310955 (+ 564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:20.311638 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:20.312350 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:20.312649 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:20.312707 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:20.315186 (+ 2479us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:20.315195 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:20.315196 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:04:20.315202 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:20.316580 (+ 1378us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:20.316901 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:20.316904 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:20.316904 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:20.316959 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:20.317124 (+ 165us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:20.317125 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:20.317125 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:20.317268 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:20.317441 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:20.317508 (+ 67us) server_negotiation.cc:299] Negotiation successful
0812 00:04:20.317579 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":94,"threads_started":1}
Aug 12 00:04:20 dist-test-slave-f0tn krb5kdc[3464](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493060, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.124@KRBTEST.COM for kudu/127.11.206.125@KRBTEST.COM
I20260812 00:04:20.320531 3865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:20.314553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.125:46445 (local address 127.0.0.1:54800)
0812 00:04:20.314593 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:20.314603 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:20.314643 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:20.314817 (+ 174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:20.314818 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:20.314955 (+ 137us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:04:20.315012 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:20.315014 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:20.315721 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:20.315722 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:20.316334 (+ 612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:20.316336 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:20.316661 (+ 325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:20.316662 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:20.316733 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:20.317056 (+ 323us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:04:20.317061 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:04:20.318227 (+ 1166us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:04:20.319614 (+ 1387us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:20.319615 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:20.319615 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:20.319770 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:20.319938 (+ 168us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:20.319939 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:20.319939 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:20.319994 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:20.320267 (+ 273us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:04:20.320268 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:04:20.320301 (+ 33us) client_negotiation.cc:769] Sending connection context
0812 00:04:20.320351 (+ 50us) client_negotiation.cc:240] Negotiation successful
0812 00:04:20.320438 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23}
I20260812 00:04:20.320546 3741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:20.314656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54800 (local address 127.11.206.125:46445)
0812 00:04:20.314705 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:20.314707 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:20.314716 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:04:20.314743 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:20.314744 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:20.314754 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:20.314812 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:20.315100 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:20.315649 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:20.316407 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:20.316606 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:20.316660 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:20.318297 (+ 1637us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:20.318299 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:20.318299 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:04:20.318306 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:20.319548 (+ 1242us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:20.319829 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:20.319830 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:20.319831 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:20.319886 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:20.320067 (+ 181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:20.320068 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:20.320068 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:20.320190 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:20.320224 (+ 34us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:20.320394 (+ 170us) server_negotiation.cc:299] Negotiation successful
0812 00:04:20.320463 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 00:04:20.320833 3859 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.206.124" port: 35987 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 00:04:20 dist-test-slave-f0tn krb5kdc[3464](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493059, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
Aug 12 00:04:20 dist-test-slave-f0tn krb5kdc[3464](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493060, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.124@KRBTEST.COM for kudu/127.11.206.124@KRBTEST.COM
I20260812 00:04:20.326078 3615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:20.318487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33518 (local address 127.11.206.126:33333)
0812 00:04:20.318688 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:20.318689 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:20.318697 (+ 8us) server_negotiation.cc:407] Connection header received
0812 00:04:20.318715 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:20.318716 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:20.318723 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:20.318770 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:20.319331 (+ 561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:20.319771 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:20.320504 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:20.320769 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:20.320823 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:20.322914 (+ 2091us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:20.322915 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:20.322916 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:04:20.322923 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:20.324456 (+ 1533us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:20.324774 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:20.324775 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:20.324775 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:20.324852 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:20.325063 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:20.325064 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:20.325064 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:20.325172 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:20.325910 (+ 738us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:20.325947 (+ 37us) server_negotiation.cc:299] Negotiation successful
0812 00:04:20.326012 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":178}
I20260812 00:04:20.326964 3871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:20.321126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40528 (local address 127.11.206.124:35987)
0812 00:04:20.321159 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:20.321161 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:20.321182 (+ 21us) server_negotiation.cc:407] Connection header received
0812 00:04:20.321198 (+ 16us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:20.321199 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:20.321207 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:20.321246 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:20.321493 (+ 247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:20.321970 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:20.322571 (+ 601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:20.322780 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:20.322824 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:20.324613 (+ 1789us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:20.324614 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:20.324615 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:04:20.324621 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:20.325880 (+ 1259us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:20.326154 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:20.326155 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:20.326155 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:20.326205 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:20.326480 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:20.326481 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:20.326481 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:20.326579 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:20.326630 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:20.326753 (+ 123us) server_negotiation.cc:299] Negotiation successful
0812 00:04:20.326880 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":62,"server-negotiator.queue_time_us":19}
I20260812 00:04:20.326965 3865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:20.321078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.124:35987 (local address 127.0.0.1:40528)
0812 00:04:20.321115 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:20.321124 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:20.321155 (+ 31us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:20.321248 (+ 93us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:20.321248 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:20.321373 (+ 125us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:04:20.321435 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:20.321436 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:20.322035 (+ 599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:20.322036 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:20.322497 (+ 461us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:20.322498 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:20.322845 (+ 347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:20.322846 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:20.322909 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:20.323237 (+ 328us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:04:20.323242 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:04:20.324558 (+ 1316us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:04:20.325950 (+ 1392us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:20.325950 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:20.325951 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:20.326097 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:20.326373 (+ 276us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:20.326374 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:20.326374 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:20.326423 (+ 49us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:20.326630 (+ 207us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:04:20.326631 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:04:20.326668 (+ 37us) client_negotiation.cc:769] Sending connection context
0812 00:04:20.326728 (+ 60us) client_negotiation.cc:240] Negotiation successful
0812 00:04:20.326831 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25}
I20260812 00:04:20.328425 3859 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b693d9af02924bf8aa3a87671c6a360d: Bootstrap starting.
I20260812 00:04:20.329282 3859 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b693d9af02924bf8aa3a87671c6a360d: Neither blocks nor log segments found. Creating new log.
I20260812 00:04:20.329584 3859 log.cc:824] T 00000000000000000000000000000000 P b693d9af02924bf8aa3a87671c6a360d: Log is configured to *not* fsync() on all Append() calls
I20260812 00:04:20.330443 3859 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b693d9af02924bf8aa3a87671c6a360d: No bootstrap required, opened a new log
Aug 12 00:04:20 dist-test-slave-f0tn krb5kdc[3464](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493059, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.206.125@KRBTEST.COM
I20260812 00:04:20.332433 3859 raft_consensus.cc:348] T 00000000000000000000000000000000 P b693d9af02924bf8aa3a87671c6a360d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aca7e9a24a742dc8ded546568d8f28c" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 33333 } } peers { permanent_uuid: "0a01e68bc2da44c9a6d64124800a4edd" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 46445 } } peers { permanent_uuid: "b693d9af02924bf8aa3a87671c6a360d" member_type: VOTER last_known_addr { host: "127.11.206.124" port: 35987 } }
I20260812 00:04:20.332602 3859 raft_consensus.cc:374] T 00000000000000000000000000000000 P b693d9af02924bf8aa3a87671c6a360d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:04:20.332641 3859 raft_consensus.cc:729] T 00000000000000000000000000000000 P b693d9af02924bf8aa3a87671c6a360d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b693d9af02924bf8aa3a87671c6a360d, State: Initialized, Role: FOLLOWER
I20260812 00:04:20.332777 3859 consensus_queue.cc:260] T 00000000000000000000000000000000 P b693d9af02924bf8aa3a87671c6a360d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aca7e9a24a742dc8ded546568d8f28c" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 33333 } } peers { permanent_uuid: "0a01e68bc2da44c9a6d64124800a4edd" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 46445 } } peers { permanent_uuid: "b693d9af02924bf8aa3a87671c6a360d" member_type: VOTER last_known_addr { host: "127.11.206.124" port: 35987 } }
I20260812 00:04:20.333086 3874 sys_catalog.cc:455] T 00000000000000000000000000000000 P b693d9af02924bf8aa3a87671c6a360d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aca7e9a24a742dc8ded546568d8f28c" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 33333 } } peers { permanent_uuid: "0a01e68bc2da44c9a6d64124800a4edd" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 46445 } } peers { permanent_uuid: "b693d9af02924bf8aa3a87671c6a360d" member_type: VOTER last_known_addr { host: "127.11.206.124" port: 35987 } } }
I20260812 00:04:20.333127 3859 sys_catalog.cc:564] T 00000000000000000000000000000000 P b693d9af02924bf8aa3a87671c6a360d [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:04:20.333177 3874 sys_catalog.cc:458] T 00000000000000000000000000000000 P b693d9af02924bf8aa3a87671c6a360d [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:04:20.333730 3741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:20.326692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54808 (local address 127.11.206.125:46445)
0812 00:04:20.326739 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:20.326741 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:20.326748 (+ 7us) server_negotiation.cc:407] Connection header received
0812 00:04:20.326769 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:20.326770 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:20.326778 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:20.326819 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:20.327343 (+ 524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:20.327877 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:20.328497 (+ 620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:20.328713 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:20.328775 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:20.331007 (+ 2232us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:20.331009 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:20.331009 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:04:20.331018 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:20.332463 (+ 1445us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:20.332804 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:20.332806 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:20.332806 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:20.332859 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:20.333031 (+ 172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:20.333032 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:20.333033 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:20.333184 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:20.333361 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:20.333573 (+ 212us) server_negotiation.cc:299] Negotiation successful
0812 00:04:20.333642 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
W20260812 00:04:20.335088 3889 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b693d9af02924bf8aa3a87671c6a360d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 00:04:20.335141 3889 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 00:04:20.335592 12089 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:04:20.336293 3610 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.206.124" port: 35987 } attempt: 2
I20260812 00:04:20.335410 3744 master_runner.cc:186] Error getting master registration for 127.11.206.126:33333: OK, instance_id { permanent_uuid: "9aca7e9a24a742dc8ded546568d8f28c" instance_seqno: 1786493059994035 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 00:04:20.338392 3744 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
Aug 12 00:04:20 dist-test-slave-f0tn krb5kdc[3464](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493059, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.126@KRBTEST.COM for kudu/127.11.206.124@KRBTEST.COM
I20260812 00:04:20.344547 3615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:20.336926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33520 (local address 127.11.206.126:33333)
0812 00:04:20.336961 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:20.336963 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:20.337900 (+ 937us) server_negotiation.cc:407] Connection header received
0812 00:04:20.337980 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:20.337981 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:20.337991 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:20.338019 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:20.338713 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:20.339292 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:20.340193 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:20.340444 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:20.340474 (+ 30us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:20.341828 (+ 1354us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:20.341829 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:20.341829 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:04:20.341837 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:20.343343 (+ 1506us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:20.343707 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:20.343708 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:20.343709 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:20.343761 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:20.343955 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:20.343955 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:20.343956 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:20.344082 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:20.344169 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:20.344387 (+ 218us) server_negotiation.cc:299] Negotiation successful
0812 00:04:20.344453 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 00:04:20.345245 3612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:20.336533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.124:35987 (local address 127.0.0.1:40532)
0812 00:04:20.336619 (+ 86us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:20.336629 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:20.336666 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:20.336967 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:20.336968 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:20.337132 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:04:20.337181 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:20.337184 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:20.338078 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:20.338079 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:20.338839 (+ 760us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:20.338841 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:20.339295 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:20.339296 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:20.339352 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:20.339804 (+ 452us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:04:20.339809 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:04:20.341606 (+ 1797us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:04:20.343875 (+ 2269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:20.343876 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:20.343877 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:20.344096 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:20.344560 (+ 464us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:20.344561 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:20.344561 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:20.344628 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:20.344951 (+ 323us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:04:20.344952 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:04:20.344997 (+ 45us) client_negotiation.cc:769] Sending connection context
0812 00:04:20.345068 (+ 71us) client_negotiation.cc:240] Negotiation successful
0812 00:04:20.345153 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":67}
I20260812 00:04:20.345548 3871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:20.336799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40532 (local address 127.11.206.124:35987)
0812 00:04:20.336838 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:20.336840 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:20.336847 (+ 7us) server_negotiation.cc:407] Connection header received
0812 00:04:20.336867 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:20.336867 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:20.336876 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:20.336921 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:20.337260 (+ 339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:20.337988 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:20.338919 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:20.339220 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:20.339296 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:20.341695 (+ 2399us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:20.341696 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:20.341696 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:04:20.341703 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:20.343782 (+ 2079us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:20.344435 (+ 653us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:20.344436 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:20.344436 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:20.344496 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:20.344690 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:20.344690 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:20.344691 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:20.344863 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:20.344924 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:20.345361 (+ 437us) server_negotiation.cc:299] Negotiation successful
0812 00:04:20.345460 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 00:04:20.347157 3610 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9aca7e9a24a742dc8ded546568d8f28c: Bootstrap starting.
I20260812 00:04:20.347862 3610 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9aca7e9a24a742dc8ded546568d8f28c: Neither blocks nor log segments found. Creating new log.
I20260812 00:04:20.348140 3610 log.cc:824] T 00000000000000000000000000000000 P 9aca7e9a24a742dc8ded546568d8f28c: Log is configured to *not* fsync() on all Append() calls
I20260812 00:04:20.348995 3610 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9aca7e9a24a742dc8ded546568d8f28c: No bootstrap required, opened a new log
I20260812 00:04:20.349301 3741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:20.337214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54810 (local address 127.11.206.125:46445)
0812 00:04:20.337251 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:20.337264 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:20.340813 (+ 3549us) server_negotiation.cc:407] Connection header received
0812 00:04:20.340841 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:20.340842 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:20.340852 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:20.340901 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:20.341954 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:20.342599 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:20.343545 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:20.343833 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:20.343872 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:20.346578 (+ 2706us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:20.346579 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:20.346580 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:04:20.346587 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:20.348108 (+ 1521us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:20.348487 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:20.348489 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:20.348489 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:20.348551 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:20.348743 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:20.348744 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:20.348745 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:20.348884 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:20.348992 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:20.349139 (+ 147us) server_negotiation.cc:299] Negotiation successful
0812 00:04:20.349221 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 00:04:20.350746 3610 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9aca7e9a24a742dc8ded546568d8f28c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aca7e9a24a742dc8ded546568d8f28c" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 33333 } } peers { permanent_uuid: "0a01e68bc2da44c9a6d64124800a4edd" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 46445 } } peers { permanent_uuid: "b693d9af02924bf8aa3a87671c6a360d" member_type: VOTER last_known_addr { host: "127.11.206.124" port: 35987 } }
I20260812 00:04:20.350867 3610 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9aca7e9a24a742dc8ded546568d8f28c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:04:20.350888 3610 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9aca7e9a24a742dc8ded546568d8f28c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9aca7e9a24a742dc8ded546568d8f28c, State: Initialized, Role: FOLLOWER
I20260812 00:04:20.350979 3610 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9aca7e9a24a742dc8ded546568d8f28c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aca7e9a24a742dc8ded546568d8f28c" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 33333 } } peers { permanent_uuid: "0a01e68bc2da44c9a6d64124800a4edd" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 46445 } } peers { permanent_uuid: "b693d9af02924bf8aa3a87671c6a360d" member_type: VOTER last_known_addr { host: "127.11.206.124" port: 35987 } }
I20260812 00:04:20.351231 3908 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9aca7e9a24a742dc8ded546568d8f28c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aca7e9a24a742dc8ded546568d8f28c" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 33333 } } peers { permanent_uuid: "0a01e68bc2da44c9a6d64124800a4edd" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 46445 } } peers { permanent_uuid: "b693d9af02924bf8aa3a87671c6a360d" member_type: VOTER last_known_addr { host: "127.11.206.124" port: 35987 } } }
I20260812 00:04:20.351295 3610 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9aca7e9a24a742dc8ded546568d8f28c [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:04:20.351315 3908 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9aca7e9a24a742dc8ded546568d8f28c [sys.catalog]: This master's current role is: FOLLOWER
W20260812 00:04:20.352939 3929 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9aca7e9a24a742dc8ded546568d8f28c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 00:04:20.352998 3929 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 00:04:20.353910 3489 master_runner.cc:186] Error getting master registration for 127.11.206.125:46445: OK, instance_id { permanent_uuid: "0a01e68bc2da44c9a6d64124800a4edd" instance_seqno: 1786493060138615 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 00:04:20.357698 3489 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 00:04:20.358517 3904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:20.337547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40546 (local address 127.11.206.124:35987)
0812 00:04:20.337799 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:20.337801 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:20.341756 (+ 3955us) server_negotiation.cc:407] Connection header received
0812 00:04:20.342122 (+ 366us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:20.342123 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:20.342134 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:20.342199 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:20.345003 (+ 2804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:20.348421 (+ 3418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:20.353794 (+ 5373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:20.354115 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:20.354161 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:20.355699 (+ 1538us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:20.355701 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:20.355701 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:04:20.355708 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:20.357335 (+ 1627us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:20.357764 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:20.357766 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:20.357766 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:20.357824 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:20.357988 (+ 164us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:20.357989 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:20.357989 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:20.358098 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:20.358197 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:20.358325 (+ 128us) server_negotiation.cc:299] Negotiation successful
0812 00:04:20.358403 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":226,"thread_start_us":91,"threads_started":1}
I20260812 00:04:20.371284 3733 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.206.124" port: 35987 } attempt: 3
Aug 12 00:04:20 dist-test-slave-f0tn krb5kdc[3464](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493060, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.125@KRBTEST.COM for kudu/127.11.206.124@KRBTEST.COM
I20260812 00:04:20.380016 3738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:20.371577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.124:35987 (local address 127.0.0.1:40554)
0812 00:04:20.371629 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:20.371640 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:20.371677 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:20.371886 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:20.371887 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:20.372084 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:04:20.372138 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:20.372140 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:20.373096 (+ 956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:20.373097 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:20.373940 (+ 843us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:20.373943 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:20.374421 (+ 478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:20.374422 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:20.374480 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:20.375239 (+ 759us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:04:20.375245 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:04:20.376804 (+ 1559us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:04:20.378833 (+ 2029us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:20.378834 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:20.378834 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:20.379077 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:20.379323 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:20.379324 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:20.379324 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:20.379388 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:20.379665 (+ 277us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:04:20.379666 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:04:20.379721 (+ 55us) client_negotiation.cc:769] Sending connection context
0812 00:04:20.379806 (+ 85us) client_negotiation.cc:240] Negotiation successful
0812 00:04:20.379909 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260812 00:04:20.380345 3904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:20.371626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40554 (local address 127.11.206.124:35987)
0812 00:04:20.371746 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:20.371748 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:20.371766 (+ 18us) server_negotiation.cc:407] Connection header received
0812 00:04:20.371785 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:20.371786 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:20.371797 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:20.371845 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:20.372221 (+ 376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:20.373019 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:20.374021 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:20.374345 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:20.374420 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:20.376883 (+ 2463us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:20.376885 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:20.376885 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:04:20.376893 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:20.378739 (+ 1846us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:20.379139 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:20.379140 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:20.379140 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:20.379239 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:20.379453 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:20.379454 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:20.379454 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:20.379598 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:20.379660 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:20.379848 (+ 188us) server_negotiation.cc:299] Negotiation successful
0812 00:04:20.379930 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98}
I20260812 00:04:20.382120 3733 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0a01e68bc2da44c9a6d64124800a4edd: Bootstrap starting.
I20260812 00:04:20.382846 3733 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0a01e68bc2da44c9a6d64124800a4edd: Neither blocks nor log segments found. Creating new log.
I20260812 00:04:20.383148 3733 log.cc:824] T 00000000000000000000000000000000 P 0a01e68bc2da44c9a6d64124800a4edd: Log is configured to *not* fsync() on all Append() calls
I20260812 00:04:20.384028 3733 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0a01e68bc2da44c9a6d64124800a4edd: No bootstrap required, opened a new log
I20260812 00:04:20.386022 3733 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0a01e68bc2da44c9a6d64124800a4edd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aca7e9a24a742dc8ded546568d8f28c" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 33333 } } peers { permanent_uuid: "0a01e68bc2da44c9a6d64124800a4edd" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 46445 } } peers { permanent_uuid: "b693d9af02924bf8aa3a87671c6a360d" member_type: VOTER last_known_addr { host: "127.11.206.124" port: 35987 } }
I20260812 00:04:20.386165 3733 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0a01e68bc2da44c9a6d64124800a4edd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:04:20.386197 3733 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0a01e68bc2da44c9a6d64124800a4edd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a01e68bc2da44c9a6d64124800a4edd, State: Initialized, Role: FOLLOWER
I20260812 00:04:20.386431 3733 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0a01e68bc2da44c9a6d64124800a4edd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aca7e9a24a742dc8ded546568d8f28c" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 33333 } } peers { permanent_uuid: "0a01e68bc2da44c9a6d64124800a4edd" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 46445 } } peers { permanent_uuid: "b693d9af02924bf8aa3a87671c6a360d" member_type: VOTER last_known_addr { host: "127.11.206.124" port: 35987 } }
I20260812 00:04:20.386832 3733 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0a01e68bc2da44c9a6d64124800a4edd [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:04:20.386791 3935 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0a01e68bc2da44c9a6d64124800a4edd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aca7e9a24a742dc8ded546568d8f28c" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 33333 } } peers { permanent_uuid: "0a01e68bc2da44c9a6d64124800a4edd" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 46445 } } peers { permanent_uuid: "b693d9af02924bf8aa3a87671c6a360d" member_type: VOTER last_known_addr { host: "127.11.206.124" port: 35987 } } }
I20260812 00:04:20.386968 3935 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0a01e68bc2da44c9a6d64124800a4edd [sys.catalog]: This master's current role is: FOLLOWER
W20260812 00:04:20.388845 3957 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 0a01e68bc2da44c9a6d64124800a4edd: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 00:04:20.388898 3957 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 00:04:20.390884 3622 master_runner.cc:263] No leader master found from master 0a01e68bc2da44c9a6d64124800a4edd
I20260812 00:04:20.390928 3622 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 00:04:20.446333 3908 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9aca7e9a24a742dc8ded546568d8f28c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:04:20.446477 3908 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9aca7e9a24a742dc8ded546568d8f28c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aca7e9a24a742dc8ded546568d8f28c" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 33333 } } peers { permanent_uuid: "0a01e68bc2da44c9a6d64124800a4edd" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 46445 } } peers { permanent_uuid: "b693d9af02924bf8aa3a87671c6a360d" member_type: VOTER last_known_addr { host: "127.11.206.124" port: 35987 } }
I20260812 00:04:20.446739 3908 leader_election.cc:288] T 00000000000000000000000000000000 P 9aca7e9a24a742dc8ded546568d8f28c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a01e68bc2da44c9a6d64124800a4edd (127.11.206.125:46445), b693d9af02924bf8aa3a87671c6a360d (127.11.206.124:35987)
I20260812 00:04:20.447136 3819 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9aca7e9a24a742dc8ded546568d8f28c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b693d9af02924bf8aa3a87671c6a360d" is_pre_election: true
I20260812 00:04:20.447314 3819 raft_consensus.cc:2454] T 00000000000000000000000000000000 P b693d9af02924bf8aa3a87671c6a360d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9aca7e9a24a742dc8ded546568d8f28c in term 0.
I20260812 00:04:20.447654 3690 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9aca7e9a24a742dc8ded546568d8f28c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a01e68bc2da44c9a6d64124800a4edd" is_pre_election: true
I20260812 00:04:20.447835 3690 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 0a01e68bc2da44c9a6d64124800a4edd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9aca7e9a24a742dc8ded546568d8f28c in term 0.
I20260812 00:04:20.448038 3511 leader_election.cc:302] T 00000000000000000000000000000000 P 9aca7e9a24a742dc8ded546568d8f28c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9aca7e9a24a742dc8ded546568d8f28c, b693d9af02924bf8aa3a87671c6a360d; no voters:
I20260812 00:04:20.448292 3908 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9aca7e9a24a742dc8ded546568d8f28c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:04:20.448355 3908 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9aca7e9a24a742dc8ded546568d8f28c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:04:20.448382 3908 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9aca7e9a24a742dc8ded546568d8f28c [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:04:20.449268 3908 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9aca7e9a24a742dc8ded546568d8f28c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aca7e9a24a742dc8ded546568d8f28c" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 33333 } } peers { permanent_uuid: "0a01e68bc2da44c9a6d64124800a4edd" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 46445 } } peers { permanent_uuid: "b693d9af02924bf8aa3a87671c6a360d" member_type: VOTER last_known_addr { host: "127.11.206.124" port: 35987 } }
I20260812 00:04:20.449424 3908 leader_election.cc:288] T 00000000000000000000000000000000 P 9aca7e9a24a742dc8ded546568d8f28c [CANDIDATE]: Term 1 election: Requested vote from peers 0a01e68bc2da44c9a6d64124800a4edd (127.11.206.125:46445), b693d9af02924bf8aa3a87671c6a360d (127.11.206.124:35987)
I20260812 00:04:20.449676 3819 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9aca7e9a24a742dc8ded546568d8f28c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b693d9af02924bf8aa3a87671c6a360d"
I20260812 00:04:20.449774 3819 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b693d9af02924bf8aa3a87671c6a360d [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:04:20.450662 3819 raft_consensus.cc:2454] T 00000000000000000000000000000000 P b693d9af02924bf8aa3a87671c6a360d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9aca7e9a24a742dc8ded546568d8f28c in term 1.
I20260812 00:04:20.450868 3511 leader_election.cc:302] T 00000000000000000000000000000000 P 9aca7e9a24a742dc8ded546568d8f28c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9aca7e9a24a742dc8ded546568d8f28c, b693d9af02924bf8aa3a87671c6a360d; no voters:
I20260812 00:04:20.451007 3690 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9aca7e9a24a742dc8ded546568d8f28c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a01e68bc2da44c9a6d64124800a4edd"
I20260812 00:04:20.451112 3690 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0a01e68bc2da44c9a6d64124800a4edd [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:04:20.452055 3690 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 0a01e68bc2da44c9a6d64124800a4edd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9aca7e9a24a742dc8ded546568d8f28c in term 1.
I20260812 00:04:20.452916 3908 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9aca7e9a24a742dc8ded546568d8f28c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:04:20.453115 3908 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9aca7e9a24a742dc8ded546568d8f28c [term 1 LEADER]: Becoming Leader. State: Replica: 9aca7e9a24a742dc8ded546568d8f28c, State: Running, Role: LEADER
I20260812 00:04:20.453224 3908 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9aca7e9a24a742dc8ded546568d8f28c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aca7e9a24a742dc8ded546568d8f28c" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 33333 } } peers { permanent_uuid: "0a01e68bc2da44c9a6d64124800a4edd" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 46445 } } peers { permanent_uuid: "b693d9af02924bf8aa3a87671c6a360d" member_type: VOTER last_known_addr { host: "127.11.206.124" port: 35987 } }
I20260812 00:04:20.453681 3908 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9aca7e9a24a742dc8ded546568d8f28c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9aca7e9a24a742dc8ded546568d8f28c. Latest consensus state: current_term: 1 leader_uuid: "9aca7e9a24a742dc8ded546568d8f28c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aca7e9a24a742dc8ded546568d8f28c" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 33333 } } peers { permanent_uuid: "0a01e68bc2da44c9a6d64124800a4edd" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 46445 } } peers { permanent_uuid: "b693d9af02924bf8aa3a87671c6a360d" member_type: VOTER last_known_addr { host: "127.11.206.124" port: 35987 } } }
I20260812 00:04:20.453770 3908 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9aca7e9a24a742dc8ded546568d8f28c [sys.catalog]: This master's current role is: LEADER
I20260812 00:04:20.454468 3964 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:04:20.454668 3964 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:04:20.456274 3819 raft_consensus.cc:1261] T 00000000000000000000000000000000 P b693d9af02924bf8aa3a87671c6a360d [term 1 FOLLOWER]: Refusing update from remote peer 9aca7e9a24a742dc8ded546568d8f28c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:04:20.456619 3960 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 9aca7e9a24a742dc8ded546568d8f28c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b693d9af02924bf8aa3a87671c6a360d" member_type: VOTER last_known_addr { host: "127.11.206.124" port: 35987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:04:20.457993 3874 sys_catalog.cc:455] T 00000000000000000000000000000000 P b693d9af02924bf8aa3a87671c6a360d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9aca7e9a24a742dc8ded546568d8f28c. Latest consensus state: current_term: 1 leader_uuid: "9aca7e9a24a742dc8ded546568d8f28c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aca7e9a24a742dc8ded546568d8f28c" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 33333 } } peers { permanent_uuid: "0a01e68bc2da44c9a6d64124800a4edd" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 46445 } } peers { permanent_uuid: "b693d9af02924bf8aa3a87671c6a360d" member_type: VOTER last_known_addr { host: "127.11.206.124" port: 35987 } } }
I20260812 00:04:20.458091 3874 sys_catalog.cc:458] T 00000000000000000000000000000000 P b693d9af02924bf8aa3a87671c6a360d [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:04:20.458451 3690 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 0a01e68bc2da44c9a6d64124800a4edd [term 1 FOLLOWER]: Refusing update from remote peer 9aca7e9a24a742dc8ded546568d8f28c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:04:20.458724 3960 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 9aca7e9a24a742dc8ded546568d8f28c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a01e68bc2da44c9a6d64124800a4edd" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 46445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:04:20.459975 3935 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0a01e68bc2da44c9a6d64124800a4edd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9aca7e9a24a742dc8ded546568d8f28c. Latest consensus state: current_term: 1 leader_uuid: "9aca7e9a24a742dc8ded546568d8f28c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aca7e9a24a742dc8ded546568d8f28c" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 33333 } } peers { permanent_uuid: "0a01e68bc2da44c9a6d64124800a4edd" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 46445 } } peers { permanent_uuid: "b693d9af02924bf8aa3a87671c6a360d" member_type: VOTER last_known_addr { host: "127.11.206.124" port: 35987 } } }
I20260812 00:04:20.460069 3935 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0a01e68bc2da44c9a6d64124800a4edd [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:04:20.461069 3960 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9aca7e9a24a742dc8ded546568d8f28c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9aca7e9a24a742dc8ded546568d8f28c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aca7e9a24a742dc8ded546568d8f28c" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 33333 } } peers { permanent_uuid: "0a01e68bc2da44c9a6d64124800a4edd" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 46445 } } peers { permanent_uuid: "b693d9af02924bf8aa3a87671c6a360d" member_type: VOTER last_known_addr { host: "127.11.206.124" port: 35987 } } }
I20260812 00:04:20.461158 3960 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9aca7e9a24a742dc8ded546568d8f28c [sys.catalog]: This master's current role is: LEADER
I20260812 00:04:20.461571 3874 sys_catalog.cc:455] T 00000000000000000000000000000000 P b693d9af02924bf8aa3a87671c6a360d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "9aca7e9a24a742dc8ded546568d8f28c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aca7e9a24a742dc8ded546568d8f28c" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 33333 } } peers { permanent_uuid: "0a01e68bc2da44c9a6d64124800a4edd" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 46445 } } peers { permanent_uuid: "b693d9af02924bf8aa3a87671c6a360d" member_type: VOTER last_known_addr { host: "127.11.206.124" port: 35987 } } }
I20260812 00:04:20.461664 3874 sys_catalog.cc:458] T 00000000000000000000000000000000 P b693d9af02924bf8aa3a87671c6a360d [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:04:20.461892 3966 mvcc.cc:205] Tried to move back new op lower bound from 7317475575626297344 to 7317475575617163264. Current Snapshot: MvccSnapshot[applied={T|T < 7317475575626297344}]
I20260812 00:04:20.462698 3967 mvcc.cc:205] Tried to move back new op lower bound from 7317475575626297344 to 7317475575617163264. Current Snapshot: MvccSnapshot[applied={T|T < 7317475575626297344}]
I20260812 00:04:20.463238 3964 catalog_manager.cc:1347] Generated new cluster ID: 122a571ed40f4cce98d9c73adaa974e5
I20260812 00:04:20.463291 3964 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:04:20.474221 3908 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9aca7e9a24a742dc8ded546568d8f28c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9aca7e9a24a742dc8ded546568d8f28c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aca7e9a24a742dc8ded546568d8f28c" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 33333 } } peers { permanent_uuid: "0a01e68bc2da44c9a6d64124800a4edd" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 46445 } } peers { permanent_uuid: "b693d9af02924bf8aa3a87671c6a360d" member_type: VOTER last_known_addr { host: "127.11.206.124" port: 35987 } } }
I20260812 00:04:20.474346 3908 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9aca7e9a24a742dc8ded546568d8f28c [sys.catalog]: This master's current role is: LEADER
I20260812 00:04:20.474874 3935 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0a01e68bc2da44c9a6d64124800a4edd [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "9aca7e9a24a742dc8ded546568d8f28c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aca7e9a24a742dc8ded546568d8f28c" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 33333 } } peers { permanent_uuid: "0a01e68bc2da44c9a6d64124800a4edd" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 46445 } } peers { permanent_uuid: "b693d9af02924bf8aa3a87671c6a360d" member_type: VOTER last_known_addr { host: "127.11.206.124" port: 35987 } } }
I20260812 00:04:20.474978 3935 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0a01e68bc2da44c9a6d64124800a4edd [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:04:20.481734 3964 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:04:20.482477 3964 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:04:20.497342 3964 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9aca7e9a24a742dc8ded546568d8f28c: Generated new TSK 0
I20260812 00:04:20.497586 3964 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:04:21.335639 3889 catalog_manager.cc:1259] Loaded cluster ID: 122a571ed40f4cce98d9c73adaa974e5
I20260812 00:04:21.335731 3889 catalog_manager.cc:1552] T 00000000000000000000000000000000 P b693d9af02924bf8aa3a87671c6a360d: loading cluster ID for follower catalog manager: success
I20260812 00:04:21.336619 3889 catalog_manager.cc:1574] T 00000000000000000000000000000000 P b693d9af02924bf8aa3a87671c6a360d: acquiring CA information for follower catalog manager: success
I20260812 00:04:21.336961 3889 catalog_manager.cc:1602] T 00000000000000000000000000000000 P b693d9af02924bf8aa3a87671c6a360d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 00:04:21.389305 3957 catalog_manager.cc:1259] Loaded cluster ID: 122a571ed40f4cce98d9c73adaa974e5
I20260812 00:04:21.389402 3957 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 0a01e68bc2da44c9a6d64124800a4edd: loading cluster ID for follower catalog manager: success
I20260812 00:04:21.390228 3957 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 0a01e68bc2da44c9a6d64124800a4edd: acquiring CA information for follower catalog manager: success
I20260812 00:04:21.390542 3957 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 0a01e68bc2da44c9a6d64124800a4edd: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 00:04:21.551877 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 3489
I20260812 00:04:21.564826 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 3622
I20260812 00:04:21.577942 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 3744
2026-08-12T00:04:21Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3070 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786492899949492-12089-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:04:21 dist-test-slave-f0tn krb5kdc[3989](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:04:21 dist-test-slave-f0tn krb5kdc[3989](info): set up 2 sockets
Aug 12 00:04:21 dist-test-slave-f0tn krb5kdc[3989](info): commencing operation
krb5kdc: starting...
W20260812 00:04:22.775270 12089 mini_kdc.cc:121] Time spent starting KDC: real 1.166s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786492899949492-12089-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786492899949492-12089-0/krb5kdc/test-user.keytab.
Aug 12 00:04:22 dist-test-slave-f0tn krb5kdc[3989](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493062, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:04:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:04:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.206.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab.
Entry for principal kudu/127.11.206.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab.
I20260812 00:04:22.890075 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786492899949492-12089-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786492899949492-12089-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786492899949492-12089-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:42727
--webserver_interface=127.11.206.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab
--principal=kudu/127.11.206.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:44387
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.206.126:42727
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:04:22.971612 4008 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:04:22.971805 4008 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:04:22.971827 4008 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:04:22.972885 4008 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:04:22.972919 4008 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:04:22.972932 4008 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:04:22.972944 4008 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:04:22.972954 4008 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:04:22.974417 4008 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:44387
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786492899949492-12089-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786492899949492-12089-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.206.126:42727
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab
--principal=kudu/127.11.206.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:42727
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.206.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4008
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786492899949492-12089-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:04:22.974620 4008 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:04:22.974792 4008 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:04:22.979571 4019 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:22.979560 4017 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:22.979622 4008 server_base.cc:1034] running on GCE node
W20260812 00:04:22.979548 4023 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:22.979974 4008 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:04:22.980226 4008 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:04:22.981366 4008 hybrid_clock.cc:648] HybridClock initialized: now 1786493062981358 us; error 27 us; skew 500 ppm
Aug 12 00:04:22 dist-test-slave-f0tn krb5kdc[3989](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493062, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:04:22.983798 4008 init.cc:377] Logged in from keytab as kudu/127.11.206.126@KRBTEST.COM (short username kudu)
I20260812 00:04:22.984176 4008 webserver.cc:460] Webserver started at http://127.11.206.126:34813/ using document root <none> and password file <none>
I20260812 00:04:22.984357 4008 fs_manager.cc:359] Metadata directory not provided
I20260812 00:04:22.984413 4008 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:04:22.984534 4008 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:04:22.985597 4008 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786492899949492-12089-0/minicluster-data/master-0/data/instance:
uuid: "7ed95055bc5c42488b37b4ed18d740b4"
format_stamp: "Formatted at 2026-08-12 00:04:22 on dist-test-slave-f0tn"
server_key: "1e8becf1b56cc83b594a950e84bdc978"
server_key_iv: "ababbc162cf389f85b620b2f6a83465c"
server_key_version: "encryptionkey@0"
I20260812 00:04:22.985953 4008 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786492899949492-12089-0/minicluster-data/master-0/wal/instance:
uuid: "7ed95055bc5c42488b37b4ed18d740b4"
format_stamp: "Formatted at 2026-08-12 00:04:22 on dist-test-slave-f0tn"
server_key: "1e8becf1b56cc83b594a950e84bdc978"
server_key_iv: "ababbc162cf389f85b620b2f6a83465c"
server_key_version: "encryptionkey@0"
I20260812 00:04:22.987221 4008 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:04:22.987874 4033 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:22.988039 4008 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:04:22.988122 4008 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786492899949492-12089-0/minicluster-data/master-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786492899949492-12089-0/minicluster-data/master-0/wal
uuid: "7ed95055bc5c42488b37b4ed18d740b4"
format_stamp: "Formatted at 2026-08-12 00:04:22 on dist-test-slave-f0tn"
server_key: "1e8becf1b56cc83b594a950e84bdc978"
server_key_iv: "ababbc162cf389f85b620b2f6a83465c"
server_key_version: "encryptionkey@0"
I20260812 00:04:22.988175 4008 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786492899949492-12089-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786492899949492-12089-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786492899949492-12089-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:04:23.005069 4008 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:04:23.006824 4008 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:04:23.006938 4008 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:04:23.010586 4008 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.126:42727
I20260812 00:04:23.010620 4120 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.126:42727 every 8 connection(s)
I20260812 00:04:23.010931 4008 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
I20260812 00:04:23.011782 4121 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:04:23.014008 4121 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7ed95055bc5c42488b37b4ed18d740b4: Bootstrap starting.
I20260812 00:04:23.014547 4121 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7ed95055bc5c42488b37b4ed18d740b4: Neither blocks nor log segments found. Creating new log.
I20260812 00:04:23.014849 4121 log.cc:824] T 00000000000000000000000000000000 P 7ed95055bc5c42488b37b4ed18d740b4: Log is configured to *not* fsync() on all Append() calls
I20260812 00:04:23.014876 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 4008
I20260812 00:04:23.014963 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786492899949492-12089-0/minicluster-data/master-0/wal/instance
I20260812 00:04:23.015166 12089 external_mini_cluster.cc:1428] Setting key 34a1c6db9f46e2117360bf24ae97e352
I20260812 00:04:23.015590 4121 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7ed95055bc5c42488b37b4ed18d740b4: No bootstrap required, opened a new log
I20260812 00:04:23.017531 4121 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7ed95055bc5c42488b37b4ed18d740b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ed95055bc5c42488b37b4ed18d740b4" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 42727 } }
I20260812 00:04:23.017712 4121 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7ed95055bc5c42488b37b4ed18d740b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:04:23.017769 4121 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7ed95055bc5c42488b37b4ed18d740b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ed95055bc5c42488b37b4ed18d740b4, State: Initialized, Role: FOLLOWER
I20260812 00:04:23.017902 4121 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7ed95055bc5c42488b37b4ed18d740b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ed95055bc5c42488b37b4ed18d740b4" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 42727 } }
I20260812 00:04:23.017977 4121 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7ed95055bc5c42488b37b4ed18d740b4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:04:23.018014 4121 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7ed95055bc5c42488b37b4ed18d740b4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:04:23.018056 4121 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7ed95055bc5c42488b37b4ed18d740b4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:04:23.018687 4121 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7ed95055bc5c42488b37b4ed18d740b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ed95055bc5c42488b37b4ed18d740b4" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 42727 } }
I20260812 00:04:23.018802 4121 leader_election.cc:302] T 00000000000000000000000000000000 P 7ed95055bc5c42488b37b4ed18d740b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7ed95055bc5c42488b37b4ed18d740b4; no voters:
I20260812 00:04:23.018939 4121 leader_election.cc:288] T 00000000000000000000000000000000 P 7ed95055bc5c42488b37b4ed18d740b4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:04:23.018989 4127 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7ed95055bc5c42488b37b4ed18d740b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:04:23.019151 4121 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7ed95055bc5c42488b37b4ed18d740b4 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:04:23.019183 4127 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7ed95055bc5c42488b37b4ed18d740b4 [term 1 LEADER]: Becoming Leader. State: Replica: 7ed95055bc5c42488b37b4ed18d740b4, State: Running, Role: LEADER
I20260812 00:04:23.020372 4127 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7ed95055bc5c42488b37b4ed18d740b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ed95055bc5c42488b37b4ed18d740b4" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 42727 } }
I20260812 00:04:23.020890 4129 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ed95055bc5c42488b37b4ed18d740b4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7ed95055bc5c42488b37b4ed18d740b4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ed95055bc5c42488b37b4ed18d740b4" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 42727 } } }
I20260812 00:04:23.020957 4129 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ed95055bc5c42488b37b4ed18d740b4 [sys.catalog]: This master's current role is: LEADER
I20260812 00:04:23.021334 4150 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:04:23.021337 4130 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ed95055bc5c42488b37b4ed18d740b4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7ed95055bc5c42488b37b4ed18d740b4. Latest consensus state: current_term: 1 leader_uuid: "7ed95055bc5c42488b37b4ed18d740b4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ed95055bc5c42488b37b4ed18d740b4" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 42727 } } }
I20260812 00:04:23.021497 4130 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ed95055bc5c42488b37b4ed18d740b4 [sys.catalog]: This master's current role is: LEADER
I20260812 00:04:23.021914 4150 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 12 00:04:23 dist-test-slave-f0tn krb5kdc[3989](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493062, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:04:23.023435 4150 catalog_manager.cc:1347] Generated new cluster ID: 8526b95ffcb8424fa9d0bdd93abdf73d
I20260812 00:04:23.023497 4150 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:04:23.027215 4126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:23.015583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51114 (local address 127.11.206.126:42727)
0812 00:04:23.015753 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:23.015762 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:23.015795 (+ 33us) server_negotiation.cc:407] Connection header received
0812 00:04:23.016734 (+ 939us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:23.016744 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:23.016807 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:23.016952 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:23.017530 (+ 578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:23.019124 (+ 1594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:23.020018 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:23.020622 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:23.020738 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:23.023539 (+ 2801us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:23.023543 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:23.023543 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:04:23.023554 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:23.025503 (+ 1949us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:23.025867 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:23.025870 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:23.025870 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:23.025978 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:23.026146 (+ 168us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:23.026146 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:23.026147 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:23.026443 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:23.026594 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:23.026699 (+ 105us) server_negotiation.cc:299] Negotiation successful
0812 00:04:23.026844 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":86,"threads_started":1}
I20260812 00:04:23.028120 12089 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:04:23.053668 4150 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:04:23.054240 4150 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:04:23.062836 4150 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7ed95055bc5c42488b37b4ed18d740b4: Generated new TSK 0
I20260812 00:04:23.063054 4150 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:04:23.081895 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 4008
2026-08-12T00:04:23Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1498 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:04:23 dist-test-slave-f0tn krb5kdc[4164](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:04:23 dist-test-slave-f0tn krb5kdc[4164](info): set up 2 sockets
Aug 12 00:04:23 dist-test-slave-f0tn krb5kdc[4164](info): commencing operation
krb5kdc: starting...
W20260812 00:04:24.268258 12089 mini_kdc.cc:121] Time spent starting KDC: real 1.161s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/krb5kdc/test-user.keytab.
Aug 12 00:04:24 dist-test-slave-f0tn krb5kdc[4164](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493064, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:04:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:04:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.206.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab.
Entry for principal kudu/127.11.206.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab.
I20260812 00:04:24.386260 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:39509
--webserver_interface=127.11.206.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab
--principal=kudu/127.11.206.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:46009
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.206.126:39509
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:04:24.467410 4188 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:04:24.467624 4188 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:04:24.467665 4188 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:04:24.468815 4188 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:04:24.468858 4188 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:04:24.468878 4188 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:04:24.468894 4188 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:04:24.468909 4188 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:04:24.470451 4188 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:46009
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.206.126:39509
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab
--principal=kudu/127.11.206.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:39509
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.206.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4188
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:04:24.470709 4188 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:04:24.470920 4188 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:04:24.475847 4198 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:24.475850 4200 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:24.475878 4188 server_base.cc:1034] running on GCE node
W20260812 00:04:24.475844 4195 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:24.476373 4188 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:04:24.476689 4188 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:04:24.477865 4188 hybrid_clock.cc:648] HybridClock initialized: now 1786493064477841 us; error 33 us; skew 500 ppm
Aug 12 00:04:24 dist-test-slave-f0tn krb5kdc[4164](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493064, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:04:24.483276 4188 init.cc:377] Logged in from keytab as kudu/127.11.206.126@KRBTEST.COM (short username kudu)
I20260812 00:04:24.483785 4188 webserver.cc:460] Webserver started at http://127.11.206.126:44489/ using document root <none> and password file <none>
I20260812 00:04:24.483999 4188 fs_manager.cc:359] Metadata directory not provided
I20260812 00:04:24.484050 4188 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:04:24.484184 4188 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:04:24.485320 4188 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/master-0/data/instance:
uuid: "1659d7b29a0f4e7f8272846248919213"
format_stamp: "Formatted at 2026-08-12 00:04:24 on dist-test-slave-f0tn"
server_key: "bcea93e1a1422ea8f5fb0807dbb0923f"
server_key_iv: "bd079881b7a9ac2e8c43045bd2dfad9f"
server_key_version: "encryptionkey@0"
I20260812 00:04:24.485731 4188 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/master-0/wal/instance:
uuid: "1659d7b29a0f4e7f8272846248919213"
format_stamp: "Formatted at 2026-08-12 00:04:24 on dist-test-slave-f0tn"
server_key: "bcea93e1a1422ea8f5fb0807dbb0923f"
server_key_iv: "bd079881b7a9ac2e8c43045bd2dfad9f"
server_key_version: "encryptionkey@0"
I20260812 00:04:24.487054 4188 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:04:24.487793 4215 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:24.487951 4188 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:04:24.488041 4188 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/master-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/master-0/wal
uuid: "1659d7b29a0f4e7f8272846248919213"
format_stamp: "Formatted at 2026-08-12 00:04:24 on dist-test-slave-f0tn"
server_key: "bcea93e1a1422ea8f5fb0807dbb0923f"
server_key_iv: "bd079881b7a9ac2e8c43045bd2dfad9f"
server_key_version: "encryptionkey@0"
I20260812 00:04:24.488111 4188 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:04:24.504858 4188 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:04:24.507179 4188 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:04:24.507323 4188 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:04:24.511307 4188 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.126:39509
I20260812 00:04:24.511348 4313 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.126:39509 every 8 connection(s)
I20260812 00:04:24.511754 4188 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
I20260812 00:04:24.513023 4315 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:04:24.516306 4315 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1659d7b29a0f4e7f8272846248919213: Bootstrap starting.
I20260812 00:04:24.517045 4315 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1659d7b29a0f4e7f8272846248919213: Neither blocks nor log segments found. Creating new log.
I20260812 00:04:24.517344 4315 log.cc:824] T 00000000000000000000000000000000 P 1659d7b29a0f4e7f8272846248919213: Log is configured to *not* fsync() on all Append() calls
I20260812 00:04:24.518167 4315 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1659d7b29a0f4e7f8272846248919213: No bootstrap required, opened a new log
I20260812 00:04:24.519758 4315 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1659d7b29a0f4e7f8272846248919213 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1659d7b29a0f4e7f8272846248919213" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 39509 } }
I20260812 00:04:24.519899 4315 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1659d7b29a0f4e7f8272846248919213 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:04:24.519932 4315 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1659d7b29a0f4e7f8272846248919213 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1659d7b29a0f4e7f8272846248919213, State: Initialized, Role: FOLLOWER
I20260812 00:04:24.520121 4315 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1659d7b29a0f4e7f8272846248919213 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1659d7b29a0f4e7f8272846248919213" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 39509 } }
I20260812 00:04:24.520399 4319 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1659d7b29a0f4e7f8272846248919213 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:04:24.520479 4319 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1659d7b29a0f4e7f8272846248919213 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1659d7b29a0f4e7f8272846248919213" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 39509 } }
I20260812 00:04:24.520210 4315 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1659d7b29a0f4e7f8272846248919213 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:04:24.520602 4319 leader_election.cc:302] T 00000000000000000000000000000000 P 1659d7b29a0f4e7f8272846248919213 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1659d7b29a0f4e7f8272846248919213; no voters:
I20260812 00:04:24.520620 4315 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1659d7b29a0f4e7f8272846248919213 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:04:24.520673 4315 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1659d7b29a0f4e7f8272846248919213 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:04:24.520757 4319 leader_election.cc:288] T 00000000000000000000000000000000 P 1659d7b29a0f4e7f8272846248919213 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers
I20260812 00:04:24.520831 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 4188
I20260812 00:04:24.520927 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/master-0/wal/instance
I20260812 00:04:24.521117 12089 external_mini_cluster.cc:1428] Setting key 96c0b9cb8b680482dfd1222df19ab815
I20260812 00:04:24.521347 4315 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1659d7b29a0f4e7f8272846248919213 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1659d7b29a0f4e7f8272846248919213" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 39509 } }
I20260812 00:04:24.521443 4315 leader_election.cc:302] T 00000000000000000000000000000000 P 1659d7b29a0f4e7f8272846248919213 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1659d7b29a0f4e7f8272846248919213; no voters:
I20260812 00:04:24.521485 4321 raft_consensus.cc:2741] T 00000000000000000000000000000000 P 1659d7b29a0f4e7f8272846248919213 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260812 00:04:24.521485 4315 leader_election.cc:288] T 00000000000000000000000000000000 P 1659d7b29a0f4e7f8272846248919213 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:04:24.521854 4319 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1659d7b29a0f4e7f8272846248919213 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:04:24.521927 4315 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1659d7b29a0f4e7f8272846248919213 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:04:24.521982 4319 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1659d7b29a0f4e7f8272846248919213 [term 1 LEADER]: Becoming Leader. State: Replica: 1659d7b29a0f4e7f8272846248919213, State: Running, Role: LEADER
I20260812 00:04:24.522131 4319 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1659d7b29a0f4e7f8272846248919213 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1659d7b29a0f4e7f8272846248919213" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 39509 } }
I20260812 00:04:24.522475 4324 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1659d7b29a0f4e7f8272846248919213 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1659d7b29a0f4e7f8272846248919213" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1659d7b29a0f4e7f8272846248919213" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 39509 } } }
I20260812 00:04:24.522565 4324 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1659d7b29a0f4e7f8272846248919213 [sys.catalog]: This master's current role is: LEADER
I20260812 00:04:24.522718 4329 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1659d7b29a0f4e7f8272846248919213 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1659d7b29a0f4e7f8272846248919213. Latest consensus state: current_term: 1 leader_uuid: "1659d7b29a0f4e7f8272846248919213" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1659d7b29a0f4e7f8272846248919213" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 39509 } } }
I20260812 00:04:24.522768 4329 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1659d7b29a0f4e7f8272846248919213 [sys.catalog]: This master's current role is: LEADER
I20260812 00:04:24.523306 4340 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:04:24.523972 4340 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:04:24.525656 4340 catalog_manager.cc:1347] Generated new cluster ID: 9afbe778840c438aa0fa3a841aad9829
I20260812 00:04:24.525710 4340 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 00:04:24 dist-test-slave-f0tn krb5kdc[4164](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493064, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:04:24.529731 4340 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:04:24.530484 4340 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:04:24.532475 4328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:24.521675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58702 (local address 127.11.206.126:39509)
0812 00:04:24.522035 (+ 360us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:24.522046 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:24.522122 (+ 76us) server_negotiation.cc:407] Connection header received
0812 00:04:24.522247 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:24.522254 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:24.522311 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:24.522491 (+ 180us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:24.523296 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:24.524372 (+ 1076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:24.525349 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:24.525898 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:24.525993 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:24.528204 (+ 2211us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:24.528209 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:24.528209 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:04:24.528221 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:24.531044 (+ 2823us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:24.531381 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:24.531384 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:24.531385 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:24.531479 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:24.531660 (+ 181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:24.531660 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:24.531661 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:24.531881 (+ 220us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:24.532035 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:24.532108 (+ 73us) server_negotiation.cc:299] Negotiation successful
0812 00:04:24.532256 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":306,"thread_start_us":72,"threads_started":1}
I20260812 00:04:24.536065 4340 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1659d7b29a0f4e7f8272846248919213: Generated new TSK 0
I20260812 00:04:24.536237 4340 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.206.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.65.keytab.
Entry for principal kudu/127.11.206.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.65.keytab.
I20260812 00:04:24.569998 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.65:0
--local_ip_for_outbound_sockets=127.11.206.65
--webserver_interface=127.11.206.65
--webserver_port=0
--tserver_master_addrs=127.11.206.126:39509
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.65.keytab
--principal=kudu/127.11.206.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:46009
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:04:24.668797 4366 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:04:24.669031 4366 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:04:24.669075 4366 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:04:24.670360 4366 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:04:24.670408 4366 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:04:24.670445 4366 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.65
I20260812 00:04:24.671967 4366 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:46009
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.65.keytab
--principal=kudu/127.11.206.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.206.65
--webserver_port=0
--tserver_master_addrs=127.11.206.126:39509
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4366
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.65
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:04:24.672235 4366 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:04:24.672461 4366 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:04:24.677738 4380 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:24.677738 4378 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:24.677762 4377 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:24.677958 4366 server_base.cc:1034] running on GCE node
I20260812 00:04:24.678268 4366 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:04:24.678515 4366 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:04:24.679698 4366 hybrid_clock.cc:648] HybridClock initialized: now 1786493064679681 us; error 42 us; skew 500 ppm
Aug 12 00:04:24 dist-test-slave-f0tn krb5kdc[4164](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493064, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:04:24.682351 4366 init.cc:377] Logged in from keytab as kudu/127.11.206.65@KRBTEST.COM (short username kudu)
I20260812 00:04:24.682833 4366 webserver.cc:460] Webserver started at http://127.11.206.65:41705/ using document root <none> and password file <none>
I20260812 00:04:24.683043 4366 fs_manager.cc:359] Metadata directory not provided
I20260812 00:04:24.683091 4366 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:04:24.683221 4366 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:04:24.684281 4366 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-0/data/instance:
uuid: "8bf8ca15e8a3411cae50308f35fdb5f9"
format_stamp: "Formatted at 2026-08-12 00:04:24 on dist-test-slave-f0tn"
server_key: "05d05338f2911c1a0feb2e96fe301695"
server_key_iv: "02e94050a6480199525ea994ed79b485"
server_key_version: "encryptionkey@0"
I20260812 00:04:24.684624 4366 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-0/wal/instance:
uuid: "8bf8ca15e8a3411cae50308f35fdb5f9"
format_stamp: "Formatted at 2026-08-12 00:04:24 on dist-test-slave-f0tn"
server_key: "05d05338f2911c1a0feb2e96fe301695"
server_key_iv: "02e94050a6480199525ea994ed79b485"
server_key_version: "encryptionkey@0"
I20260812 00:04:24.685962 4366 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260812 00:04:24.686672 4397 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:24.686831 4366 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:04:24.686919 4366 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-0/wal
uuid: "8bf8ca15e8a3411cae50308f35fdb5f9"
format_stamp: "Formatted at 2026-08-12 00:04:24 on dist-test-slave-f0tn"
server_key: "05d05338f2911c1a0feb2e96fe301695"
server_key_iv: "02e94050a6480199525ea994ed79b485"
server_key_version: "encryptionkey@0"
I20260812 00:04:24.686977 4366 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:04:24.700150 4366 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:04:24.702469 4366 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:04:24.702617 4366 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:04:24.702853 4366 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:04:24.703167 4366 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:04:24.703202 4366 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:24.703231 4366 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:04:24.703256 4366 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:24.708851 4366 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.65:39207
I20260812 00:04:24.708913 4607 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.65:39207 every 8 connection(s)
I20260812 00:04:24.709213 4366 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
Aug 12 00:04:24 dist-test-slave-f0tn krb5kdc[4164](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493064, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.65@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:04:24.716267 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 4366
I20260812 00:04:24.716367 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-0/wal/instance
I20260812 00:04:24.716550 12089 external_mini_cluster.cc:1428] Setting key 2ffa7912d8bb363025c104bcd41a3cbf
I20260812 00:04:24.718966 4328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:24.709991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.65:35591 (local address 127.11.206.126:39509)
0812 00:04:24.710040 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:24.710043 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:24.710256 (+ 213us) server_negotiation.cc:407] Connection header received
0812 00:04:24.710780 (+ 524us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:24.710782 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:24.710794 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:24.710860 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:24.711833 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:24.712392 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:24.713507 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:24.713723 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:24.713786 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:24.715962 (+ 2176us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:24.715964 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:24.715964 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:04:24.715971 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:24.717582 (+ 1611us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:24.717976 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:24.717978 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:24.717978 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:24.718044 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:24.718257 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:24.718258 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:24.718258 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:24.718387 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:24.718447 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:24.718774 (+ 327us) server_negotiation.cc:299] Negotiation successful
0812 00:04:24.718874 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 00:04:24.719169 4611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:24.709961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:39509 (local address 127.11.206.65:35591)
0812 00:04:24.710130 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:24.710175 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:24.710668 (+ 493us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:24.710932 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:24.710936 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:24.711501 (+ 565us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:04:24.711721 (+ 220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:24.711726 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:24.712511 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:24.712512 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:24.713420 (+ 908us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:24.713424 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:24.713803 (+ 379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:24.713804 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:24.713924 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:24.714418 (+ 494us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:04:24.714426 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:04:24.715873 (+ 1447us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:04:24.717678 (+ 1805us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:24.717685 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:24.717687 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:24.717907 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:24.718102 (+ 195us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:24.718103 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:24.718103 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:24.718207 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:24.718469 (+ 262us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:04:24.718476 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:04:24.718612 (+ 136us) client_negotiation.cc:769] Sending connection context
0812 00:04:24.718731 (+ 119us) client_negotiation.cc:240] Negotiation successful
0812 00:04:24.718911 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":76,"threads_started":1}
I20260812 00:04:24.719902 4608 heartbeater.cc:347] Connected to a master server at 127.11.206.126:39509
I20260812 00:04:24.720000 4608 heartbeater.cc:464] Registering TS with master...
I20260812 00:04:24.720187 4608 heartbeater.cc:511] Master 127.11.206.126:39509 requested a full tablet report, sending...
I20260812 00:04:24.720721 4241 ts_manager.cc:194] Registered new tserver with Master: 8bf8ca15e8a3411cae50308f35fdb5f9 (127.11.206.65:39207)
I20260812 00:04:24.721479 4241 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.206.65@KRBTEST.COM'} at 127.11.206.65:35591
WARNING: no policy specified for kudu/127.11.206.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.66.keytab.
Entry for principal kudu/127.11.206.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.66.keytab.
I20260812 00:04:24.740317 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.66:0
--local_ip_for_outbound_sockets=127.11.206.66
--webserver_interface=127.11.206.66
--webserver_port=0
--tserver_master_addrs=127.11.206.126:39509
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.66.keytab
--principal=kudu/127.11.206.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:46009
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:04:24.822432 4614 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:04:24.822690 4614 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:04:24.822729 4614 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:04:24.823987 4614 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:04:24.824034 4614 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:04:24.824070 4614 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.66
I20260812 00:04:24.825618 4614 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:46009
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.66.keytab
--principal=kudu/127.11.206.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.206.66
--webserver_port=0
--tserver_master_addrs=127.11.206.126:39509
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4614
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.66
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:04:24.825875 4614 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:04:24.826109 4614 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 00:04:24.831429 4614 server_base.cc:1034] running on GCE node
W20260812 00:04:24.831400 4620 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:24.831384 4624 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:24.831396 4628 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:24.831775 4614 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:04:24.832044 4614 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:04:24.833210 4614 hybrid_clock.cc:648] HybridClock initialized: now 1786493064833193 us; error 35 us; skew 500 ppm
Aug 12 00:04:24 dist-test-slave-f0tn krb5kdc[4164](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493064, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:04:24.835870 4614 init.cc:377] Logged in from keytab as kudu/127.11.206.66@KRBTEST.COM (short username kudu)
I20260812 00:04:24.836359 4614 webserver.cc:460] Webserver started at http://127.11.206.66:45473/ using document root <none> and password file <none>
I20260812 00:04:24.836591 4614 fs_manager.cc:359] Metadata directory not provided
I20260812 00:04:24.836644 4614 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:04:24.836781 4614 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:04:24.837955 4614 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-1/data/instance:
uuid: "5870757da61e462da82bf46ab1aa453a"
format_stamp: "Formatted at 2026-08-12 00:04:24 on dist-test-slave-f0tn"
server_key: "ddd599bae19a7be03e5bd7c70d605a05"
server_key_iv: "8c9000de5a93088a42fb3dc41300a32b"
server_key_version: "encryptionkey@0"
I20260812 00:04:24.838323 4614 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-1/wal/instance:
uuid: "5870757da61e462da82bf46ab1aa453a"
format_stamp: "Formatted at 2026-08-12 00:04:24 on dist-test-slave-f0tn"
server_key: "ddd599bae19a7be03e5bd7c70d605a05"
server_key_iv: "8c9000de5a93088a42fb3dc41300a32b"
server_key_version: "encryptionkey@0"
I20260812 00:04:24.839637 4614 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:04:24.840332 4640 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:24.840492 4614 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:04:24.840571 4614 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-1/wal
uuid: "5870757da61e462da82bf46ab1aa453a"
format_stamp: "Formatted at 2026-08-12 00:04:24 on dist-test-slave-f0tn"
server_key: "ddd599bae19a7be03e5bd7c70d605a05"
server_key_iv: "8c9000de5a93088a42fb3dc41300a32b"
server_key_version: "encryptionkey@0"
I20260812 00:04:24.840632 4614 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:04:24.852926 4614 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:04:24.854913 4614 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:04:24.855060 4614 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:04:24.855299 4614 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:04:24.855610 4614 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:04:24.855646 4614 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:24.855679 4614 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:04:24.855705 4614 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:24.861426 4614 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.66:39635
I20260812 00:04:24.861477 4842 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.66:39635 every 8 connection(s)
I20260812 00:04:24.861815 4614 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
I20260812 00:04:24.865398 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 4614
I20260812 00:04:24.865509 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-1/wal/instance
I20260812 00:04:24.865700 12089 external_mini_cluster.cc:1428] Setting key f7ffb390cbb051ca1471fded274a702f
Aug 12 00:04:24 dist-test-slave-f0tn krb5kdc[4164](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493064, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.66@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:04:24.871376 4328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:24.862503 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.66:44313 (local address 127.11.206.126:39509)
0812 00:04:24.862555 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:24.862557 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:24.862758 (+ 201us) server_negotiation.cc:407] Connection header received
0812 00:04:24.863288 (+ 530us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:24.863290 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:24.863302 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:24.863353 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:24.864328 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:24.864837 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:24.866153 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:24.866386 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:24.866446 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:24.868724 (+ 2278us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:24.868726 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:24.868726 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:04:24.868733 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:24.870074 (+ 1341us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:24.870461 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:24.870462 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:24.870462 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:24.870516 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:24.870764 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:24.870765 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:24.870766 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:24.870879 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:24.870935 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:24.871203 (+ 268us) server_negotiation.cc:299] Negotiation successful
0812 00:04:24.871284 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260812 00:04:24.871552 4846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:24.862471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:39509 (local address 127.11.206.66:44313)
0812 00:04:24.862644 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:24.862680 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:24.863190 (+ 510us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:24.863428 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:24.863432 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:24.864031 (+ 599us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:04:24.864233 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:24.864239 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:24.864922 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:24.864923 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:24.866071 (+ 1148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:24.866075 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:24.866478 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:24.866479 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:24.866615 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:24.867128 (+ 513us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:04:24.867137 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:04:24.868628 (+ 1491us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:04:24.870153 (+ 1525us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:24.870161 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:24.870164 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:24.870391 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:24.870570 (+ 179us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:24.870571 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:24.870571 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:24.870702 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:24.870933 (+ 231us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:04:24.870939 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:04:24.871079 (+ 140us) client_negotiation.cc:769] Sending connection context
0812 00:04:24.871169 (+ 90us) client_negotiation.cc:240] Negotiation successful
0812 00:04:24.871328 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":79,"threads_started":1}
I20260812 00:04:24.872074 4843 heartbeater.cc:347] Connected to a master server at 127.11.206.126:39509
I20260812 00:04:24.872175 4843 heartbeater.cc:464] Registering TS with master...
I20260812 00:04:24.872361 4843 heartbeater.cc:511] Master 127.11.206.126:39509 requested a full tablet report, sending...
I20260812 00:04:24.872776 4241 ts_manager.cc:194] Registered new tserver with Master: 5870757da61e462da82bf46ab1aa453a (127.11.206.66:39635)
I20260812 00:04:24.873279 4241 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.206.66@KRBTEST.COM'} at 127.11.206.66:44313
WARNING: no policy specified for kudu/127.11.206.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.67.keytab.
Entry for principal kudu/127.11.206.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.67.keytab.
I20260812 00:04:24.890386 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.67:0
--local_ip_for_outbound_sockets=127.11.206.67
--webserver_interface=127.11.206.67
--webserver_port=0
--tserver_master_addrs=127.11.206.126:39509
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.67.keytab
--principal=kudu/127.11.206.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:46009
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:04:24.972420 4850 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:04:24.972630 4850 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:04:24.972651 4850 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:04:24.973773 4850 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:04:24.973807 4850 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:04:24.973831 4850 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.67
I20260812 00:04:24.975286 4850 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:46009
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.67.keytab
--principal=kudu/127.11.206.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.206.67
--webserver_port=0
--tserver_master_addrs=127.11.206.126:39509
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4850
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.67
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:04:24.975478 4850 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:04:24.975656 4850 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:04:24.980522 4862 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:24.980549 4863 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:24.980716 4865 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:24.980706 4850 server_base.cc:1034] running on GCE node
I20260812 00:04:24.980931 4850 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:04:24.981166 4850 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:04:24.982304 4850 hybrid_clock.cc:648] HybridClock initialized: now 1786493064982284 us; error 35 us; skew 500 ppm
Aug 12 00:04:24 dist-test-slave-f0tn krb5kdc[4164](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493064, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:04:24.984673 4850 init.cc:377] Logged in from keytab as kudu/127.11.206.67@KRBTEST.COM (short username kudu)
I20260812 00:04:24.985102 4850 webserver.cc:460] Webserver started at http://127.11.206.67:39029/ using document root <none> and password file <none>
I20260812 00:04:24.985296 4850 fs_manager.cc:359] Metadata directory not provided
I20260812 00:04:24.985342 4850 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:04:24.985486 4850 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:04:24.986514 4850 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-2/data/instance:
uuid: "cd851d45beeb4409be68b1bebbc28ca4"
format_stamp: "Formatted at 2026-08-12 00:04:24 on dist-test-slave-f0tn"
server_key: "fb3247a3c16458cfb25b8bcfedeb3581"
server_key_iv: "3802561a17d2b387e3c8bf091e438d94"
server_key_version: "encryptionkey@0"
I20260812 00:04:24.986848 4850 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-2/wal/instance:
uuid: "cd851d45beeb4409be68b1bebbc28ca4"
format_stamp: "Formatted at 2026-08-12 00:04:24 on dist-test-slave-f0tn"
server_key: "fb3247a3c16458cfb25b8bcfedeb3581"
server_key_iv: "3802561a17d2b387e3c8bf091e438d94"
server_key_version: "encryptionkey@0"
I20260812 00:04:24.988206 4850 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:04:24.988870 4875 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:24.989037 4850 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:04:24.989145 4850 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-2/wal
uuid: "cd851d45beeb4409be68b1bebbc28ca4"
format_stamp: "Formatted at 2026-08-12 00:04:24 on dist-test-slave-f0tn"
server_key: "fb3247a3c16458cfb25b8bcfedeb3581"
server_key_iv: "3802561a17d2b387e3c8bf091e438d94"
server_key_version: "encryptionkey@0"
I20260812 00:04:24.989208 4850 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:04:25.018558 4850 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:04:25.020426 4850 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:04:25.020568 4850 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:04:25.020805 4850 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:04:25.021124 4850 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:04:25.021160 4850 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:25.021189 4850 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:04:25.021206 4850 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:25.027055 4850 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.67:35673
I20260812 00:04:25.027135 5079 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.67:35673 every 8 connection(s)
I20260812 00:04:25.027417 4850 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
Aug 12 00:04:25 dist-test-slave-f0tn krb5kdc[4164](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493064, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.67@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:04:25.035720 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 4850
I20260812 00:04:25.035826 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-2/wal/instance
I20260812 00:04:25.036064 12089 external_mini_cluster.cc:1428] Setting key d1186d89eb4e72e59871a1e5c7c11fab
I20260812 00:04:25.037487 4328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:25.028111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.67:39303 (local address 127.11.206.126:39509)
0812 00:04:25.028210 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:25.028213 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:25.028433 (+ 220us) server_negotiation.cc:407] Connection header received
0812 00:04:25.028990 (+ 557us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:25.028991 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:25.029006 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:25.029086 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:25.030190 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.030701 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.031754 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.031953 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.032011 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:25.034349 (+ 2338us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:25.034351 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:25.034351 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:04:25.034360 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:25.035945 (+ 1585us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:25.036448 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:25.036449 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:25.036450 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:25.036539 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:25.036800 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:25.036801 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:25.036802 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:25.036929 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:25.036988 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:25.037279 (+ 291us) server_negotiation.cc:299] Negotiation successful
0812 00:04:25.037371 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260812 00:04:25.037647 5082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:25.028094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:39509 (local address 127.11.206.67:39303)
0812 00:04:25.028305 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:25.028346 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:25.028887 (+ 541us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:25.029166 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:25.029171 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:25.029867 (+ 696us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:04:25.030084 (+ 217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:25.030091 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.030804 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.030806 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:25.031661 (+ 855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:25.031664 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.032037 (+ 373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.032038 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:25.032169 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:25.032726 (+ 557us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:04:25.032735 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:04:25.034243 (+ 1508us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:04:25.036041 (+ 1798us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:25.036078 (+ 37us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:25.036080 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:25.036362 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:25.036615 (+ 253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:25.036616 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:25.036616 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:25.036733 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:25.036987 (+ 254us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:04:25.036994 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:04:25.037153 (+ 159us) client_negotiation.cc:769] Sending connection context
0812 00:04:25.037244 (+ 91us) client_negotiation.cc:240] Negotiation successful
0812 00:04:25.037423 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":90,"threads_started":1}
I20260812 00:04:25.038087 5080 heartbeater.cc:347] Connected to a master server at 127.11.206.126:39509
I20260812 00:04:25.038199 5080 heartbeater.cc:464] Registering TS with master...
I20260812 00:04:25.038390 5080 heartbeater.cc:511] Master 127.11.206.126:39509 requested a full tablet report, sending...
I20260812 00:04:25.038738 4241 ts_manager.cc:194] Registered new tserver with Master: cd851d45beeb4409be68b1bebbc28ca4 (127.11.206.67:35673)
I20260812 00:04:25.039080 4241 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.206.67@KRBTEST.COM'} at 127.11.206.67:39303
I20260812 00:04:25.047940 12089 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:04:25.054924 4328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:25.049260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59934 (local address 127.11.206.126:39509)
0812 00:04:25.049302 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:25.049305 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:25.049443 (+ 138us) server_negotiation.cc:407] Connection header received
0812 00:04:25.049522 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:25.049523 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:25.049534 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:25.049586 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:25.050182 (+ 596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.050662 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.051382 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.051568 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.051622 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:25.052754 (+ 1132us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:25.052755 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:25.052755 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:04:25.052762 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:25.053836 (+ 1074us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:25.054154 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:25.054156 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:25.054156 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:25.054215 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:25.054377 (+ 162us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:25.054378 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:25.054378 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:25.054527 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:25.054622 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:25.054731 (+ 109us) server_negotiation.cc:299] Negotiation successful
0812 00:04:25.054824 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 00:04:25.056531 4241 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59934:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:04:25.058188 4241 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:04:25.064457 5097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:25.060619 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.67:35673 (local address 127.0.0.1:56432)
0812 00:04:25.060954 (+ 335us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:25.060963 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:25.061007 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:25.061279 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:25.061280 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:25.061283 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:04:25.061349 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:25.061351 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.062254 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.062255 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:25.063387 (+ 1132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:25.063390 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.064153 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.064154 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:25.064242 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:25.064257 (+ 15us) client_negotiation.cc:769] Sending connection context
0812 00:04:25.064324 (+ 67us) client_negotiation.cc:240] Negotiation successful
0812 00:04:25.064380 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":324,"thread_start_us":76,"threads_started":1}
I20260812 00:04:25.064469 5107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:25.060748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56432 (local address 127.11.206.67:35673)
0812 00:04:25.060894 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:25.060898 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:25.061062 (+ 164us) server_negotiation.cc:407] Connection header received
0812 00:04:25.061108 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:25.061111 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:25.061127 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:25.061195 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:04:25.061462 (+ 267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.062156 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.063475 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.064079 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.064150 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:25.064216 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:25.064345 (+ 129us) server_negotiation.cc:299] Negotiation successful
0812 00:04:25.064389 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":87,"threads_started":1}
I20260812 00:04:25.064749 5100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:25.060406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.65:39207 (local address 127.0.0.1:45330)
0812 00:04:25.060564 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:25.060604 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:25.060670 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:25.061193 (+ 523us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:25.061196 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:25.061199 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:04:25.061270 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:25.061272 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.062674 (+ 1402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.062675 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:25.063666 (+ 991us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:25.063668 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.064535 (+ 867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.064536 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:25.064606 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:25.064611 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 00:04:25.064639 (+ 28us) client_negotiation.cc:240] Negotiation successful
0812 00:04:25.064678 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"mutex_wait_us":24,"thread_start_us":57,"threads_started":1}
I20260812 00:04:25.065073 5108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:25.060792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45330 (local address 127.11.206.65:39207)
0812 00:04:25.060965 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:25.060969 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:25.060978 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:04:25.061020 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:25.061022 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:25.061040 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:25.061346 (+ 306us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:04:25.061465 (+ 119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.062564 (+ 1099us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.063750 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.064446 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.064866 (+ 420us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:25.064924 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:25.064948 (+ 24us) server_negotiation.cc:299] Negotiation successful
0812 00:04:25.064992 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":81,"threads_started":1}
I20260812 00:04:25.065191 5103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:25.060409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.66:39635 (local address 127.0.0.1:44446)
0812 00:04:25.060925 (+ 516us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:25.060936 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:25.061001 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:25.061242 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:25.061243 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:25.061245 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:04:25.061285 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:25.061287 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.062693 (+ 1406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.062694 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:25.063604 (+ 910us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:25.063606 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.064930 (+ 1324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.064932 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:25.064992 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:25.064996 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:04:25.065052 (+ 56us) client_negotiation.cc:240] Negotiation successful
0812 00:04:25.065088 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":494,"thread_start_us":101,"threads_started":1}
I20260812 00:04:25.065267 4968 tablet_service.cc:1467] Processing CreateTablet for tablet 4060d0f9c72d4bf192a10d72e577fa8c (DEFAULT_TABLE table=test-table [id=3772b29835ee43e6971b6808081846bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:04:25.065555 5102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:25.060524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44446 (local address 127.11.206.66:39635)
0812 00:04:25.060790 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:25.060795 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:25.061007 (+ 212us) server_negotiation.cc:407] Connection header received
0812 00:04:25.061074 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:25.061076 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:25.061089 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:25.061161 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:04:25.061363 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.062564 (+ 1201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.063719 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.064432 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.064505 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:25.064893 (+ 388us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:25.065085 (+ 192us) server_negotiation.cc:299] Negotiation successful
0812 00:04:25.065272 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":229,"thread_start_us":81,"threads_started":1}
I20260812 00:04:25.065719 4968 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4060d0f9c72d4bf192a10d72e577fa8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:04:25.066210 4718 tablet_service.cc:1467] Processing CreateTablet for tablet 4060d0f9c72d4bf192a10d72e577fa8c (DEFAULT_TABLE table=test-table [id=3772b29835ee43e6971b6808081846bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:04:25.066545 4718 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4060d0f9c72d4bf192a10d72e577fa8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:04:25.069095 5109 tablet_bootstrap.cc:492] T 4060d0f9c72d4bf192a10d72e577fa8c P cd851d45beeb4409be68b1bebbc28ca4: Bootstrap starting.
I20260812 00:04:25.069753 5111 tablet_bootstrap.cc:492] T 4060d0f9c72d4bf192a10d72e577fa8c P 5870757da61e462da82bf46ab1aa453a: Bootstrap starting.
I20260812 00:04:25.069828 5109 tablet_bootstrap.cc:654] T 4060d0f9c72d4bf192a10d72e577fa8c P cd851d45beeb4409be68b1bebbc28ca4: Neither blocks nor log segments found. Creating new log.
I20260812 00:04:25.069772 4493 tablet_service.cc:1467] Processing CreateTablet for tablet 4060d0f9c72d4bf192a10d72e577fa8c (DEFAULT_TABLE table=test-table [id=3772b29835ee43e6971b6808081846bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:04:25.070101 4493 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4060d0f9c72d4bf192a10d72e577fa8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:04:25.070420 5109 log.cc:824] T 4060d0f9c72d4bf192a10d72e577fa8c P cd851d45beeb4409be68b1bebbc28ca4: Log is configured to *not* fsync() on all Append() calls
I20260812 00:04:25.070518 5111 tablet_bootstrap.cc:654] T 4060d0f9c72d4bf192a10d72e577fa8c P 5870757da61e462da82bf46ab1aa453a: Neither blocks nor log segments found. Creating new log.
I20260812 00:04:25.070987 5111 log.cc:824] T 4060d0f9c72d4bf192a10d72e577fa8c P 5870757da61e462da82bf46ab1aa453a: Log is configured to *not* fsync() on all Append() calls
I20260812 00:04:25.071238 5109 tablet_bootstrap.cc:492] T 4060d0f9c72d4bf192a10d72e577fa8c P cd851d45beeb4409be68b1bebbc28ca4: No bootstrap required, opened a new log
I20260812 00:04:25.071310 5109 ts_tablet_manager.cc:1397] T 4060d0f9c72d4bf192a10d72e577fa8c P cd851d45beeb4409be68b1bebbc28ca4: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260812 00:04:25.071763 5111 tablet_bootstrap.cc:492] T 4060d0f9c72d4bf192a10d72e577fa8c P 5870757da61e462da82bf46ab1aa453a: No bootstrap required, opened a new log
I20260812 00:04:25.071884 5111 ts_tablet_manager.cc:1397] T 4060d0f9c72d4bf192a10d72e577fa8c P 5870757da61e462da82bf46ab1aa453a: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 00:04:25.072911 5114 tablet_bootstrap.cc:492] T 4060d0f9c72d4bf192a10d72e577fa8c P 8bf8ca15e8a3411cae50308f35fdb5f9: Bootstrap starting.
I20260812 00:04:25.073235 5109 raft_consensus.cc:348] T 4060d0f9c72d4bf192a10d72e577fa8c P cd851d45beeb4409be68b1bebbc28ca4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5870757da61e462da82bf46ab1aa453a" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 39635 } } peers { permanent_uuid: "8bf8ca15e8a3411cae50308f35fdb5f9" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 39207 } } peers { permanent_uuid: "cd851d45beeb4409be68b1bebbc28ca4" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 35673 } }
I20260812 00:04:25.073438 5109 raft_consensus.cc:374] T 4060d0f9c72d4bf192a10d72e577fa8c P cd851d45beeb4409be68b1bebbc28ca4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:04:25.073485 5109 raft_consensus.cc:729] T 4060d0f9c72d4bf192a10d72e577fa8c P cd851d45beeb4409be68b1bebbc28ca4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd851d45beeb4409be68b1bebbc28ca4, State: Initialized, Role: FOLLOWER
I20260812 00:04:25.073539 5114 tablet_bootstrap.cc:654] T 4060d0f9c72d4bf192a10d72e577fa8c P 8bf8ca15e8a3411cae50308f35fdb5f9: Neither blocks nor log segments found. Creating new log.
I20260812 00:04:25.073601 5109 consensus_queue.cc:260] T 4060d0f9c72d4bf192a10d72e577fa8c P cd851d45beeb4409be68b1bebbc28ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5870757da61e462da82bf46ab1aa453a" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 39635 } } peers { permanent_uuid: "8bf8ca15e8a3411cae50308f35fdb5f9" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 39207 } } peers { permanent_uuid: "cd851d45beeb4409be68b1bebbc28ca4" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 35673 } }
I20260812 00:04:25.073907 5109 ts_tablet_manager.cc:1428] T 4060d0f9c72d4bf192a10d72e577fa8c P cd851d45beeb4409be68b1bebbc28ca4: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260812 00:04:25.073835 5111 raft_consensus.cc:348] T 4060d0f9c72d4bf192a10d72e577fa8c P 5870757da61e462da82bf46ab1aa453a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5870757da61e462da82bf46ab1aa453a" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 39635 } } peers { permanent_uuid: "8bf8ca15e8a3411cae50308f35fdb5f9" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 39207 } } peers { permanent_uuid: "cd851d45beeb4409be68b1bebbc28ca4" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 35673 } }
I20260812 00:04:25.073982 5111 raft_consensus.cc:374] T 4060d0f9c72d4bf192a10d72e577fa8c P 5870757da61e462da82bf46ab1aa453a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:04:25.074025 5080 heartbeater.cc:503] Master 127.11.206.126:39509 was elected leader, sending a full tablet report...
I20260812 00:04:25.074025 5111 raft_consensus.cc:729] T 4060d0f9c72d4bf192a10d72e577fa8c P 5870757da61e462da82bf46ab1aa453a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5870757da61e462da82bf46ab1aa453a, State: Initialized, Role: FOLLOWER
I20260812 00:04:25.074074 5114 log.cc:824] T 4060d0f9c72d4bf192a10d72e577fa8c P 8bf8ca15e8a3411cae50308f35fdb5f9: Log is configured to *not* fsync() on all Append() calls
I20260812 00:04:25.074200 5111 consensus_queue.cc:260] T 4060d0f9c72d4bf192a10d72e577fa8c P 5870757da61e462da82bf46ab1aa453a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5870757da61e462da82bf46ab1aa453a" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 39635 } } peers { permanent_uuid: "8bf8ca15e8a3411cae50308f35fdb5f9" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 39207 } } peers { permanent_uuid: "cd851d45beeb4409be68b1bebbc28ca4" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 35673 } }
I20260812 00:04:25.074541 5111 ts_tablet_manager.cc:1428] T 4060d0f9c72d4bf192a10d72e577fa8c P 5870757da61e462da82bf46ab1aa453a: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 00:04:25.074707 4843 heartbeater.cc:503] Master 127.11.206.126:39509 was elected leader, sending a full tablet report...
I20260812 00:04:25.075037 5114 tablet_bootstrap.cc:492] T 4060d0f9c72d4bf192a10d72e577fa8c P 8bf8ca15e8a3411cae50308f35fdb5f9: No bootstrap required, opened a new log
I20260812 00:04:25.075103 5114 ts_tablet_manager.cc:1397] T 4060d0f9c72d4bf192a10d72e577fa8c P 8bf8ca15e8a3411cae50308f35fdb5f9: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 00:04:25.076606 5114 raft_consensus.cc:348] T 4060d0f9c72d4bf192a10d72e577fa8c P 8bf8ca15e8a3411cae50308f35fdb5f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5870757da61e462da82bf46ab1aa453a" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 39635 } } peers { permanent_uuid: "8bf8ca15e8a3411cae50308f35fdb5f9" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 39207 } } peers { permanent_uuid: "cd851d45beeb4409be68b1bebbc28ca4" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 35673 } }
I20260812 00:04:25.076733 5114 raft_consensus.cc:374] T 4060d0f9c72d4bf192a10d72e577fa8c P 8bf8ca15e8a3411cae50308f35fdb5f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:04:25.076766 5114 raft_consensus.cc:729] T 4060d0f9c72d4bf192a10d72e577fa8c P 8bf8ca15e8a3411cae50308f35fdb5f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bf8ca15e8a3411cae50308f35fdb5f9, State: Initialized, Role: FOLLOWER
I20260812 00:04:25.076874 5114 consensus_queue.cc:260] T 4060d0f9c72d4bf192a10d72e577fa8c P 8bf8ca15e8a3411cae50308f35fdb5f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5870757da61e462da82bf46ab1aa453a" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 39635 } } peers { permanent_uuid: "8bf8ca15e8a3411cae50308f35fdb5f9" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 39207 } } peers { permanent_uuid: "cd851d45beeb4409be68b1bebbc28ca4" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 35673 } }
I20260812 00:04:25.077129 5114 ts_tablet_manager.cc:1428] T 4060d0f9c72d4bf192a10d72e577fa8c P 8bf8ca15e8a3411cae50308f35fdb5f9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 00:04:25.077198 4608 heartbeater.cc:503] Master 127.11.206.126:39509 was elected leader, sending a full tablet report...
W20260812 00:04:25.112385 4845 tablet.cc:2369] T 4060d0f9c72d4bf192a10d72e577fa8c P 5870757da61e462da82bf46ab1aa453a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 00:04:25.210000 4610 tablet.cc:2369] T 4060d0f9c72d4bf192a10d72e577fa8c P 8bf8ca15e8a3411cae50308f35fdb5f9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:04:25.241565 5118 raft_consensus.cc:482] T 4060d0f9c72d4bf192a10d72e577fa8c P 8bf8ca15e8a3411cae50308f35fdb5f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:04:25.241703 5118 raft_consensus.cc:504] T 4060d0f9c72d4bf192a10d72e577fa8c P 8bf8ca15e8a3411cae50308f35fdb5f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5870757da61e462da82bf46ab1aa453a" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 39635 } } peers { permanent_uuid: "8bf8ca15e8a3411cae50308f35fdb5f9" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 39207 } } peers { permanent_uuid: "cd851d45beeb4409be68b1bebbc28ca4" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 35673 } }
I20260812 00:04:25.242035 5118 leader_election.cc:288] T 4060d0f9c72d4bf192a10d72e577fa8c P 8bf8ca15e8a3411cae50308f35fdb5f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5870757da61e462da82bf46ab1aa453a (127.11.206.66:39635), cd851d45beeb4409be68b1bebbc28ca4 (127.11.206.67:35673)
I20260812 00:04:25.245043 5107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:25.242507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.65:53901 (local address 127.11.206.67:35673)
0812 00:04:25.242565 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:25.242567 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:25.242576 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:04:25.242602 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:25.242602 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:25.242611 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:25.242659 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:04:25.242823 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.243296 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.244324 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.244731 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.244800 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:25.244809 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:25.244940 (+ 131us) server_negotiation.cc:299] Negotiation successful
0812 00:04:25.244975 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260812 00:04:25.245055 5123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:25.242411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.67:35673 (local address 127.11.206.65:53901)
0812 00:04:25.242505 (+ 94us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:25.242513 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:25.242549 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:25.242668 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:25.242669 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:25.242671 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:04:25.242743 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:25.242744 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.243368 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.243369 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:25.244244 (+ 875us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:25.244247 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.244800 (+ 553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.244801 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:25.244876 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:25.244881 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 00:04:25.244927 (+ 46us) client_negotiation.cc:240] Negotiation successful
0812 00:04:25.244968 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":85,"thread_start_us":59,"threads_started":1}
I20260812 00:04:25.245117 5102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:25.242298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.65:58831 (local address 127.11.206.66:39635)
0812 00:04:25.242353 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:25.242355 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:25.242385 (+ 30us) server_negotiation.cc:407] Connection header received
0812 00:04:25.242466 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:25.242467 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:25.242480 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:25.242552 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:04:25.242720 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.243270 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.244356 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.244803 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.244867 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:25.244876 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:25.245013 (+ 137us) server_negotiation.cc:299] Negotiation successful
0812 00:04:25.245052 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260812 00:04:25.245150 5119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:25.242201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.66:39635 (local address 127.11.206.65:58831)
0812 00:04:25.242329 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:25.242340 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:25.242402 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:25.242577 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:25.242578 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:25.242581 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:04:25.242653 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:25.242655 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.243353 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.243354 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:25.244279 (+ 925us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:25.244282 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.244882 (+ 600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.244883 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:25.244949 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:25.244953 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:04:25.244999 (+ 46us) client_negotiation.cc:240] Negotiation successful
0812 00:04:25.245038 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":74,"threads_started":1}
I20260812 00:04:25.245764 4764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4060d0f9c72d4bf192a10d72e577fa8c" candidate_uuid: "8bf8ca15e8a3411cae50308f35fdb5f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5870757da61e462da82bf46ab1aa453a" is_pre_election: true
I20260812 00:04:25.245802 4999 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4060d0f9c72d4bf192a10d72e577fa8c" candidate_uuid: "8bf8ca15e8a3411cae50308f35fdb5f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd851d45beeb4409be68b1bebbc28ca4" is_pre_election: true
I20260812 00:04:25.245955 4999 raft_consensus.cc:2454] T 4060d0f9c72d4bf192a10d72e577fa8c P cd851d45beeb4409be68b1bebbc28ca4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8bf8ca15e8a3411cae50308f35fdb5f9 in term 0.
I20260812 00:04:25.245955 4764 raft_consensus.cc:2454] T 4060d0f9c72d4bf192a10d72e577fa8c P 5870757da61e462da82bf46ab1aa453a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8bf8ca15e8a3411cae50308f35fdb5f9 in term 0.
I20260812 00:04:25.246186 4400 leader_election.cc:302] T 4060d0f9c72d4bf192a10d72e577fa8c P 8bf8ca15e8a3411cae50308f35fdb5f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8bf8ca15e8a3411cae50308f35fdb5f9, cd851d45beeb4409be68b1bebbc28ca4; no voters:
I20260812 00:04:25.246330 5118 raft_consensus.cc:2781] T 4060d0f9c72d4bf192a10d72e577fa8c P 8bf8ca15e8a3411cae50308f35fdb5f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:04:25.246394 5118 raft_consensus.cc:482] T 4060d0f9c72d4bf192a10d72e577fa8c P 8bf8ca15e8a3411cae50308f35fdb5f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:04:25.246419 5118 raft_consensus.cc:3037] T 4060d0f9c72d4bf192a10d72e577fa8c P 8bf8ca15e8a3411cae50308f35fdb5f9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:04:25.247179 5118 raft_consensus.cc:504] T 4060d0f9c72d4bf192a10d72e577fa8c P 8bf8ca15e8a3411cae50308f35fdb5f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5870757da61e462da82bf46ab1aa453a" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 39635 } } peers { permanent_uuid: "8bf8ca15e8a3411cae50308f35fdb5f9" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 39207 } } peers { permanent_uuid: "cd851d45beeb4409be68b1bebbc28ca4" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 35673 } }
I20260812 00:04:25.247305 5118 leader_election.cc:288] T 4060d0f9c72d4bf192a10d72e577fa8c P 8bf8ca15e8a3411cae50308f35fdb5f9 [CANDIDATE]: Term 1 election: Requested vote from peers 5870757da61e462da82bf46ab1aa453a (127.11.206.66:39635), cd851d45beeb4409be68b1bebbc28ca4 (127.11.206.67:35673)
I20260812 00:04:25.247483 4999 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4060d0f9c72d4bf192a10d72e577fa8c" candidate_uuid: "8bf8ca15e8a3411cae50308f35fdb5f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd851d45beeb4409be68b1bebbc28ca4"
I20260812 00:04:25.247493 4764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4060d0f9c72d4bf192a10d72e577fa8c" candidate_uuid: "8bf8ca15e8a3411cae50308f35fdb5f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5870757da61e462da82bf46ab1aa453a"
I20260812 00:04:25.247572 4764 raft_consensus.cc:3037] T 4060d0f9c72d4bf192a10d72e577fa8c P 5870757da61e462da82bf46ab1aa453a [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:04:25.247572 4999 raft_consensus.cc:3037] T 4060d0f9c72d4bf192a10d72e577fa8c P cd851d45beeb4409be68b1bebbc28ca4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:04:25.248510 4999 raft_consensus.cc:2454] T 4060d0f9c72d4bf192a10d72e577fa8c P cd851d45beeb4409be68b1bebbc28ca4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8bf8ca15e8a3411cae50308f35fdb5f9 in term 1.
I20260812 00:04:25.248510 4764 raft_consensus.cc:2454] T 4060d0f9c72d4bf192a10d72e577fa8c P 5870757da61e462da82bf46ab1aa453a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8bf8ca15e8a3411cae50308f35fdb5f9 in term 1.
I20260812 00:04:25.248677 4400 leader_election.cc:302] T 4060d0f9c72d4bf192a10d72e577fa8c P 8bf8ca15e8a3411cae50308f35fdb5f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8bf8ca15e8a3411cae50308f35fdb5f9, cd851d45beeb4409be68b1bebbc28ca4; no voters:
I20260812 00:04:25.248764 5118 raft_consensus.cc:2781] T 4060d0f9c72d4bf192a10d72e577fa8c P 8bf8ca15e8a3411cae50308f35fdb5f9 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:04:25.248906 5118 raft_consensus.cc:686] T 4060d0f9c72d4bf192a10d72e577fa8c P 8bf8ca15e8a3411cae50308f35fdb5f9 [term 1 LEADER]: Becoming Leader. State: Replica: 8bf8ca15e8a3411cae50308f35fdb5f9, State: Running, Role: LEADER
I20260812 00:04:25.249089 5118 consensus_queue.cc:237] T 4060d0f9c72d4bf192a10d72e577fa8c P 8bf8ca15e8a3411cae50308f35fdb5f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5870757da61e462da82bf46ab1aa453a" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 39635 } } peers { permanent_uuid: "8bf8ca15e8a3411cae50308f35fdb5f9" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 39207 } } peers { permanent_uuid: "cd851d45beeb4409be68b1bebbc28ca4" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 35673 } }
I20260812 00:04:25.249974 4241 catalog_manager.cc:5495] T 4060d0f9c72d4bf192a10d72e577fa8c P 8bf8ca15e8a3411cae50308f35fdb5f9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8bf8ca15e8a3411cae50308f35fdb5f9 (127.11.206.65). New cstate: current_term: 1 leader_uuid: "8bf8ca15e8a3411cae50308f35fdb5f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5870757da61e462da82bf46ab1aa453a" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8bf8ca15e8a3411cae50308f35fdb5f9" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 39207 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd851d45beeb4409be68b1bebbc28ca4" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 35673 } health_report { overall_health: UNKNOWN } } }
W20260812 00:04:25.278024 5081 tablet.cc:2369] T 4060d0f9c72d4bf192a10d72e577fa8c P cd851d45beeb4409be68b1bebbc28ca4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:04:25.289861 5108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:25.287730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45340 (local address 127.11.206.65:39207)
0812 00:04:25.287786 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:25.287787 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:25.287795 (+ 8us) server_negotiation.cc:407] Connection header received
0812 00:04:25.287833 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:25.287833 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:25.287854 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:25.287913 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:04:25.288013 (+ 100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.288478 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.289175 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.289396 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.289446 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:25.289589 (+ 143us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:04:25.289699 (+ 110us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:04:25.289759 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:25.289773 (+ 14us) server_negotiation.cc:299] Negotiation successful
0812 00:04:25.289790 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260812 00:04:25.291965 4764 raft_consensus.cc:1261] T 4060d0f9c72d4bf192a10d72e577fa8c P 5870757da61e462da82bf46ab1aa453a [term 1 FOLLOWER]: Refusing update from remote peer 8bf8ca15e8a3411cae50308f35fdb5f9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:04:25.291972 4999 raft_consensus.cc:1261] T 4060d0f9c72d4bf192a10d72e577fa8c P cd851d45beeb4409be68b1bebbc28ca4 [term 1 FOLLOWER]: Refusing update from remote peer 8bf8ca15e8a3411cae50308f35fdb5f9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:04:25.292309 5118 consensus_queue.cc:1035] T 4060d0f9c72d4bf192a10d72e577fa8c P 8bf8ca15e8a3411cae50308f35fdb5f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd851d45beeb4409be68b1bebbc28ca4" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 35673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:04:25.292448 5127 consensus_queue.cc:1035] T 4060d0f9c72d4bf192a10d72e577fa8c P 8bf8ca15e8a3411cae50308f35fdb5f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5870757da61e462da82bf46ab1aa453a" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:04:25.295467 5139 mvcc.cc:205] Tried to move back new op lower bound from 7317475595433021440 to 7317475595261009920. Current Snapshot: MvccSnapshot[applied={T|T < 7317475595433021440 or (T in {7317475595433021440})}]
I20260812 00:04:25.296686 4240 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59934:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:04:25.296787 4240 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59934:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:04:25.297523 4240 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1659d7b29a0f4e7f8272846248919213: Sending DeleteTablet for 3 replicas of tablet 4060d0f9c72d4bf192a10d72e577fa8c
I20260812 00:04:25.297829 4718 tablet_service.cc:1514] Processing DeleteTablet for tablet 4060d0f9c72d4bf192a10d72e577fa8c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:04:25 UTC) from {username='kudu', principal='kudu/127.11.206.126@KRBTEST.COM'} at 127.0.0.1:44446
I20260812 00:04:25.297847 4493 tablet_service.cc:1514] Processing DeleteTablet for tablet 4060d0f9c72d4bf192a10d72e577fa8c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:04:25 UTC) from {username='kudu', principal='kudu/127.11.206.126@KRBTEST.COM'} at 127.0.0.1:45330
I20260812 00:04:25.297865 4968 tablet_service.cc:1514] Processing DeleteTablet for tablet 4060d0f9c72d4bf192a10d72e577fa8c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:04:25 UTC) from {username='kudu', principal='kudu/127.11.206.126@KRBTEST.COM'} at 127.0.0.1:56432
I20260812 00:04:25.298061 5155 tablet_replica.cc:330] T 4060d0f9c72d4bf192a10d72e577fa8c P 8bf8ca15e8a3411cae50308f35fdb5f9: stopping tablet replica
I20260812 00:04:25.298112 5153 tablet_replica.cc:330] T 4060d0f9c72d4bf192a10d72e577fa8c P 5870757da61e462da82bf46ab1aa453a: stopping tablet replica
I20260812 00:04:25.298156 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 4366
I20260812 00:04:25.298182 5155 raft_consensus.cc:2229] T 4060d0f9c72d4bf192a10d72e577fa8c P 8bf8ca15e8a3411cae50308f35fdb5f9 [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:04:25.298240 5154 tablet_replica.cc:330] T 4060d0f9c72d4bf192a10d72e577fa8c P cd851d45beeb4409be68b1bebbc28ca4: stopping tablet replica
I20260812 00:04:25.298269 5155 raft_consensus.cc:2258] T 4060d0f9c72d4bf192a10d72e577fa8c P 8bf8ca15e8a3411cae50308f35fdb5f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:04:25.298324 5154 raft_consensus.cc:2229] T 4060d0f9c72d4bf192a10d72e577fa8c P cd851d45beeb4409be68b1bebbc28ca4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:04:25.298408 5154 raft_consensus.cc:2258] T 4060d0f9c72d4bf192a10d72e577fa8c P cd851d45beeb4409be68b1bebbc28ca4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:04:25.298528 5153 raft_consensus.cc:2229] T 4060d0f9c72d4bf192a10d72e577fa8c P 5870757da61e462da82bf46ab1aa453a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:04:25.298611 5153 raft_consensus.cc:2258] T 4060d0f9c72d4bf192a10d72e577fa8c P 5870757da61e462da82bf46ab1aa453a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:04:25.306028 5153 ts_tablet_manager.cc:1905] T 4060d0f9c72d4bf192a10d72e577fa8c P 5870757da61e462da82bf46ab1aa453a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:04:25.307087 5154 ts_tablet_manager.cc:1905] T 4060d0f9c72d4bf192a10d72e577fa8c P cd851d45beeb4409be68b1bebbc28ca4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:04:25.307565 5153 ts_tablet_manager.cc:1918] T 4060d0f9c72d4bf192a10d72e577fa8c P 5870757da61e462da82bf46ab1aa453a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:04:25.307629 5153 log.cc:1196] T 4060d0f9c72d4bf192a10d72e577fa8c P 5870757da61e462da82bf46ab1aa453a: Deleting WAL directory at /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-1/wal/wals/4060d0f9c72d4bf192a10d72e577fa8c
I20260812 00:04:25.307838 5153 ts_tablet_manager.cc:1939] T 4060d0f9c72d4bf192a10d72e577fa8c P 5870757da61e462da82bf46ab1aa453a: Deleting consensus metadata
I20260812 00:04:25.308288 4217 catalog_manager.cc:4841] TS 5870757da61e462da82bf46ab1aa453a (127.11.206.66:39635): tablet 4060d0f9c72d4bf192a10d72e577fa8c (table test-table [id=3772b29835ee43e6971b6808081846bc]) successfully deleted
I20260812 00:04:25.308849 5154 ts_tablet_manager.cc:1918] T 4060d0f9c72d4bf192a10d72e577fa8c P cd851d45beeb4409be68b1bebbc28ca4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:04:25.308907 5154 log.cc:1196] T 4060d0f9c72d4bf192a10d72e577fa8c P cd851d45beeb4409be68b1bebbc28ca4: Deleting WAL directory at /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-2/wal/wals/4060d0f9c72d4bf192a10d72e577fa8c
I20260812 00:04:25.309104 5154 ts_tablet_manager.cc:1939] T 4060d0f9c72d4bf192a10d72e577fa8c P cd851d45beeb4409be68b1bebbc28ca4: Deleting consensus metadata
I20260812 00:04:25.310297 4217 catalog_manager.cc:4841] TS cd851d45beeb4409be68b1bebbc28ca4 (127.11.206.67:35673): tablet 4060d0f9c72d4bf192a10d72e577fa8c (table test-table [id=3772b29835ee43e6971b6808081846bc]) successfully deleted
W20260812 00:04:25.314110 4219 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.206.65:39207 (error 108)
I20260812 00:04:25.314296 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 4614
I20260812 00:04:25.317866 5103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:25.317699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.65:39207 (local address 127.0.0.1:45352)
0812 00:04:25.317772 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:25.317827 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.65:39207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260812 00:04:25.320792 4219 catalog_manager.cc:4584] TS 8bf8ca15e8a3411cae50308f35fdb5f9 (127.11.206.65:39207): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4060d0f9c72d4bf192a10d72e577fa8c: Network error: Client connection negotiation failed: client connection to 127.11.206.65:39207: connect: Connection refused (error 111)
I20260812 00:04:25.324323 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 4850
I20260812 00:04:25.335562 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 4188
I20260812 00:04:25.346864 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:39509
--webserver_interface=127.11.206.126
--webserver_port=44489
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab
--principal=kudu/127.11.206.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:46009
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.206.126:39509
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:04:25.428539 5157 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:04:25.428763 5157 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:04:25.428794 5157 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:04:25.429977 5157 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:04:25.430017 5157 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:04:25.430035 5157 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:04:25.430051 5157 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:04:25.430066 5157 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:04:25.431634 5157 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:46009
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.11.206.126:39509
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab
--principal=kudu/127.11.206.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:39509
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.206.126
--webserver_port=44489
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5157
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:04:25.431883 5157 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:04:25.432096 5157 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:04:25.441324 5171 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:25.441366 5169 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:25.441354 5166 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:25.441557 5157 server_base.cc:1034] running on GCE node
I20260812 00:04:25.441835 5157 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:04:25.442157 5157 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:04:25.443311 5157 hybrid_clock.cc:648] HybridClock initialized: now 1786493065443295 us; error 30 us; skew 500 ppm
Aug 12 00:04:25 dist-test-slave-f0tn krb5kdc[4164](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493065, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:04:25.446018 5157 init.cc:377] Logged in from keytab as kudu/127.11.206.126@KRBTEST.COM (short username kudu)
I20260812 00:04:25.446442 5157 webserver.cc:460] Webserver started at http://127.11.206.126:44489/ using document root <none> and password file <none>
I20260812 00:04:25.446669 5157 fs_manager.cc:359] Metadata directory not provided
I20260812 00:04:25.446735 5157 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:04:25.448139 5157 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:04:25.448794 5182 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:25.448952 5157 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:25.449046 5157 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/master-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/master-0/wal
uuid: "1659d7b29a0f4e7f8272846248919213"
format_stamp: "Formatted at 2026-08-12 00:04:24 on dist-test-slave-f0tn"
server_key: "bcea93e1a1422ea8f5fb0807dbb0923f"
server_key_iv: "bd079881b7a9ac2e8c43045bd2dfad9f"
server_key_version: "encryptionkey@0"
I20260812 00:04:25.449501 5157 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:04:25.464635 5157 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:04:25.466660 5157 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:04:25.466791 5157 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:04:25.470654 5157 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.126:39509
I20260812 00:04:25.470701 5276 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.126:39509 every 8 connection(s)
I20260812 00:04:25.471057 5157 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
I20260812 00:04:25.471776 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 5157
I20260812 00:04:25.472116 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.65:39207
--local_ip_for_outbound_sockets=127.11.206.65
--tserver_master_addrs=127.11.206.126:39509
--webserver_port=41705
--webserver_interface=127.11.206.65
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.65.keytab
--principal=kudu/127.11.206.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:46009
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:04:25.473351 5277 sys_catalog.cc:263] Verifying existing consensus state
I20260812 00:04:25.474217 5277 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1659d7b29a0f4e7f8272846248919213: Bootstrap starting.
I20260812 00:04:25.482527 5277 log.cc:824] T 00000000000000000000000000000000 P 1659d7b29a0f4e7f8272846248919213: Log is configured to *not* fsync() on all Append() calls
I20260812 00:04:25.484715 5277 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1659d7b29a0f4e7f8272846248919213: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 00:04:25.485071 5277 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1659d7b29a0f4e7f8272846248919213: Bootstrap complete.
I20260812 00:04:25.487344 5277 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1659d7b29a0f4e7f8272846248919213 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1659d7b29a0f4e7f8272846248919213" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 39509 } }
I20260812 00:04:25.487594 5277 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1659d7b29a0f4e7f8272846248919213 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1659d7b29a0f4e7f8272846248919213, State: Initialized, Role: FOLLOWER
I20260812 00:04:25.487751 5277 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1659d7b29a0f4e7f8272846248919213 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1659d7b29a0f4e7f8272846248919213" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 39509 } }
I20260812 00:04:25.487818 5277 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1659d7b29a0f4e7f8272846248919213 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:04:25.487856 5277 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1659d7b29a0f4e7f8272846248919213 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:04:25.487910 5277 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1659d7b29a0f4e7f8272846248919213 [term 1 FOLLOWER]: Advancing to term 2
I20260812 00:04:25.488997 5277 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1659d7b29a0f4e7f8272846248919213 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1659d7b29a0f4e7f8272846248919213" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 39509 } }
I20260812 00:04:25.489116 5277 leader_election.cc:302] T 00000000000000000000000000000000 P 1659d7b29a0f4e7f8272846248919213 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1659d7b29a0f4e7f8272846248919213; no voters:
I20260812 00:04:25.489300 5277 leader_election.cc:288] T 00000000000000000000000000000000 P 1659d7b29a0f4e7f8272846248919213 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260812 00:04:25.489353 5284 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1659d7b29a0f4e7f8272846248919213 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 00:04:25.489542 5284 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1659d7b29a0f4e7f8272846248919213 [term 2 LEADER]: Becoming Leader. State: Replica: 1659d7b29a0f4e7f8272846248919213, State: Running, Role: LEADER
I20260812 00:04:25.489629 5277 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1659d7b29a0f4e7f8272846248919213 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:04:25.489725 5284 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1659d7b29a0f4e7f8272846248919213 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1659d7b29a0f4e7f8272846248919213" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 39509 } }
I20260812 00:04:25.490062 5287 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1659d7b29a0f4e7f8272846248919213 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "1659d7b29a0f4e7f8272846248919213" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1659d7b29a0f4e7f8272846248919213" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 39509 } } }
I20260812 00:04:25.490103 5284 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1659d7b29a0f4e7f8272846248919213 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1659d7b29a0f4e7f8272846248919213. Latest consensus state: current_term: 2 leader_uuid: "1659d7b29a0f4e7f8272846248919213" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1659d7b29a0f4e7f8272846248919213" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 39509 } } }
I20260812 00:04:25.490196 5284 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1659d7b29a0f4e7f8272846248919213 [sys.catalog]: This master's current role is: LEADER
I20260812 00:04:25.490151 5287 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1659d7b29a0f4e7f8272846248919213 [sys.catalog]: This master's current role is: LEADER
I20260812 00:04:25.490821 5299 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:04:25.491602 5299 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:04:25.491711 5299 catalog_manager.cc:1259] Loaded cluster ID: 9afbe778840c438aa0fa3a841aad9829
I20260812 00:04:25.491750 5299 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:04:25.491966 5299 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260812 00:04:25.494814 5299 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260812 00:04:25.496770 5299 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:04:25.496969 5299 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 1659d7b29a0f4e7f8272846248919213: Loaded TSK: 0
I20260812 00:04:25.497179 5299 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 00:04:25.567368 5280 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:04:25.567577 5280 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:04:25.567610 5280 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:04:25.568773 5280 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:04:25.568818 5280 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:04:25.568853 5280 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.65
I20260812 00:04:25.570340 5280 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:46009
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.65.keytab
--principal=kudu/127.11.206.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.65:39207
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.206.65
--webserver_port=41705
--tserver_master_addrs=127.11.206.126:39509
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5280
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.65
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:04:25.570577 5280 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:04:25.570802 5280 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:04:25.575923 5326 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:25.575976 5332 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:25.576002 5327 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:25.576334 5280 server_base.cc:1034] running on GCE node
I20260812 00:04:25.576541 5280 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:04:25.576776 5280 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:04:25.577924 5280 hybrid_clock.cc:648] HybridClock initialized: now 1786493065577906 us; error 34 us; skew 500 ppm
Aug 12 00:04:25 dist-test-slave-f0tn krb5kdc[4164](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493065, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:04:25.580472 5280 init.cc:377] Logged in from keytab as kudu/127.11.206.65@KRBTEST.COM (short username kudu)
I20260812 00:04:25.580955 5280 webserver.cc:460] Webserver started at http://127.11.206.65:41705/ using document root <none> and password file <none>
I20260812 00:04:25.581174 5280 fs_manager.cc:359] Metadata directory not provided
I20260812 00:04:25.581238 5280 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:04:25.582718 5280 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:04:25.583456 5342 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:25.583631 5280 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:04:25.583745 5280 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-0/wal
uuid: "8bf8ca15e8a3411cae50308f35fdb5f9"
format_stamp: "Formatted at 2026-08-12 00:04:24 on dist-test-slave-f0tn"
server_key: "05d05338f2911c1a0feb2e96fe301695"
server_key_iv: "02e94050a6480199525ea994ed79b485"
server_key_version: "encryptionkey@0"
I20260812 00:04:25.584208 5280 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:04:25.602399 5280 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:04:25.604849 5280 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:04:25.605013 5280 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:04:25.605288 5280 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:04:25.605818 5355 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260812 00:04:25.607326 5280 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 00:04:25.607388 5280 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260812 00:04:25.607422 5280 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260812 00:04:25.608330 5280 ts_tablet_manager.cc:610] Registered 1 tablets
I20260812 00:04:25.608376 5280 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260812 00:04:25.608435 5355 tablet_bootstrap.cc:492] T 4060d0f9c72d4bf192a10d72e577fa8c P 8bf8ca15e8a3411cae50308f35fdb5f9: Bootstrap starting.
I20260812 00:04:25.615567 5280 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.65:39207
I20260812 00:04:25.615752 5539 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.65:39207 every 8 connection(s)
I20260812 00:04:25.616019 5280 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
I20260812 00:04:25.618057 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 5280
I20260812 00:04:25.618057 5355 log.cc:824] T 4060d0f9c72d4bf192a10d72e577fa8c P 8bf8ca15e8a3411cae50308f35fdb5f9: Log is configured to *not* fsync() on all Append() calls
I20260812 00:04:25.618346 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.66:39635
--local_ip_for_outbound_sockets=127.11.206.66
--tserver_master_addrs=127.11.206.126:39509
--webserver_port=45473
--webserver_interface=127.11.206.66
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.66.keytab
--principal=kudu/127.11.206.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:46009
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:04:25.620678 5355 tablet_bootstrap.cc:492] T 4060d0f9c72d4bf192a10d72e577fa8c P 8bf8ca15e8a3411cae50308f35fdb5f9: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 00:04:25.620965 5355 tablet_bootstrap.cc:492] T 4060d0f9c72d4bf192a10d72e577fa8c P 8bf8ca15e8a3411cae50308f35fdb5f9: Bootstrap complete.
I20260812 00:04:25.622040 5355 ts_tablet_manager.cc:1397] T 4060d0f9c72d4bf192a10d72e577fa8c P 8bf8ca15e8a3411cae50308f35fdb5f9: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.010s
I20260812 00:04:25.623354 5355 raft_consensus.cc:348] T 4060d0f9c72d4bf192a10d72e577fa8c P 8bf8ca15e8a3411cae50308f35fdb5f9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5870757da61e462da82bf46ab1aa453a" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 39635 } } peers { permanent_uuid: "8bf8ca15e8a3411cae50308f35fdb5f9" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 39207 } } peers { permanent_uuid: "cd851d45beeb4409be68b1bebbc28ca4" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 35673 } }
I20260812 00:04:25.623687 5355 raft_consensus.cc:729] T 4060d0f9c72d4bf192a10d72e577fa8c P 8bf8ca15e8a3411cae50308f35fdb5f9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bf8ca15e8a3411cae50308f35fdb5f9, State: Initialized, Role: FOLLOWER
I20260812 00:04:25.623849 5355 consensus_queue.cc:260] T 4060d0f9c72d4bf192a10d72e577fa8c P 8bf8ca15e8a3411cae50308f35fdb5f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5870757da61e462da82bf46ab1aa453a" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 39635 } } peers { permanent_uuid: "8bf8ca15e8a3411cae50308f35fdb5f9" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 39207 } } peers { permanent_uuid: "cd851d45beeb4409be68b1bebbc28ca4" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 35673 } }
I20260812 00:04:25.624148 5355 ts_tablet_manager.cc:1428] T 4060d0f9c72d4bf192a10d72e577fa8c P 8bf8ca15e8a3411cae50308f35fdb5f9: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
Aug 12 00:04:25 dist-test-slave-f0tn krb5kdc[4164](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493065, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.65@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:04:25.630254 5542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:25.616893 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:39509 (local address 127.11.206.65:47053)
0812 00:04:25.617349 (+ 456us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:25.617443 (+ 94us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:25.618273 (+ 830us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:25.619088 (+ 815us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:25.619092 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:25.619445 (+ 353us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:04:25.619693 (+ 248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:25.619700 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.621339 (+ 1639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.621340 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:25.622576 (+ 1236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:25.622579 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.623474 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.623475 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:25.623601 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:25.624221 (+ 620us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:04:25.624230 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:04:25.626006 (+ 1776us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:04:25.628226 (+ 2220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:25.628235 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:25.628237 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:25.628551 (+ 314us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:25.628842 (+ 291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:25.628843 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:25.628843 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:25.629037 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:25.629513 (+ 476us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:04:25.629521 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:04:25.629702 (+ 181us) client_negotiation.cc:769] Sending connection context
0812 00:04:25.629823 (+ 121us) client_negotiation.cc:240] Negotiation successful
0812 00:04:25.630011 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":407,"thread_start_us":108,"threads_started":1}
I20260812 00:04:25.630339 5543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:25.617005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.65:47053 (local address 127.11.206.126:39509)
0812 00:04:25.617232 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:25.617245 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:25.617564 (+ 319us) server_negotiation.cc:407] Connection header received
0812 00:04:25.618709 (+ 1145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:25.618719 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:25.618780 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:25.618900 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:25.619833 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.621210 (+ 1377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.622679 (+ 1469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.623272 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.623357 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:25.626124 (+ 2767us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:25.626128 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:25.626129 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:04:25.626143 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:25.628130 (+ 1987us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:25.628647 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:25.628651 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:25.628651 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:25.628775 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:25.629113 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:25.629114 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:25.629115 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:25.629443 (+ 328us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:25.629530 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:25.629931 (+ 401us) server_negotiation.cc:299] Negotiation successful
0812 00:04:25.630102 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":176,"thread_start_us":90,"threads_started":1}
I20260812 00:04:25.631610 5540 heartbeater.cc:347] Connected to a master server at 127.11.206.126:39509
I20260812 00:04:25.631719 5540 heartbeater.cc:464] Registering TS with master...
I20260812 00:04:25.631928 5540 heartbeater.cc:511] Master 127.11.206.126:39509 requested a full tablet report, sending...
I20260812 00:04:25.632834 5210 ts_manager.cc:194] Registered new tserver with Master: 8bf8ca15e8a3411cae50308f35fdb5f9 (127.11.206.65:39207)
I20260812 00:04:25.634094 5210 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.206.65@KRBTEST.COM'} at 127.11.206.65:47053
I20260812 00:04:25.635216 5540 heartbeater.cc:503] Master 127.11.206.126:39509 was elected leader, sending a full tablet report...
I20260812 00:04:25.641492 5551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:25.634536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.65:39207 (local address 127.0.0.1:45360)
0812 00:04:25.637507 (+ 2971us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:25.637550 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:25.637629 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:25.637869 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:25.637872 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:25.637874 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:04:25.637940 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:25.637942 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.639143 (+ 1201us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.639144 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:25.640326 (+ 1182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:25.640329 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.641201 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.641202 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:25.641277 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:25.641289 (+ 12us) client_negotiation.cc:769] Sending connection context
0812 00:04:25.641344 (+ 55us) client_negotiation.cc:240] Negotiation successful
0812 00:04:25.641419 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2936,"thread_start_us":112,"threads_started":1}
I20260812 00:04:25.641875 5553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:25.634660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45360 (local address 127.11.206.65:39207)
0812 00:04:25.637492 (+ 2832us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:25.637497 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:25.637615 (+ 118us) server_negotiation.cc:407] Connection header received
0812 00:04:25.637707 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:25.637709 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:25.637724 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:25.637802 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:04:25.638006 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.639051 (+ 1045us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.640419 (+ 1368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.641050 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.641114 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:25.641168 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:25.641747 (+ 579us) server_negotiation.cc:299] Negotiation successful
0812 00:04:25.641806 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2797,"thread_start_us":114,"threads_started":1}
I20260812 00:04:25.642210 5395 tablet_service.cc:1514] Processing DeleteTablet for tablet 4060d0f9c72d4bf192a10d72e577fa8c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:04:25 UTC) from {username='kudu', principal='kudu/127.11.206.126@KRBTEST.COM'} at 127.0.0.1:45360
I20260812 00:04:25.642863 5554 tablet_replica.cc:330] stopping tablet replica
I20260812 00:04:25.642976 5554 raft_consensus.cc:2229] T 4060d0f9c72d4bf192a10d72e577fa8c P 8bf8ca15e8a3411cae50308f35fdb5f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:04:25.643044 5554 raft_consensus.cc:2258] T 4060d0f9c72d4bf192a10d72e577fa8c P 8bf8ca15e8a3411cae50308f35fdb5f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:04:25.643406 5554 ts_tablet_manager.cc:1905] T 4060d0f9c72d4bf192a10d72e577fa8c P 8bf8ca15e8a3411cae50308f35fdb5f9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:04:25.645663 5554 ts_tablet_manager.cc:1918] T 4060d0f9c72d4bf192a10d72e577fa8c P 8bf8ca15e8a3411cae50308f35fdb5f9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:04:25.645741 5554 log.cc:1196] T 4060d0f9c72d4bf192a10d72e577fa8c P 8bf8ca15e8a3411cae50308f35fdb5f9: Deleting WAL directory at /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-0/wal/wals/4060d0f9c72d4bf192a10d72e577fa8c
I20260812 00:04:25.645951 5554 ts_tablet_manager.cc:1939] T 4060d0f9c72d4bf192a10d72e577fa8c P 8bf8ca15e8a3411cae50308f35fdb5f9: Deleting consensus metadata
I20260812 00:04:25.646492 5187 catalog_manager.cc:4841] TS 8bf8ca15e8a3411cae50308f35fdb5f9 (127.11.206.65:39207): tablet 4060d0f9c72d4bf192a10d72e577fa8c (table test-table [id=3772b29835ee43e6971b6808081846bc]) successfully deleted
W20260812 00:04:25.708524 5545 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:04:25.708731 5545 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:04:25.708755 5545 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:04:25.709937 5545 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:04:25.709978 5545 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:04:25.710003 5545 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.66
I20260812 00:04:25.711453 5545 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:46009
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.66.keytab
--principal=kudu/127.11.206.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.66:39635
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.206.66
--webserver_port=45473
--tserver_master_addrs=127.11.206.126:39509
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5545
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.66
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:04:25.711681 5545 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:04:25.711898 5545 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 00:04:25.716897 5545 server_base.cc:1034] running on GCE node
W20260812 00:04:25.716849 5561 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:25.716836 5564 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:25.716867 5566 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:25.717262 5545 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:04:25.717547 5545 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:04:25.718700 5545 hybrid_clock.cc:648] HybridClock initialized: now 1786493065718691 us; error 28 us; skew 500 ppm
Aug 12 00:04:25 dist-test-slave-f0tn krb5kdc[4164](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493065, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:04:25.721168 5545 init.cc:377] Logged in from keytab as kudu/127.11.206.66@KRBTEST.COM (short username kudu)
I20260812 00:04:25.721621 5545 webserver.cc:460] Webserver started at http://127.11.206.66:45473/ using document root <none> and password file <none>
I20260812 00:04:25.721848 5545 fs_manager.cc:359] Metadata directory not provided
I20260812 00:04:25.721916 5545 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:04:25.723234 5545 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:04:25.723775 5574 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:25.723928 5545 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:25.724009 5545 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-1/wal
uuid: "5870757da61e462da82bf46ab1aa453a"
format_stamp: "Formatted at 2026-08-12 00:04:24 on dist-test-slave-f0tn"
server_key: "ddd599bae19a7be03e5bd7c70d605a05"
server_key_iv: "8c9000de5a93088a42fb3dc41300a32b"
server_key_version: "encryptionkey@0"
I20260812 00:04:25.724332 5545 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:04:25.742570 5545 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:04:25.744652 5545 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:04:25.744781 5545 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:04:25.744984 5545 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:04:25.745282 5545 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:04:25.745321 5545 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:25.745349 5545 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:04:25.745414 5545 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:25.750998 5545 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.66:39635
I20260812 00:04:25.751044 5760 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.66:39635 every 8 connection(s)
I20260812 00:04:25.751374 5545 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
Aug 12 00:04:25 dist-test-slave-f0tn krb5kdc[4164](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493065, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.66@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:04:25.757802 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 5545
I20260812 00:04:25.758071 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.67:35673
--local_ip_for_outbound_sockets=127.11.206.67
--tserver_master_addrs=127.11.206.126:39509
--webserver_port=39029
--webserver_interface=127.11.206.67
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.67.keytab
--principal=kudu/127.11.206.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:46009
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:04:25.760479 5543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:25.752014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.66:35499 (local address 127.11.206.126:39509)
0812 00:04:25.752076 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:25.752078 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:25.752331 (+ 253us) server_negotiation.cc:407] Connection header received
0812 00:04:25.752828 (+ 497us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:25.752829 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:25.752842 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:25.752888 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:25.753860 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.754381 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.755312 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.755501 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.755545 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:25.757530 (+ 1985us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:25.757532 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:25.757532 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:04:25.757539 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:25.759006 (+ 1467us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:25.759381 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:25.759382 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:25.759383 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:25.759448 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:25.759785 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:25.759786 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:25.759787 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:25.759914 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:25.759978 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:25.760321 (+ 343us) server_negotiation.cc:299] Negotiation successful
0812 00:04:25.760410 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260812 00:04:25.760679 5764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:25.752036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:39509 (local address 127.11.206.66:35499)
0812 00:04:25.752219 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:25.752253 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:25.752745 (+ 492us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:25.752950 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:25.752954 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:25.753575 (+ 621us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:04:25.753772 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:25.753778 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.754448 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.754449 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:25.755251 (+ 802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:25.755253 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.755554 (+ 301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.755555 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:25.755670 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:25.756105 (+ 435us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:04:25.756113 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:04:25.757444 (+ 1331us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:04:25.759088 (+ 1644us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:25.759094 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:25.759096 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:25.759313 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:25.759534 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:25.759535 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:25.759536 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:25.759690 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:25.759980 (+ 290us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:04:25.759986 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:04:25.760175 (+ 189us) client_negotiation.cc:769] Sending connection context
0812 00:04:25.760290 (+ 115us) client_negotiation.cc:240] Negotiation successful
0812 00:04:25.760454 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":110,"threads_started":1}
I20260812 00:04:25.761153 5761 heartbeater.cc:347] Connected to a master server at 127.11.206.126:39509
I20260812 00:04:25.761242 5761 heartbeater.cc:464] Registering TS with master...
I20260812 00:04:25.761449 5761 heartbeater.cc:511] Master 127.11.206.126:39509 requested a full tablet report, sending...
I20260812 00:04:25.761840 5210 ts_manager.cc:194] Registered new tserver with Master: 5870757da61e462da82bf46ab1aa453a (127.11.206.66:39635)
I20260812 00:04:25.762210 5210 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.206.66@KRBTEST.COM'} at 127.11.206.66:35499
W20260812 00:04:25.840999 5766 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:04:25.841216 5766 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:04:25.841240 5766 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:04:25.842485 5766 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:04:25.842530 5766 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:04:25.842556 5766 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.67
I20260812 00:04:25.844390 5766 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:46009
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.67.keytab
--principal=kudu/127.11.206.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.67:35673
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.206.67
--webserver_port=39029
--tserver_master_addrs=127.11.206.126:39509
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5766
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.67
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:04:25.844631 5766 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:04:25.844870 5766 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:04:25.849833 5774 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:25.849879 5776 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:25.849839 5780 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:25.850028 5766 server_base.cc:1034] running on GCE node
I20260812 00:04:25.850272 5766 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:04:25.850499 5766 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:04:25.851652 5766 hybrid_clock.cc:648] HybridClock initialized: now 1786493065851634 us; error 33 us; skew 500 ppm
Aug 12 00:04:25 dist-test-slave-f0tn krb5kdc[4164](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493065, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:04:25.854202 5766 init.cc:377] Logged in from keytab as kudu/127.11.206.67@KRBTEST.COM (short username kudu)
I20260812 00:04:25.854657 5766 webserver.cc:460] Webserver started at http://127.11.206.67:39029/ using document root <none> and password file <none>
I20260812 00:04:25.854880 5766 fs_manager.cc:359] Metadata directory not provided
I20260812 00:04:25.854943 5766 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:04:25.856290 5766 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:04:25.856813 5792 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:25.856980 5766 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:04:25.857065 5766 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-2/wal
uuid: "cd851d45beeb4409be68b1bebbc28ca4"
format_stamp: "Formatted at 2026-08-12 00:04:24 on dist-test-slave-f0tn"
server_key: "fb3247a3c16458cfb25b8bcfedeb3581"
server_key_iv: "3802561a17d2b387e3c8bf091e438d94"
server_key_version: "encryptionkey@0"
I20260812 00:04:25.857470 5766 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:04:25.876778 5766 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:04:25.878608 5766 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:04:25.878746 5766 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:04:25.878963 5766 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:04:25.879284 5766 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:04:25.879319 5766 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:25.879348 5766 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:04:25.879366 5766 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:25.884980 5766 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.67:35673
I20260812 00:04:25.885022 5989 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.67:35673 every 8 connection(s)
I20260812 00:04:25.885362 5766 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
Aug 12 00:04:25 dist-test-slave-f0tn krb5kdc[4164](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493065, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.67@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:04:25.894122 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 5766
I20260812 00:04:25.894742 5543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:25.886097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.67:46903 (local address 127.11.206.126:39509)
0812 00:04:25.886148 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:25.886149 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:25.886357 (+ 208us) server_negotiation.cc:407] Connection header received
0812 00:04:25.886818 (+ 461us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:25.886819 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:25.886830 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:25.886880 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:25.887777 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.888307 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.889344 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.889616 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.889692 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:25.891894 (+ 2202us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:25.891896 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:25.891896 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:04:25.891904 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:25.893255 (+ 1351us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:25.893706 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:25.893707 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:25.893707 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:25.893769 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:25.894039 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:25.894039 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:25.894039 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:25.894154 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:25.894219 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:25.894553 (+ 334us) server_negotiation.cc:299] Negotiation successful
0812 00:04:25.894644 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 00:04:25.894908 5997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:25.886073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:39509 (local address 127.11.206.67:46903)
0812 00:04:25.886234 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:25.886270 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:25.886738 (+ 468us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:25.886937 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:25.886940 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:25.887494 (+ 554us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:04:25.887707 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:25.887712 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.888383 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.888384 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:25.889242 (+ 858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:25.889245 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.889699 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.889700 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:25.889828 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:25.890312 (+ 484us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:04:25.890323 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:04:25.891803 (+ 1480us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:04:25.893326 (+ 1523us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:25.893332 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:25.893334 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:25.893619 (+ 285us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:25.893832 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:25.893833 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:25.893833 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:25.893974 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:25.894222 (+ 248us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:04:25.894229 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:04:25.894382 (+ 153us) client_negotiation.cc:769] Sending connection context
0812 00:04:25.894522 (+ 140us) client_negotiation.cc:240] Negotiation successful
0812 00:04:25.894695 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":89,"threads_started":1}
I20260812 00:04:25.895393 5993 heartbeater.cc:347] Connected to a master server at 127.11.206.126:39509
I20260812 00:04:25.895481 5993 heartbeater.cc:464] Registering TS with master...
I20260812 00:04:25.895659 5993 heartbeater.cc:511] Master 127.11.206.126:39509 requested a full tablet report, sending...
I20260812 00:04:25.896040 5210 ts_manager.cc:194] Registered new tserver with Master: cd851d45beeb4409be68b1bebbc28ca4 (127.11.206.67:35673)
I20260812 00:04:25.896394 5210 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.206.67@KRBTEST.COM'} at 127.11.206.67:46903
I20260812 00:04:25.900478 5999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:25.894499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59938 (local address 127.11.206.126:39509)
0812 00:04:25.894622 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:25.894624 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:25.894634 (+ 10us) server_negotiation.cc:407] Connection header received
0812 00:04:25.894699 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:25.894700 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:25.894711 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:25.894764 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:25.895748 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.896321 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.897071 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.897274 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.897328 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:25.898377 (+ 1049us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:25.898379 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:25.898379 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:04:25.898386 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:25.899484 (+ 1098us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:25.899785 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:25.899786 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:25.899786 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:25.899842 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:25.900005 (+ 163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:25.900006 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:25.900007 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:25.900112 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:25.900272 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:25.900308 (+ 36us) server_negotiation.cc:299] Negotiation successful
0812 00:04:25.900380 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106,"thread_start_us":52,"threads_started":1}
I20260812 00:04:25.901214 12089 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:04:25.903656 5999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:25.901541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59948 (local address 127.11.206.126:39509)
0812 00:04:25.901601 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:25.901602 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:25.901688 (+ 86us) server_negotiation.cc:407] Connection header received
0812 00:04:25.901735 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:25.901735 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:25.901764 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:25.901828 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:04:25.901912 (+ 84us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.902361 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.903019 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.903207 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.903253 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:25.903347 (+ 94us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:04:25.903437 (+ 90us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:04:25.903490 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:25.903590 (+ 100us) server_negotiation.cc:299] Negotiation successful
0812 00:04:25.903606 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260812 00:04:25.903954 5210 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:59948:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:04:25.905575 5210 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:04:25.907965 5395 tablet_service.cc:1467] Processing CreateTablet for tablet 41a7f97045c4489d8eea9aa355b7590e (DEFAULT_TABLE table=test-table [id=48f41ed321ea477abd2ac3bff88a6058]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:04:25.908162 5395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 41a7f97045c4489d8eea9aa355b7590e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:04:25.909690 5355 tablet_bootstrap.cc:492] T 41a7f97045c4489d8eea9aa355b7590e P 8bf8ca15e8a3411cae50308f35fdb5f9: Bootstrap starting.
I20260812 00:04:25.910051 5355 tablet_bootstrap.cc:654] T 41a7f97045c4489d8eea9aa355b7590e P 8bf8ca15e8a3411cae50308f35fdb5f9: Neither blocks nor log segments found. Creating new log.
I20260812 00:04:25.911181 5551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:25.907663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.67:35673 (local address 127.0.0.1:56436)
0812 00:04:25.907702 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:25.907712 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:25.907745 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:25.908092 (+ 347us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:25.908094 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:25.908095 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:04:25.908138 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:25.908139 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.909212 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.909213 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:25.910151 (+ 938us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:25.910155 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.910934 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.910935 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:25.910995 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:25.910998 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:04:25.911058 (+ 60us) client_negotiation.cc:240] Negotiation successful
0812 00:04:25.911106 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22}
I20260812 00:04:25.911237 6001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:25.907749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56436 (local address 127.11.206.67:35673)
0812 00:04:25.907924 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:25.907929 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:25.907940 (+ 11us) server_negotiation.cc:407] Connection header received
0812 00:04:25.907980 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:25.907982 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:25.907995 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:25.908085 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:04:25.908199 (+ 114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.909115 (+ 916us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.910239 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.910864 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.910935 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:25.910985 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:25.911107 (+ 122us) server_negotiation.cc:299] Negotiation successful
0812 00:04:25.911157 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":101,"threads_started":1}
I20260812 00:04:25.911332 5355 tablet_bootstrap.cc:492] T 41a7f97045c4489d8eea9aa355b7590e P 8bf8ca15e8a3411cae50308f35fdb5f9: No bootstrap required, opened a new log
I20260812 00:04:25.911386 5355 ts_tablet_manager.cc:1397] T 41a7f97045c4489d8eea9aa355b7590e P 8bf8ca15e8a3411cae50308f35fdb5f9: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260812 00:04:25.911496 5355 raft_consensus.cc:348] T 41a7f97045c4489d8eea9aa355b7590e P 8bf8ca15e8a3411cae50308f35fdb5f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd851d45beeb4409be68b1bebbc28ca4" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 35673 } } peers { permanent_uuid: "5870757da61e462da82bf46ab1aa453a" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 39635 } } peers { permanent_uuid: "8bf8ca15e8a3411cae50308f35fdb5f9" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 39207 } }
I20260812 00:04:25.911569 5355 raft_consensus.cc:374] T 41a7f97045c4489d8eea9aa355b7590e P 8bf8ca15e8a3411cae50308f35fdb5f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:04:25.911602 5355 raft_consensus.cc:729] T 41a7f97045c4489d8eea9aa355b7590e P 8bf8ca15e8a3411cae50308f35fdb5f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bf8ca15e8a3411cae50308f35fdb5f9, State: Initialized, Role: FOLLOWER
I20260812 00:04:25.911652 5355 consensus_queue.cc:260] T 41a7f97045c4489d8eea9aa355b7590e P 8bf8ca15e8a3411cae50308f35fdb5f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd851d45beeb4409be68b1bebbc28ca4" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 35673 } } peers { permanent_uuid: "5870757da61e462da82bf46ab1aa453a" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 39635 } } peers { permanent_uuid: "8bf8ca15e8a3411cae50308f35fdb5f9" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 39207 } }
I20260812 00:04:25.911744 5355 ts_tablet_manager.cc:1428] T 41a7f97045c4489d8eea9aa355b7590e P 8bf8ca15e8a3411cae50308f35fdb5f9: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:25.912489 5872 tablet_service.cc:1467] Processing CreateTablet for tablet 41a7f97045c4489d8eea9aa355b7590e (DEFAULT_TABLE table=test-table [id=48f41ed321ea477abd2ac3bff88a6058]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:04:25.912871 5872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 41a7f97045c4489d8eea9aa355b7590e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:04:25.914016 6002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:25.907762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.66:39635 (local address 127.0.0.1:44450)
0812 00:04:25.909926 (+ 2164us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:25.909938 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:25.910008 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:25.910259 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:25.910260 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:25.910261 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:04:25.910300 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:25.910302 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.911901 (+ 1599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.911902 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:25.912914 (+ 1012us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:25.912917 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.913833 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.913834 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:25.913883 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:25.913886 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:04:25.913936 (+ 50us) client_negotiation.cc:240] Negotiation successful
0812 00:04:25.913969 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2147,"thread_start_us":105,"threads_started":1}
I20260812 00:04:25.914090 6003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:25.909722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44450 (local address 127.11.206.66:39635)
0812 00:04:25.909957 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:25.909963 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:25.909993 (+ 30us) server_negotiation.cc:407] Connection header received
0812 00:04:25.910083 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:25.910085 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:25.910101 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:25.910173 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:04:25.910383 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.911777 (+ 1394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.913036 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:25.913745 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:25.913831 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:25.913889 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:25.913953 (+ 64us) server_negotiation.cc:299] Negotiation successful
0812 00:04:25.913996 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":201,"thread_start_us":102,"threads_started":1}
I20260812 00:04:25.914743 5646 tablet_service.cc:1467] Processing CreateTablet for tablet 41a7f97045c4489d8eea9aa355b7590e (DEFAULT_TABLE table=test-table [id=48f41ed321ea477abd2ac3bff88a6058]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:04:25.915102 5646 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 41a7f97045c4489d8eea9aa355b7590e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:04:25.916596 6006 tablet_bootstrap.cc:492] T 41a7f97045c4489d8eea9aa355b7590e P cd851d45beeb4409be68b1bebbc28ca4: Bootstrap starting.
I20260812 00:04:25.917484 6006 tablet_bootstrap.cc:654] T 41a7f97045c4489d8eea9aa355b7590e P cd851d45beeb4409be68b1bebbc28ca4: Neither blocks nor log segments found. Creating new log.
I20260812 00:04:25.918059 6006 log.cc:824] T 41a7f97045c4489d8eea9aa355b7590e P cd851d45beeb4409be68b1bebbc28ca4: Log is configured to *not* fsync() on all Append() calls
I20260812 00:04:25.918509 6008 tablet_bootstrap.cc:492] T 41a7f97045c4489d8eea9aa355b7590e P 5870757da61e462da82bf46ab1aa453a: Bootstrap starting.
I20260812 00:04:25.918970 6006 tablet_bootstrap.cc:492] T 41a7f97045c4489d8eea9aa355b7590e P cd851d45beeb4409be68b1bebbc28ca4: No bootstrap required, opened a new log
I20260812 00:04:25.919062 6006 ts_tablet_manager.cc:1397] T 41a7f97045c4489d8eea9aa355b7590e P cd851d45beeb4409be68b1bebbc28ca4: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260812 00:04:25.919235 6008 tablet_bootstrap.cc:654] T 41a7f97045c4489d8eea9aa355b7590e P 5870757da61e462da82bf46ab1aa453a: Neither blocks nor log segments found. Creating new log.
I20260812 00:04:25.919834 6008 log.cc:824] T 41a7f97045c4489d8eea9aa355b7590e P 5870757da61e462da82bf46ab1aa453a: Log is configured to *not* fsync() on all Append() calls
I20260812 00:04:25.920611 6008 tablet_bootstrap.cc:492] T 41a7f97045c4489d8eea9aa355b7590e P 5870757da61e462da82bf46ab1aa453a: No bootstrap required, opened a new log
I20260812 00:04:25.920689 6008 ts_tablet_manager.cc:1397] T 41a7f97045c4489d8eea9aa355b7590e P 5870757da61e462da82bf46ab1aa453a: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 00:04:25.921048 6006 raft_consensus.cc:348] T 41a7f97045c4489d8eea9aa355b7590e P cd851d45beeb4409be68b1bebbc28ca4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd851d45beeb4409be68b1bebbc28ca4" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 35673 } } peers { permanent_uuid: "5870757da61e462da82bf46ab1aa453a" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 39635 } } peers { permanent_uuid: "8bf8ca15e8a3411cae50308f35fdb5f9" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 39207 } }
I20260812 00:04:25.921223 6006 raft_consensus.cc:374] T 41a7f97045c4489d8eea9aa355b7590e P cd851d45beeb4409be68b1bebbc28ca4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:04:25.921267 6006 raft_consensus.cc:729] T 41a7f97045c4489d8eea9aa355b7590e P cd851d45beeb4409be68b1bebbc28ca4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd851d45beeb4409be68b1bebbc28ca4, State: Initialized, Role: FOLLOWER
I20260812 00:04:25.921417 6006 consensus_queue.cc:260] T 41a7f97045c4489d8eea9aa355b7590e P cd851d45beeb4409be68b1bebbc28ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd851d45beeb4409be68b1bebbc28ca4" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 35673 } } peers { permanent_uuid: "5870757da61e462da82bf46ab1aa453a" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 39635 } } peers { permanent_uuid: "8bf8ca15e8a3411cae50308f35fdb5f9" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 39207 } }
I20260812 00:04:25.921715 5993 heartbeater.cc:503] Master 127.11.206.126:39509 was elected leader, sending a full tablet report...
I20260812 00:04:25.921715 6006 ts_tablet_manager.cc:1428] T 41a7f97045c4489d8eea9aa355b7590e P cd851d45beeb4409be68b1bebbc28ca4: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260812 00:04:25.922987 6008 raft_consensus.cc:348] T 41a7f97045c4489d8eea9aa355b7590e P 5870757da61e462da82bf46ab1aa453a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd851d45beeb4409be68b1bebbc28ca4" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 35673 } } peers { permanent_uuid: "5870757da61e462da82bf46ab1aa453a" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 39635 } } peers { permanent_uuid: "8bf8ca15e8a3411cae50308f35fdb5f9" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 39207 } }
I20260812 00:04:25.923122 6008 raft_consensus.cc:374] T 41a7f97045c4489d8eea9aa355b7590e P 5870757da61e462da82bf46ab1aa453a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:04:25.923146 6008 raft_consensus.cc:729] T 41a7f97045c4489d8eea9aa355b7590e P 5870757da61e462da82bf46ab1aa453a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5870757da61e462da82bf46ab1aa453a, State: Initialized, Role: FOLLOWER
I20260812 00:04:25.923233 6008 consensus_queue.cc:260] T 41a7f97045c4489d8eea9aa355b7590e P 5870757da61e462da82bf46ab1aa453a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd851d45beeb4409be68b1bebbc28ca4" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 35673 } } peers { permanent_uuid: "5870757da61e462da82bf46ab1aa453a" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 39635 } } peers { permanent_uuid: "8bf8ca15e8a3411cae50308f35fdb5f9" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 39207 } }
I20260812 00:04:25.923475 6008 ts_tablet_manager.cc:1428] T 41a7f97045c4489d8eea9aa355b7590e P 5870757da61e462da82bf46ab1aa453a: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 00:04:25.923504 5761 heartbeater.cc:503] Master 127.11.206.126:39509 was elected leader, sending a full tablet report...
W20260812 00:04:26.001927 5762 tablet.cc:2369] T 41a7f97045c4489d8eea9aa355b7590e P 5870757da61e462da82bf46ab1aa453a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 00:04:26.117110 5541 tablet.cc:2369] T 41a7f97045c4489d8eea9aa355b7590e P 8bf8ca15e8a3411cae50308f35fdb5f9: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 00:04:26.135959 5996 tablet.cc:2369] T 41a7f97045c4489d8eea9aa355b7590e P cd851d45beeb4409be68b1bebbc28ca4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:04:26.196271 6011 raft_consensus.cc:482] T 41a7f97045c4489d8eea9aa355b7590e P 5870757da61e462da82bf46ab1aa453a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:04:26.196408 6011 raft_consensus.cc:504] T 41a7f97045c4489d8eea9aa355b7590e P 5870757da61e462da82bf46ab1aa453a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd851d45beeb4409be68b1bebbc28ca4" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 35673 } } peers { permanent_uuid: "5870757da61e462da82bf46ab1aa453a" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 39635 } } peers { permanent_uuid: "8bf8ca15e8a3411cae50308f35fdb5f9" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 39207 } }
I20260812 00:04:26.196767 6011 leader_election.cc:288] T 41a7f97045c4489d8eea9aa355b7590e P 5870757da61e462da82bf46ab1aa453a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd851d45beeb4409be68b1bebbc28ca4 (127.11.206.67:35673), 8bf8ca15e8a3411cae50308f35fdb5f9 (127.11.206.65:39207)
I20260812 00:04:26.200654 6015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:26.197101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.66:49465 (local address 127.11.206.65:39207)
0812 00:04:26.197232 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:26.197234 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:26.197243 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:04:26.197285 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:26.197286 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:26.197295 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:26.197341 (+ 46us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:04:26.197491 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:26.198217 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:26.199665 (+ 1448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:26.200263 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:26.200325 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:26.200332 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:26.200530 (+ 198us) server_negotiation.cc:299] Negotiation successful
0812 00:04:26.200581 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109,"thread_start_us":51,"threads_started":1}
I20260812 00:04:26.200659 6001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:26.197085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.66:45049 (local address 127.11.206.67:35673)
0812 00:04:26.197131 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:26.197133 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:26.197141 (+ 8us) server_negotiation.cc:407] Connection header received
0812 00:04:26.197169 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:26.197170 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:26.197180 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:26.197234 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:04:26.197441 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:26.198212 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:26.199666 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:26.200240 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:26.200319 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:26.200330 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:26.200530 (+ 200us) server_negotiation.cc:299] Negotiation successful
0812 00:04:26.200574 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 00:04:26.200649 5764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:26.196973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.67:35673 (local address 127.11.206.66:45049)
0812 00:04:26.197024 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:26.197037 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:26.197090 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:26.197258 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:26.197259 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:26.197261 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:04:26.197335 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:26.197337 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:26.198296 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:26.198297 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:26.199570 (+ 1273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:26.199573 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:26.200331 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:26.200332 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:26.200447 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:26.200449 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 00:04:26.200504 (+ 55us) client_negotiation.cc:240] Negotiation successful
0812 00:04:26.200553 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28,"mutex_wait_us":13}
I20260812 00:04:26.200657 6014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:26.196982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.65:39207 (local address 127.11.206.66:49465)
0812 00:04:26.197173 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:26.197182 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:26.197235 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:26.197354 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:26.197354 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:26.197356 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:04:26.197426 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:26.197427 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:26.198296 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:26.198297 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:26.199578 (+ 1281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:26.199579 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:26.200336 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:26.200337 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:26.200442 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:26.200447 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 00:04:26.200504 (+ 57us) client_negotiation.cc:240] Negotiation successful
0812 00:04:26.200553 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":173,"mutex_wait_us":118,"thread_start_us":104,"threads_started":1}
I20260812 00:04:26.201030 5907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41a7f97045c4489d8eea9aa355b7590e" candidate_uuid: "5870757da61e462da82bf46ab1aa453a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd851d45beeb4409be68b1bebbc28ca4" is_pre_election: true
I20260812 00:04:26.201224 5907 raft_consensus.cc:2454] T 41a7f97045c4489d8eea9aa355b7590e P cd851d45beeb4409be68b1bebbc28ca4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5870757da61e462da82bf46ab1aa453a in term 0.
I20260812 00:04:26.201172 5446 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41a7f97045c4489d8eea9aa355b7590e" candidate_uuid: "5870757da61e462da82bf46ab1aa453a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf8ca15e8a3411cae50308f35fdb5f9" is_pre_election: true
I20260812 00:04:26.201324 5446 raft_consensus.cc:2454] T 41a7f97045c4489d8eea9aa355b7590e P 8bf8ca15e8a3411cae50308f35fdb5f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5870757da61e462da82bf46ab1aa453a in term 0.
I20260812 00:04:26.201512 5576 leader_election.cc:302] T 41a7f97045c4489d8eea9aa355b7590e P 5870757da61e462da82bf46ab1aa453a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5870757da61e462da82bf46ab1aa453a, cd851d45beeb4409be68b1bebbc28ca4; no voters:
I20260812 00:04:26.201686 6011 raft_consensus.cc:2781] T 41a7f97045c4489d8eea9aa355b7590e P 5870757da61e462da82bf46ab1aa453a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:04:26.201735 6011 raft_consensus.cc:482] T 41a7f97045c4489d8eea9aa355b7590e P 5870757da61e462da82bf46ab1aa453a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:04:26.201751 6011 raft_consensus.cc:3037] T 41a7f97045c4489d8eea9aa355b7590e P 5870757da61e462da82bf46ab1aa453a [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:04:26.202441 6011 raft_consensus.cc:504] T 41a7f97045c4489d8eea9aa355b7590e P 5870757da61e462da82bf46ab1aa453a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd851d45beeb4409be68b1bebbc28ca4" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 35673 } } peers { permanent_uuid: "5870757da61e462da82bf46ab1aa453a" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 39635 } } peers { permanent_uuid: "8bf8ca15e8a3411cae50308f35fdb5f9" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 39207 } }
I20260812 00:04:26.202561 6011 leader_election.cc:288] T 41a7f97045c4489d8eea9aa355b7590e P 5870757da61e462da82bf46ab1aa453a [CANDIDATE]: Term 1 election: Requested vote from peers cd851d45beeb4409be68b1bebbc28ca4 (127.11.206.67:35673), 8bf8ca15e8a3411cae50308f35fdb5f9 (127.11.206.65:39207)
I20260812 00:04:26.202718 5446 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41a7f97045c4489d8eea9aa355b7590e" candidate_uuid: "5870757da61e462da82bf46ab1aa453a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf8ca15e8a3411cae50308f35fdb5f9"
I20260812 00:04:26.202731 5907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41a7f97045c4489d8eea9aa355b7590e" candidate_uuid: "5870757da61e462da82bf46ab1aa453a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd851d45beeb4409be68b1bebbc28ca4"
I20260812 00:04:26.202811 5446 raft_consensus.cc:3037] T 41a7f97045c4489d8eea9aa355b7590e P 8bf8ca15e8a3411cae50308f35fdb5f9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:04:26.202811 5907 raft_consensus.cc:3037] T 41a7f97045c4489d8eea9aa355b7590e P cd851d45beeb4409be68b1bebbc28ca4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:04:26.203671 5907 raft_consensus.cc:2454] T 41a7f97045c4489d8eea9aa355b7590e P cd851d45beeb4409be68b1bebbc28ca4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5870757da61e462da82bf46ab1aa453a in term 1.
I20260812 00:04:26.203670 5446 raft_consensus.cc:2454] T 41a7f97045c4489d8eea9aa355b7590e P 8bf8ca15e8a3411cae50308f35fdb5f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5870757da61e462da82bf46ab1aa453a in term 1.
I20260812 00:04:26.203864 5576 leader_election.cc:302] T 41a7f97045c4489d8eea9aa355b7590e P 5870757da61e462da82bf46ab1aa453a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5870757da61e462da82bf46ab1aa453a, cd851d45beeb4409be68b1bebbc28ca4; no voters:
I20260812 00:04:26.203971 6011 raft_consensus.cc:2781] T 41a7f97045c4489d8eea9aa355b7590e P 5870757da61e462da82bf46ab1aa453a [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:04:26.204126 6011 raft_consensus.cc:686] T 41a7f97045c4489d8eea9aa355b7590e P 5870757da61e462da82bf46ab1aa453a [term 1 LEADER]: Becoming Leader. State: Replica: 5870757da61e462da82bf46ab1aa453a, State: Running, Role: LEADER
I20260812 00:04:26.204229 6011 consensus_queue.cc:237] T 41a7f97045c4489d8eea9aa355b7590e P 5870757da61e462da82bf46ab1aa453a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd851d45beeb4409be68b1bebbc28ca4" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 35673 } } peers { permanent_uuid: "5870757da61e462da82bf46ab1aa453a" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 39635 } } peers { permanent_uuid: "8bf8ca15e8a3411cae50308f35fdb5f9" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 39207 } }
I20260812 00:04:26.205117 5208 catalog_manager.cc:5495] T 41a7f97045c4489d8eea9aa355b7590e P 5870757da61e462da82bf46ab1aa453a reported cstate change: term changed from 0 to 1, leader changed from <none> to 5870757da61e462da82bf46ab1aa453a (127.11.206.66). New cstate: current_term: 1 leader_uuid: "5870757da61e462da82bf46ab1aa453a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd851d45beeb4409be68b1bebbc28ca4" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 35673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5870757da61e462da82bf46ab1aa453a" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8bf8ca15e8a3411cae50308f35fdb5f9" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 39207 } health_report { overall_health: UNKNOWN } } }
I20260812 00:04:26.267926 6003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:26.265342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44452 (local address 127.11.206.66:39635)
0812 00:04:26.265422 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:26.265424 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:26.265434 (+ 10us) server_negotiation.cc:407] Connection header received
0812 00:04:26.265475 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:26.265476 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:26.265498 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:26.265587 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:04:26.265882 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:26.266401 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:26.267173 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:26.267373 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:26.267438 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:26.267607 (+ 169us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:04:26.267734 (+ 127us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:04:26.267813 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:26.267828 (+ 15us) server_negotiation.cc:299] Negotiation successful
0812 00:04:26.267851 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 00:04:26.269904 5907 raft_consensus.cc:1261] T 41a7f97045c4489d8eea9aa355b7590e P cd851d45beeb4409be68b1bebbc28ca4 [term 1 FOLLOWER]: Refusing update from remote peer 5870757da61e462da82bf46ab1aa453a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:04:26.269906 5446 raft_consensus.cc:1261] T 41a7f97045c4489d8eea9aa355b7590e P 8bf8ca15e8a3411cae50308f35fdb5f9 [term 1 FOLLOWER]: Refusing update from remote peer 5870757da61e462da82bf46ab1aa453a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:04:26.270287 6011 consensus_queue.cc:1035] T 41a7f97045c4489d8eea9aa355b7590e P 5870757da61e462da82bf46ab1aa453a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd851d45beeb4409be68b1bebbc28ca4" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 35673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:04:26.270457 6016 consensus_queue.cc:1035] T 41a7f97045c4489d8eea9aa355b7590e P 5870757da61e462da82bf46ab1aa453a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8bf8ca15e8a3411cae50308f35fdb5f9" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 39207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:04:26.273036 6021 mvcc.cc:205] Tried to move back new op lower bound from 7317475599438643200 to 7317475599173038080. Current Snapshot: MvccSnapshot[applied={T|T < 7317475599438643200}]
I20260812 00:04:26.275282 5208 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:59948:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:04:26.275379 5208 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:59948:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:04:26.276096 5208 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1659d7b29a0f4e7f8272846248919213: Sending DeleteTablet for 3 replicas of tablet 41a7f97045c4489d8eea9aa355b7590e
I20260812 00:04:26.276376 5395 tablet_service.cc:1514] Processing DeleteTablet for tablet 41a7f97045c4489d8eea9aa355b7590e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:04:26 UTC) from {username='kudu', principal='kudu/127.11.206.126@KRBTEST.COM'} at 127.0.0.1:45360
I20260812 00:04:26.276465 5646 tablet_service.cc:1514] Processing DeleteTablet for tablet 41a7f97045c4489d8eea9aa355b7590e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:04:26 UTC) from {username='kudu', principal='kudu/127.11.206.126@KRBTEST.COM'} at 127.0.0.1:44450
I20260812 00:04:26.276448 5872 tablet_service.cc:1514] Processing DeleteTablet for tablet 41a7f97045c4489d8eea9aa355b7590e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:04:26 UTC) from {username='kudu', principal='kudu/127.11.206.126@KRBTEST.COM'} at 127.0.0.1:56436
I20260812 00:04:26.276711 6038 tablet_replica.cc:330] T 41a7f97045c4489d8eea9aa355b7590e P 5870757da61e462da82bf46ab1aa453a: stopping tablet replica
I20260812 00:04:26.276809 6037 tablet_replica.cc:330] T 41a7f97045c4489d8eea9aa355b7590e P 8bf8ca15e8a3411cae50308f35fdb5f9: stopping tablet replica
I20260812 00:04:26.276814 6038 raft_consensus.cc:2229] T 41a7f97045c4489d8eea9aa355b7590e P 5870757da61e462da82bf46ab1aa453a [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:04:26.276855 6037 raft_consensus.cc:2229] T 41a7f97045c4489d8eea9aa355b7590e P 8bf8ca15e8a3411cae50308f35fdb5f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:04:26.276841 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 5280
I20260812 00:04:26.276894 6037 raft_consensus.cc:2258] T 41a7f97045c4489d8eea9aa355b7590e P 8bf8ca15e8a3411cae50308f35fdb5f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:04:26.276901 6038 raft_consensus.cc:2258] T 41a7f97045c4489d8eea9aa355b7590e P 5870757da61e462da82bf46ab1aa453a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:04:26.277117 6039 tablet_replica.cc:330] T 41a7f97045c4489d8eea9aa355b7590e P cd851d45beeb4409be68b1bebbc28ca4: stopping tablet replica
I20260812 00:04:26.277196 6039 raft_consensus.cc:2229] T 41a7f97045c4489d8eea9aa355b7590e P cd851d45beeb4409be68b1bebbc28ca4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:04:26.277275 6039 raft_consensus.cc:2258] T 41a7f97045c4489d8eea9aa355b7590e P cd851d45beeb4409be68b1bebbc28ca4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:04:26.285175 6038 ts_tablet_manager.cc:1905] T 41a7f97045c4489d8eea9aa355b7590e P 5870757da61e462da82bf46ab1aa453a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:04:26.286790 6038 ts_tablet_manager.cc:1918] T 41a7f97045c4489d8eea9aa355b7590e P 5870757da61e462da82bf46ab1aa453a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:04:26.286886 6038 log.cc:1196] T 41a7f97045c4489d8eea9aa355b7590e P 5870757da61e462da82bf46ab1aa453a: Deleting WAL directory at /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-1/wal/wals/41a7f97045c4489d8eea9aa355b7590e
I20260812 00:04:26.287237 6038 ts_tablet_manager.cc:1939] T 41a7f97045c4489d8eea9aa355b7590e P 5870757da61e462da82bf46ab1aa453a: Deleting consensus metadata
I20260812 00:04:26.288183 5186 catalog_manager.cc:4841] TS 5870757da61e462da82bf46ab1aa453a (127.11.206.66:39635): tablet 41a7f97045c4489d8eea9aa355b7590e (table test-table [id=48f41ed321ea477abd2ac3bff88a6058]) successfully deleted
I20260812 00:04:26.291518 6039 ts_tablet_manager.cc:1905] T 41a7f97045c4489d8eea9aa355b7590e P cd851d45beeb4409be68b1bebbc28ca4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:04:26.293020 6039 ts_tablet_manager.cc:1918] T 41a7f97045c4489d8eea9aa355b7590e P cd851d45beeb4409be68b1bebbc28ca4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:04:26.293105 6039 log.cc:1196] T 41a7f97045c4489d8eea9aa355b7590e P cd851d45beeb4409be68b1bebbc28ca4: Deleting WAL directory at /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-2/wal/wals/41a7f97045c4489d8eea9aa355b7590e
I20260812 00:04:26.293438 6039 ts_tablet_manager.cc:1939] T 41a7f97045c4489d8eea9aa355b7590e P cd851d45beeb4409be68b1bebbc28ca4: Deleting consensus metadata
I20260812 00:04:26.293915 5186 catalog_manager.cc:4841] TS cd851d45beeb4409be68b1bebbc28ca4 (127.11.206.67:35673): tablet 41a7f97045c4489d8eea9aa355b7590e (table test-table [id=48f41ed321ea477abd2ac3bff88a6058]) successfully deleted
W20260812 00:04:26.297232 5187 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.206.65:39207 (error 108)
I20260812 00:04:26.297715 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 5545
I20260812 00:04:26.297761 6002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:26.297623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.65:39207 (local address 127.0.0.1:45368)
0812 00:04:26.297687 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:26.297730 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.65:39207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260812 00:04:26.300468 5187 catalog_manager.cc:4584] TS 8bf8ca15e8a3411cae50308f35fdb5f9 (127.11.206.65:39207): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 41a7f97045c4489d8eea9aa355b7590e: Network error: Client connection negotiation failed: client connection to 127.11.206.65:39207: connect: Connection refused (error 111)
I20260812 00:04:26.315143 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 5766
I20260812 00:04:26.329948 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 5157
I20260812 00:04:26.346226 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:39509
--webserver_interface=127.11.206.126
--webserver_port=44489
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab
--principal=kudu/127.11.206.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:46009
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.206.126:39509
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:04:26.427579 6041 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:04:26.427807 6041 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:04:26.427830 6041 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:04:26.428960 6041 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:04:26.429003 6041 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:04:26.429016 6041 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:04:26.429028 6041 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:04:26.429040 6041 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:04:26.430538 6041 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:46009
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.206.126:39509
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab
--principal=kudu/127.11.206.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:39509
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.206.126
--webserver_port=44489
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6041
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:04:26.430784 6041 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:04:26.431000 6041 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:04:26.435752 6047 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:26.435832 6046 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:26.435760 6052 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:26.435812 6041 server_base.cc:1034] running on GCE node
I20260812 00:04:26.436116 6041 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:04:26.436393 6041 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:04:26.437529 6041 hybrid_clock.cc:648] HybridClock initialized: now 1786493066437513 us; error 31 us; skew 500 ppm
Aug 12 00:04:26 dist-test-slave-f0tn krb5kdc[4164](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493066, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:04:26.439903 6041 init.cc:377] Logged in from keytab as kudu/127.11.206.126@KRBTEST.COM (short username kudu)
I20260812 00:04:26.440351 6041 webserver.cc:460] Webserver started at http://127.11.206.126:44489/ using document root <none> and password file <none>
I20260812 00:04:26.440551 6041 fs_manager.cc:359] Metadata directory not provided
I20260812 00:04:26.440595 6041 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:04:26.441939 6041 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 00:04:26.442571 6064 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:26.442739 6041 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 00:04:26.442826 6041 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/master-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/master-0/wal
uuid: "1659d7b29a0f4e7f8272846248919213"
format_stamp: "Formatted at 2026-08-12 00:04:24 on dist-test-slave-f0tn"
server_key: "bcea93e1a1422ea8f5fb0807dbb0923f"
server_key_iv: "bd079881b7a9ac2e8c43045bd2dfad9f"
server_key_version: "encryptionkey@0"
I20260812 00:04:26.443186 6041 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:04:26.470793 6041 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:04:26.472752 6041 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:04:26.472896 6041 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:04:26.476950 6041 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.126:39509
I20260812 00:04:26.476989 6157 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.126:39509 every 8 connection(s)
I20260812 00:04:26.477394 6041 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
I20260812 00:04:26.479017 6158 sys_catalog.cc:263] Verifying existing consensus state
I20260812 00:04:26.479746 6158 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1659d7b29a0f4e7f8272846248919213: Bootstrap starting.
I20260812 00:04:26.481637 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 6041
I20260812 00:04:26.482127 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.65:39207
--local_ip_for_outbound_sockets=127.11.206.65
--tserver_master_addrs=127.11.206.126:39509
--webserver_port=41705
--webserver_interface=127.11.206.65
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.65.keytab
--principal=kudu/127.11.206.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:46009
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:04:26.488670 6158 log.cc:824] T 00000000000000000000000000000000 P 1659d7b29a0f4e7f8272846248919213: Log is configured to *not* fsync() on all Append() calls
I20260812 00:04:26.491233 6158 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1659d7b29a0f4e7f8272846248919213: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 00:04:26.491556 6158 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1659d7b29a0f4e7f8272846248919213: Bootstrap complete.
I20260812 00:04:26.493842 6158 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1659d7b29a0f4e7f8272846248919213 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1659d7b29a0f4e7f8272846248919213" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 39509 } }
I20260812 00:04:26.494088 6158 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1659d7b29a0f4e7f8272846248919213 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1659d7b29a0f4e7f8272846248919213, State: Initialized, Role: FOLLOWER
I20260812 00:04:26.494248 6158 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1659d7b29a0f4e7f8272846248919213 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1659d7b29a0f4e7f8272846248919213" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 39509 } }
I20260812 00:04:26.494314 6158 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1659d7b29a0f4e7f8272846248919213 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:04:26.494359 6158 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1659d7b29a0f4e7f8272846248919213 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:04:26.494408 6158 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1659d7b29a0f4e7f8272846248919213 [term 2 FOLLOWER]: Advancing to term 3
I20260812 00:04:26.495579 6158 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1659d7b29a0f4e7f8272846248919213 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1659d7b29a0f4e7f8272846248919213" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 39509 } }
I20260812 00:04:26.495682 6158 leader_election.cc:302] T 00000000000000000000000000000000 P 1659d7b29a0f4e7f8272846248919213 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1659d7b29a0f4e7f8272846248919213; no voters:
I20260812 00:04:26.495865 6158 leader_election.cc:288] T 00000000000000000000000000000000 P 1659d7b29a0f4e7f8272846248919213 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260812 00:04:26.495925 6164 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1659d7b29a0f4e7f8272846248919213 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 00:04:26.496048 6164 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1659d7b29a0f4e7f8272846248919213 [term 3 LEADER]: Becoming Leader. State: Replica: 1659d7b29a0f4e7f8272846248919213, State: Running, Role: LEADER
I20260812 00:04:26.496168 6158 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1659d7b29a0f4e7f8272846248919213 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:04:26.496238 6164 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1659d7b29a0f4e7f8272846248919213 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1659d7b29a0f4e7f8272846248919213" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 39509 } }
I20260812 00:04:26.496522 6164 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1659d7b29a0f4e7f8272846248919213 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1659d7b29a0f4e7f8272846248919213. Latest consensus state: current_term: 3 leader_uuid: "1659d7b29a0f4e7f8272846248919213" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1659d7b29a0f4e7f8272846248919213" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 39509 } } }
I20260812 00:04:26.496618 6164 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1659d7b29a0f4e7f8272846248919213 [sys.catalog]: This master's current role is: LEADER
I20260812 00:04:26.496528 6167 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1659d7b29a0f4e7f8272846248919213 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "1659d7b29a0f4e7f8272846248919213" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1659d7b29a0f4e7f8272846248919213" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 39509 } } }
I20260812 00:04:26.496785 6167 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1659d7b29a0f4e7f8272846248919213 [sys.catalog]: This master's current role is: LEADER
I20260812 00:04:26.496814 6172 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:04:26.497750 6172 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:04:26.497867 6172 catalog_manager.cc:1259] Loaded cluster ID: 9afbe778840c438aa0fa3a841aad9829
I20260812 00:04:26.497905 6172 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260812 00:04:26.498147 6172 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f94b6d4c9ad google::LogMessage::Fail() at ??:0
@ 0x7f94b6d4f88a google::LogMessage::SendToLog() at ??:0
@ 0x7f94b6d4c4de google::LogMessage::Flush() at ??:0
@ 0x7f94b6d4da19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f94bec710f1 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7f94bec7a8b9 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f94b8c1a0d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f94b8c0f954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f94b9a736db start_thread at ??:0
@ 0x7f94b584a61f clone at ??:0
W20260812 00:04:26.581086 6161 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:04:26.581307 6161 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:04:26.581332 6161 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:04:26.582588 6161 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:04:26.582639 6161 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:04:26.582666 6161 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.65
I20260812 00:04:26.584208 6161 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:46009
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.65.keytab
--principal=kudu/127.11.206.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.65:39207
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.206.65
--webserver_port=41705
--tserver_master_addrs=127.11.206.126:39509
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6161
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.65
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:04:26.584451 6161 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:04:26.584688 6161 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:04:26.589860 6230 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:26.589860 6224 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:26.589949 6226 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:26.590234 6161 server_base.cc:1034] running on GCE node
I20260812 00:04:26.590449 6161 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:04:26.590696 6161 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:04:26.591882 6161 hybrid_clock.cc:648] HybridClock initialized: now 1786493066591862 us; error 35 us; skew 500 ppm
Aug 12 00:04:26 dist-test-slave-f0tn krb5kdc[4164](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493066, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:04:26.594697 6161 init.cc:377] Logged in from keytab as kudu/127.11.206.65@KRBTEST.COM (short username kudu)
I20260812 00:04:26.595220 6161 webserver.cc:460] Webserver started at http://127.11.206.65:41705/ using document root <none> and password file <none>
I20260812 00:04:26.595489 6161 fs_manager.cc:359] Metadata directory not provided
I20260812 00:04:26.595546 6161 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:04:26.596947 6161 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:04:26.597659 6240 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:26.597847 6161 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:04:26.597949 6161 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-0/wal
uuid: "8bf8ca15e8a3411cae50308f35fdb5f9"
format_stamp: "Formatted at 2026-08-12 00:04:24 on dist-test-slave-f0tn"
server_key: "05d05338f2911c1a0feb2e96fe301695"
server_key_iv: "02e94050a6480199525ea994ed79b485"
server_key_version: "encryptionkey@0"
I20260812 00:04:26.598469 6161 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:04:26.639424 6161 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:04:26.642154 6161 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:04:26.642328 6161 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:04:26.642628 6161 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:04:26.643198 6252 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260812 00:04:26.644723 6161 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 00:04:26.644783 6161 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260812 00:04:26.644815 6161 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260812 00:04:26.645768 6161 ts_tablet_manager.cc:610] Registered 1 tablets
I20260812 00:04:26.645814 6161 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260812 00:04:26.645918 6252 tablet_bootstrap.cc:492] T 41a7f97045c4489d8eea9aa355b7590e P 8bf8ca15e8a3411cae50308f35fdb5f9: Bootstrap starting.
I20260812 00:04:26.653134 6161 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.65:39207
I20260812 00:04:26.653343 6457 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.65:39207 every 8 connection(s)
I20260812 00:04:26.653649 6161 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
I20260812 00:04:26.656245 6252 log.cc:824] T 41a7f97045c4489d8eea9aa355b7590e P 8bf8ca15e8a3411cae50308f35fdb5f9: Log is configured to *not* fsync() on all Append() calls
I20260812 00:04:26.658392 6252 tablet_bootstrap.cc:492] T 41a7f97045c4489d8eea9aa355b7590e P 8bf8ca15e8a3411cae50308f35fdb5f9: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 00:04:26.658648 6252 tablet_bootstrap.cc:492] T 41a7f97045c4489d8eea9aa355b7590e P 8bf8ca15e8a3411cae50308f35fdb5f9: Bootstrap complete.
I20260812 00:04:26.658986 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 6161
I20260812 00:04:26.659255 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.66:39635
--local_ip_for_outbound_sockets=127.11.206.66
--tserver_master_addrs=127.11.206.126:39509
--webserver_port=45473
--webserver_interface=127.11.206.66
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.66.keytab
--principal=kudu/127.11.206.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:46009
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:04:26.659689 6252 ts_tablet_manager.cc:1397] T 41a7f97045c4489d8eea9aa355b7590e P 8bf8ca15e8a3411cae50308f35fdb5f9: Time spent bootstrapping tablet: real 0.014s user 0.005s sys 0.006s
I20260812 00:04:26.661020 6252 raft_consensus.cc:348] T 41a7f97045c4489d8eea9aa355b7590e P 8bf8ca15e8a3411cae50308f35fdb5f9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd851d45beeb4409be68b1bebbc28ca4" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 35673 } } peers { permanent_uuid: "5870757da61e462da82bf46ab1aa453a" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 39635 } } peers { permanent_uuid: "8bf8ca15e8a3411cae50308f35fdb5f9" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 39207 } }
I20260812 00:04:26.661273 6252 raft_consensus.cc:729] T 41a7f97045c4489d8eea9aa355b7590e P 8bf8ca15e8a3411cae50308f35fdb5f9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bf8ca15e8a3411cae50308f35fdb5f9, State: Initialized, Role: FOLLOWER
I20260812 00:04:26.661440 6252 consensus_queue.cc:260] T 41a7f97045c4489d8eea9aa355b7590e P 8bf8ca15e8a3411cae50308f35fdb5f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd851d45beeb4409be68b1bebbc28ca4" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 35673 } } peers { permanent_uuid: "5870757da61e462da82bf46ab1aa453a" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 39635 } } peers { permanent_uuid: "8bf8ca15e8a3411cae50308f35fdb5f9" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 39207 } }
I20260812 00:04:26.661726 6252 ts_tablet_manager.cc:1428] T 41a7f97045c4489d8eea9aa355b7590e P 8bf8ca15e8a3411cae50308f35fdb5f9: Time spent starting tablet: real 0.002s user 0.002s sys 0.002s
W20260812 00:04:26.692063 6460 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:04:26.654396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:39509 (local address 127.11.206.65:58699)
0812 00:04:26.654618 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:26.654683 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:26.655385 (+ 702us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:26.691852 (+ 36467us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:39509: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":101,"threads_started":1}
W20260812 00:04:26.692353 6458 heartbeater.cc:644] Failed to heartbeat to 127.11.206.126:39509 (0 consecutive failures): Network error: Failed to ping master at 127.11.206.126:39509: Client connection negotiation failed: client connection to 127.11.206.126:39509: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 00:04:26.692734 6460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:26.692610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:39509 (local address 127.11.206.65:59871)
0812 00:04:26.692664 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:26.692709 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:39509: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260812 00:04:26.693084 6460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:26.692980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:39509 (local address 127.11.206.65:60073)
0812 00:04:26.693028 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:26.693061 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:39509: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260812 00:04:26.693205 6458 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 00:04:26.744999 6463 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:04:26.745242 6463 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:04:26.745268 6463 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:04:26.746469 6463 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:04:26.746523 6463 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:04:26.746551 6463 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.66
I20260812 00:04:26.748059 6463 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:46009
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.66.keytab
--principal=kudu/127.11.206.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.66:39635
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.206.66
--webserver_port=45473
--tserver_master_addrs=127.11.206.126:39509
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6463
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.66
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:04:26.748297 6463 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:04:26.748528 6463 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:04:26.753645 6478 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:26.753669 6482 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:26.753710 6475 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:26.753803 6463 server_base.cc:1034] running on GCE node
I20260812 00:04:26.754009 6463 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:04:26.754271 6463 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:04:26.755424 6463 hybrid_clock.cc:648] HybridClock initialized: now 1786493066755404 us; error 33 us; skew 500 ppm
Aug 12 00:04:26 dist-test-slave-f0tn krb5kdc[4164](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493066, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:04:26.757985 6463 init.cc:377] Logged in from keytab as kudu/127.11.206.66@KRBTEST.COM (short username kudu)
I20260812 00:04:26.758431 6463 webserver.cc:460] Webserver started at http://127.11.206.66:45473/ using document root <none> and password file <none>
I20260812 00:04:26.758632 6463 fs_manager.cc:359] Metadata directory not provided
I20260812 00:04:26.758678 6463 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:04:26.759969 6463 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:04:26.760540 6494 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:26.760703 6463 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:26.760792 6463 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-1/wal
uuid: "5870757da61e462da82bf46ab1aa453a"
format_stamp: "Formatted at 2026-08-12 00:04:24 on dist-test-slave-f0tn"
server_key: "ddd599bae19a7be03e5bd7c70d605a05"
server_key_iv: "8c9000de5a93088a42fb3dc41300a32b"
server_key_version: "encryptionkey@0"
I20260812 00:04:26.761153 6463 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:04:26.793282 6463 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:04:26.795559 6463 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:04:26.795722 6463 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:04:26.795953 6463 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:04:26.796231 6463 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:04:26.796262 6463 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:26.796283 6463 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:04:26.796298 6463 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:26.801862 6463 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.66:39635
I20260812 00:04:26.801921 6687 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.66:39635 every 8 connection(s)
I20260812 00:04:26.802258 6463 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
I20260812 00:04:26.803371 6700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:26.802975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:39509 (local address 127.11.206.66:47105)
0812 00:04:26.803141 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:26.803225 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:39509: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":68,"threads_started":1}
W20260812 00:04:26.803755 6689 heartbeater.cc:644] Failed to heartbeat to 127.11.206.126:39509 (0 consecutive failures): Network error: Failed to ping master at 127.11.206.126:39509: Client connection negotiation failed: client connection to 127.11.206.126:39509: connect: Connection refused (error 111)
I20260812 00:04:26.804009 6700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:26.803924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:39509 (local address 127.11.206.66:36733)
0812 00:04:26.803963 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:26.803990 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:39509: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260812 00:04:26.804284 6700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:26.804219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:39509 (local address 127.11.206.66:41163)
0812 00:04:26.804249 (+ 30us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:26.804269 (+ 20us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:39509: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
W20260812 00:04:26.804365 6689 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260812 00:04:26.805594 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 6463
I20260812 00:04:26.805794 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.67:35673
--local_ip_for_outbound_sockets=127.11.206.67
--tserver_master_addrs=127.11.206.126:39509
--webserver_port=39029
--webserver_interface=127.11.206.67
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.67.keytab
--principal=kudu/127.11.206.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:46009
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:04:26.889205 6701 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:04:26.889453 6701 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:04:26.889478 6701 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:04:26.890645 6701 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:04:26.890697 6701 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:04:26.890722 6701 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.67
I20260812 00:04:26.892186 6701 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:46009
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.67.keytab
--principal=kudu/127.11.206.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.67:35673
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.206.67
--webserver_port=39029
--tserver_master_addrs=127.11.206.126:39509
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6701
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.67
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:04:26.892377 6701 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:04:26.892570 6701 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:04:26.897696 6716 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:26.897702 6721 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:26.897702 6715 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:26.897832 6701 server_base.cc:1034] running on GCE node
I20260812 00:04:26.898144 6701 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:04:26.898378 6701 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:04:26.899551 6701 hybrid_clock.cc:648] HybridClock initialized: now 1786493066899526 us; error 29 us; skew 500 ppm
Aug 12 00:04:26 dist-test-slave-f0tn krb5kdc[4164](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493066, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:04:26.902119 6701 init.cc:377] Logged in from keytab as kudu/127.11.206.67@KRBTEST.COM (short username kudu)
I20260812 00:04:26.902578 6701 webserver.cc:460] Webserver started at http://127.11.206.67:39029/ using document root <none> and password file <none>
I20260812 00:04:26.902824 6701 fs_manager.cc:359] Metadata directory not provided
I20260812 00:04:26.902875 6701 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:04:26.904232 6701 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 00:04:26.904860 6733 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:26.905009 6701 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 00:04:26.905085 6701 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-2/wal
uuid: "cd851d45beeb4409be68b1bebbc28ca4"
format_stamp: "Formatted at 2026-08-12 00:04:24 on dist-test-slave-f0tn"
server_key: "fb3247a3c16458cfb25b8bcfedeb3581"
server_key_iv: "3802561a17d2b387e3c8bf091e438d94"
server_key_version: "encryptionkey@0"
I20260812 00:04:26.905485 6701 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:04:26.913757 6701 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:04:26.915668 6701 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:04:26.915796 6701 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:04:26.916006 6701 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:04:26.916317 6701 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:04:26.916352 6701 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:26.916378 6701 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:04:26.916404 6701 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:26.922914 6701 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.67:35673
I20260812 00:04:26.922950 6937 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.67:35673 every 8 connection(s)
I20260812 00:04:26.923341 6701 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
I20260812 00:04:26.924486 6944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:26.923998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:39509 (local address 127.11.206.67:51783)
0812 00:04:26.924262 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:26.924343 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:39509: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":84,"threads_started":1}
W20260812 00:04:26.924865 6940 heartbeater.cc:644] Failed to heartbeat to 127.11.206.126:39509 (0 consecutive failures): Network error: Failed to ping master at 127.11.206.126:39509: Client connection negotiation failed: client connection to 127.11.206.126:39509: connect: Connection refused (error 111)
I20260812 00:04:26.925109 6944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:26.925028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:39509 (local address 127.11.206.67:47925)
0812 00:04:26.925066 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:26.925092 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:39509: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
I20260812 00:04:26.925338 6944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:26.925293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:39509 (local address 127.11.206.67:48593)
0812 00:04:26.925311 (+ 18us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:26.925327 (+ 16us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:39509: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":11}
W20260812 00:04:26.925434 6940 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260812 00:04:26.931236 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 6701
I20260812 00:04:27.693961 6947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:27.693697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:39509 (local address 127.11.206.65:58941)
0812 00:04:27.693840 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:27.693884 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:39509: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":85,"threads_started":1}
I20260812 00:04:27.804876 6948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:27.804680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:39509 (local address 127.11.206.66:59471)
0812 00:04:27.804789 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:27.804824 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:39509: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94,"thread_start_us":60,"threads_started":1}
I20260812 00:04:27.925911 6949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:27.925720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:39509 (local address 127.11.206.67:37343)
0812 00:04:27.925820 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:27.925858 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:39509: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84,"thread_start_us":55,"threads_started":1}
I20260812 00:04:28.425186 6950 raft_consensus.cc:482] T 41a7f97045c4489d8eea9aa355b7590e P 8bf8ca15e8a3411cae50308f35fdb5f9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:04:28.425313 6950 raft_consensus.cc:504] T 41a7f97045c4489d8eea9aa355b7590e P 8bf8ca15e8a3411cae50308f35fdb5f9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd851d45beeb4409be68b1bebbc28ca4" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 35673 } } peers { permanent_uuid: "5870757da61e462da82bf46ab1aa453a" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 39635 } } peers { permanent_uuid: "8bf8ca15e8a3411cae50308f35fdb5f9" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 39207 } }
I20260812 00:04:28.425691 6950 leader_election.cc:288] T 41a7f97045c4489d8eea9aa355b7590e P 8bf8ca15e8a3411cae50308f35fdb5f9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cd851d45beeb4409be68b1bebbc28ca4 (127.11.206.67:35673), 5870757da61e462da82bf46ab1aa453a (127.11.206.66:39635)
Aug 12 00:04:28 dist-test-slave-f0tn krb5kdc[4164](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493066, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.65@KRBTEST.COM for kudu/127.11.206.67@KRBTEST.COM
Aug 12 00:04:28 dist-test-slave-f0tn krb5kdc[4164](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493066, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.65@KRBTEST.COM for kudu/127.11.206.66@KRBTEST.COM
I20260812 00:04:28.436219 6954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:28.426090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.66:39635 (local address 127.11.206.65:36223)
0812 00:04:28.426269 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:28.426279 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:28.426338 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:28.427072 (+ 734us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:28.427075 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:28.427451 (+ 376us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:04:28.427630 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:28.427637 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:28.428719 (+ 1082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:28.428720 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:28.429620 (+ 900us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:28.429624 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:28.430204 (+ 580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:28.430205 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:28.430318 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:28.430852 (+ 534us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:04:28.430860 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:04:28.432775 (+ 1915us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:04:28.434659 (+ 1884us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:28.434660 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:28.434660 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:28.434821 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:28.435037 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:28.435038 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:28.435038 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:28.435096 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:28.435585 (+ 489us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:04:28.435594 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:04:28.435756 (+ 162us) client_negotiation.cc:769] Sending connection context
0812 00:04:28.435881 (+ 125us) client_negotiation.cc:240] Negotiation successful
0812 00:04:28.436054 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"mutex_wait_us":68,"thread_start_us":46,"threads_started":1}
I20260812 00:04:28.436224 6960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:28.425986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.65:41987 (local address 127.11.206.67:35673)
0812 00:04:28.426178 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:28.426193 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:28.426427 (+ 234us) server_negotiation.cc:407] Connection header received
0812 00:04:28.426875 (+ 448us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:28.426878 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:28.426916 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:28.427055 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:28.427747 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:28.428611 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:28.429721 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:28.430115 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:28.430221 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:28.432545 (+ 2324us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:28.432550 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:28.432550 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:04:28.432563 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:28.434366 (+ 1803us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:28.434762 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:28.434765 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:28.434766 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:28.434856 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:28.435136 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:28.435137 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:28.435138 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:28.435480 (+ 342us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:28.435589 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:28.435951 (+ 362us) server_negotiation.cc:299] Negotiation successful
0812 00:04:28.436100 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":68,"threads_started":1}
I20260812 00:04:28.436230 6962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:28.426229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.65:36223 (local address 127.11.206.66:39635)
0812 00:04:28.426354 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:28.426366 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:28.426392 (+ 26us) server_negotiation.cc:407] Connection header received
0812 00:04:28.426841 (+ 449us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:28.426843 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:28.426888 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:28.427007 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:28.427760 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:28.428606 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:28.429698 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:28.430121 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:28.430221 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:28.432869 (+ 2648us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:28.432872 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:28.432873 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:04:28.432883 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:28.434590 (+ 1707us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:28.434886 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:28.434888 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:28.434889 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:28.434980 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:28.435184 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:28.435185 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:28.435186 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:28.435480 (+ 294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:28.435589 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:28.435951 (+ 362us) server_negotiation.cc:299] Negotiation successful
0812 00:04:28.436130 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89,"thread_start_us":50,"threads_started":1}
I20260812 00:04:28.436268 6961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:28.425870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.67:35673 (local address 127.11.206.65:41987)
0812 00:04:28.426343 (+ 473us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:28.426354 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:28.426423 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:28.427073 (+ 650us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:28.427075 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:28.427450 (+ 375us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:04:28.427631 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:28.427637 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:28.428705 (+ 1068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:28.428706 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:28.429617 (+ 911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:28.429619 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:28.430205 (+ 586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:28.430206 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:28.430318 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:28.430896 (+ 578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:04:28.430901 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:04:28.432441 (+ 1540us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:04:28.434452 (+ 2011us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:28.434458 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:28.434460 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:28.434689 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:28.434919 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:28.434919 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:28.434919 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:28.435019 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:28.435585 (+ 566us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:04:28.435594 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:04:28.435756 (+ 162us) client_negotiation.cc:769] Sending connection context
0812 00:04:28.435881 (+ 125us) client_negotiation.cc:240] Negotiation successful
0812 00:04:28.436118 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":301,"mutex_wait_us":175,"thread_start_us":96,"threads_started":1}
W20260812 00:04:28.437139 6243 leader_election.cc:341] T 41a7f97045c4489d8eea9aa355b7590e P 8bf8ca15e8a3411cae50308f35fdb5f9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cd851d45beeb4409be68b1bebbc28ca4 (127.11.206.67:35673): Not found: Tablet not found: 41a7f97045c4489d8eea9aa355b7590e
W20260812 00:04:28.437247 6243 leader_election.cc:341] T 41a7f97045c4489d8eea9aa355b7590e P 8bf8ca15e8a3411cae50308f35fdb5f9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5870757da61e462da82bf46ab1aa453a (127.11.206.66:39635): Not found: Tablet not found: 41a7f97045c4489d8eea9aa355b7590e
I20260812 00:04:28.437291 6243 leader_election.cc:302] T 41a7f97045c4489d8eea9aa355b7590e P 8bf8ca15e8a3411cae50308f35fdb5f9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8bf8ca15e8a3411cae50308f35fdb5f9; no voters: 5870757da61e462da82bf46ab1aa453a, cd851d45beeb4409be68b1bebbc28ca4
I20260812 00:04:28.437420 6950 raft_consensus.cc:2726] T 41a7f97045c4489d8eea9aa355b7590e P 8bf8ca15e8a3411cae50308f35fdb5f9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 00:04:28.694649 6954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:28.694511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:39509 (local address 127.11.206.65:60057)
0812 00:04:28.694565 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:28.694608 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:39509: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260812 00:04:28.805680 6963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:28.805333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:39509 (local address 127.11.206.66:41429)
0812 00:04:28.805582 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:28.805624 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:39509: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":234,"thread_start_us":112,"threads_started":1}
I20260812 00:04:28.926566 6966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:28.926337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:39509 (local address 127.11.206.67:44429)
0812 00:04:28.926459 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:28.926502 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:39509: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":67,"threads_started":1}
I20260812 00:04:29.695355 6967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:29.695126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:39509 (local address 127.11.206.65:48661)
0812 00:04:29.695268 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:29.695308 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:39509: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":70,"threads_started":1}
I20260812 00:04:29.806262 6968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:29.806053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:39509 (local address 127.11.206.66:54561)
0812 00:04:29.806182 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:29.806220 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:39509: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":65,"threads_started":1}
I20260812 00:04:29.927240 6969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:29.926998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:39509 (local address 127.11.206.67:57651)
0812 00:04:29.927138 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:29.927196 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:39509: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":83,"threads_started":1}
I20260812 00:04:30.339422 6970 raft_consensus.cc:482] T 41a7f97045c4489d8eea9aa355b7590e P 8bf8ca15e8a3411cae50308f35fdb5f9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:04:30.339529 6970 raft_consensus.cc:504] T 41a7f97045c4489d8eea9aa355b7590e P 8bf8ca15e8a3411cae50308f35fdb5f9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd851d45beeb4409be68b1bebbc28ca4" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 35673 } } peers { permanent_uuid: "5870757da61e462da82bf46ab1aa453a" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 39635 } } peers { permanent_uuid: "8bf8ca15e8a3411cae50308f35fdb5f9" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 39207 } }
I20260812 00:04:30.339677 6970 leader_election.cc:288] T 41a7f97045c4489d8eea9aa355b7590e P 8bf8ca15e8a3411cae50308f35fdb5f9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cd851d45beeb4409be68b1bebbc28ca4 (127.11.206.67:35673), 5870757da61e462da82bf46ab1aa453a (127.11.206.66:39635)
W20260812 00:04:30.340173 6243 leader_election.cc:341] T 41a7f97045c4489d8eea9aa355b7590e P 8bf8ca15e8a3411cae50308f35fdb5f9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5870757da61e462da82bf46ab1aa453a (127.11.206.66:39635): Not found: Tablet not found: 41a7f97045c4489d8eea9aa355b7590e
W20260812 00:04:30.340243 6243 leader_election.cc:341] T 41a7f97045c4489d8eea9aa355b7590e P 8bf8ca15e8a3411cae50308f35fdb5f9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cd851d45beeb4409be68b1bebbc28ca4 (127.11.206.67:35673): Not found: Tablet not found: 41a7f97045c4489d8eea9aa355b7590e
I20260812 00:04:30.340261 6243 leader_election.cc:302] T 41a7f97045c4489d8eea9aa355b7590e P 8bf8ca15e8a3411cae50308f35fdb5f9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8bf8ca15e8a3411cae50308f35fdb5f9; no voters: 5870757da61e462da82bf46ab1aa453a, cd851d45beeb4409be68b1bebbc28ca4
I20260812 00:04:30.340349 6970 raft_consensus.cc:2726] T 41a7f97045c4489d8eea9aa355b7590e P 8bf8ca15e8a3411cae50308f35fdb5f9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 00:04:30.696044 6971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:30.695799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:39509 (local address 127.11.206.65:48097)
0812 00:04:30.695938 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:30.695975 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:39509: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":86,"threads_started":1}
I20260812 00:04:30.806938 6974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:30.806717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:39509 (local address 127.11.206.66:56883)
0812 00:04:30.806842 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:30.806881 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:39509: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":59,"threads_started":1}
I20260812 00:04:30.927956 6977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:30.927662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:39509 (local address 127.11.206.67:55385)
0812 00:04:30.927833 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:30.927878 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:39509: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":85,"threads_started":1}
I20260812 00:04:31.696740 6978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:31.696479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:39509 (local address 127.11.206.65:49107)
0812 00:04:31.696651 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:31.696693 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:39509: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":66,"threads_started":1}
I20260812 00:04:31.807637 6981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:31.807397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:39509 (local address 127.11.206.66:58699)
0812 00:04:31.807534 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:31.807591 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:39509: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":66,"threads_started":1}
I20260812 00:04:31.928608 6982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:31.928385 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:39509 (local address 127.11.206.67:50869)
0812 00:04:31.928528 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:31.928565 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:39509: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":62,"threads_started":1}
I20260812 00:04:32.697504 6984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:32.697265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:39509 (local address 127.11.206.65:56933)
0812 00:04:32.697408 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:32.697457 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:39509: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":65,"threads_started":1}
I20260812 00:04:32.808310 6987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:32.808064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:39509 (local address 127.11.206.66:32859)
0812 00:04:32.808201 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:32.808248 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:39509: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":69,"threads_started":1}
I20260812 00:04:32.929343 6989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:32.929087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:39509 (local address 127.11.206.67:36501)
0812 00:04:32.929258 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:32.929299 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:39509: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":84,"threads_started":1}
I20260812 00:04:33.067914 6992 raft_consensus.cc:482] T 41a7f97045c4489d8eea9aa355b7590e P 8bf8ca15e8a3411cae50308f35fdb5f9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:04:33.068014 6992 raft_consensus.cc:504] T 41a7f97045c4489d8eea9aa355b7590e P 8bf8ca15e8a3411cae50308f35fdb5f9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd851d45beeb4409be68b1bebbc28ca4" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 35673 } } peers { permanent_uuid: "5870757da61e462da82bf46ab1aa453a" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 39635 } } peers { permanent_uuid: "8bf8ca15e8a3411cae50308f35fdb5f9" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 39207 } }
I20260812 00:04:33.068194 6992 leader_election.cc:288] T 41a7f97045c4489d8eea9aa355b7590e P 8bf8ca15e8a3411cae50308f35fdb5f9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cd851d45beeb4409be68b1bebbc28ca4 (127.11.206.67:35673), 5870757da61e462da82bf46ab1aa453a (127.11.206.66:39635)
W20260812 00:04:33.068581 6243 leader_election.cc:341] T 41a7f97045c4489d8eea9aa355b7590e P 8bf8ca15e8a3411cae50308f35fdb5f9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5870757da61e462da82bf46ab1aa453a (127.11.206.66:39635): Not found: Tablet not found: 41a7f97045c4489d8eea9aa355b7590e
W20260812 00:04:33.068657 6243 leader_election.cc:341] T 41a7f97045c4489d8eea9aa355b7590e P 8bf8ca15e8a3411cae50308f35fdb5f9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cd851d45beeb4409be68b1bebbc28ca4 (127.11.206.67:35673): Not found: Tablet not found: 41a7f97045c4489d8eea9aa355b7590e
I20260812 00:04:33.068681 6243 leader_election.cc:302] T 41a7f97045c4489d8eea9aa355b7590e P 8bf8ca15e8a3411cae50308f35fdb5f9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8bf8ca15e8a3411cae50308f35fdb5f9; no voters: 5870757da61e462da82bf46ab1aa453a, cd851d45beeb4409be68b1bebbc28ca4
I20260812 00:04:33.068754 6992 raft_consensus.cc:2726] T 41a7f97045c4489d8eea9aa355b7590e P 8bf8ca15e8a3411cae50308f35fdb5f9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 00:04:33.698155 6993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:33.697920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:39509 (local address 127.11.206.65:33043)
0812 00:04:33.698042 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:33.698106 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:39509: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":67,"threads_started":1}
I20260812 00:04:33.808979 6997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:33.808771 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:39509 (local address 127.11.206.66:44153)
0812 00:04:33.808889 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:33.808931 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:39509: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":62,"threads_started":1}
I20260812 00:04:33.929996 6998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:33.929773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:39509 (local address 127.11.206.67:55471)
0812 00:04:33.929919 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:33.929953 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:39509: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":90,"threads_started":1}
I20260812 00:04:34.698861 6999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:34.698628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:39509 (local address 127.11.206.65:43435)
0812 00:04:34.698768 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:34.698810 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:39509: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":66,"threads_started":1}
I20260812 00:04:34.809675 7000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:34.809428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:39509 (local address 127.11.206.66:59737)
0812 00:04:34.809559 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:34.809593 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:39509: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":72,"threads_started":1}
I20260812 00:04:34.930661 7001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:34.930460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:39509 (local address 127.11.206.67:35375)
0812 00:04:34.930583 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:34.930617 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:39509: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":62,"threads_started":1}
I20260812 00:04:35.699527 7004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:35.699325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:39509 (local address 127.11.206.65:51279)
0812 00:04:35.699456 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:35.699481 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:39509: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":74,"threads_started":1}
I20260812 00:04:35.810348 7006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:35.810128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:39509 (local address 127.11.206.66:57671)
0812 00:04:35.810251 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:35.810297 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:39509: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":63,"threads_started":1}
I20260812 00:04:35.931294 7009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:35.931062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:39509 (local address 127.11.206.67:40315)
0812 00:04:35.931213 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:35.931251 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:39509: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":87,"threads_started":1}
I20260812 00:04:36.593132 7011 raft_consensus.cc:482] T 41a7f97045c4489d8eea9aa355b7590e P 8bf8ca15e8a3411cae50308f35fdb5f9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:04:36.593251 7011 raft_consensus.cc:504] T 41a7f97045c4489d8eea9aa355b7590e P 8bf8ca15e8a3411cae50308f35fdb5f9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd851d45beeb4409be68b1bebbc28ca4" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 35673 } } peers { permanent_uuid: "5870757da61e462da82bf46ab1aa453a" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 39635 } } peers { permanent_uuid: "8bf8ca15e8a3411cae50308f35fdb5f9" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 39207 } }
I20260812 00:04:36.593428 7011 leader_election.cc:288] T 41a7f97045c4489d8eea9aa355b7590e P 8bf8ca15e8a3411cae50308f35fdb5f9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cd851d45beeb4409be68b1bebbc28ca4 (127.11.206.67:35673), 5870757da61e462da82bf46ab1aa453a (127.11.206.66:39635)
W20260812 00:04:36.593875 6243 leader_election.cc:341] T 41a7f97045c4489d8eea9aa355b7590e P 8bf8ca15e8a3411cae50308f35fdb5f9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cd851d45beeb4409be68b1bebbc28ca4 (127.11.206.67:35673): Not found: Tablet not found: 41a7f97045c4489d8eea9aa355b7590e
W20260812 00:04:36.593952 6243 leader_election.cc:341] T 41a7f97045c4489d8eea9aa355b7590e P 8bf8ca15e8a3411cae50308f35fdb5f9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5870757da61e462da82bf46ab1aa453a (127.11.206.66:39635): Not found: Tablet not found: 41a7f97045c4489d8eea9aa355b7590e
I20260812 00:04:36.593967 6243 leader_election.cc:302] T 41a7f97045c4489d8eea9aa355b7590e P 8bf8ca15e8a3411cae50308f35fdb5f9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8bf8ca15e8a3411cae50308f35fdb5f9; no voters: 5870757da61e462da82bf46ab1aa453a, cd851d45beeb4409be68b1bebbc28ca4
I20260812 00:04:36.594030 7011 raft_consensus.cc:2726] T 41a7f97045c4489d8eea9aa355b7590e P 8bf8ca15e8a3411cae50308f35fdb5f9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 00:04:36.700315 7012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:36.700078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:39509 (local address 127.11.206.65:35337)
0812 00:04:36.700218 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:36.700267 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:39509: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":74,"threads_started":1}
I20260812 00:04:36.811035 7013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:36.810835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:39509 (local address 127.11.206.66:33583)
0812 00:04:36.810952 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:36.810985 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:39509: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":64,"threads_started":1}
I20260812 00:04:36.931943 7014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:36.931710 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:39509 (local address 127.11.206.67:43501)
0812 00:04:36.931841 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:36.931881 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:39509: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":62,"threads_started":1}
I20260812 00:04:37.701133 7016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:37.700846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:39509 (local address 127.11.206.65:56487)
0812 00:04:37.701007 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:37.701081 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:39509: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":69,"threads_started":1}
I20260812 00:04:37.811681 7020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:37.811477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:39509 (local address 127.11.206.66:39017)
0812 00:04:37.811585 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:37.811619 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:39509: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92,"thread_start_us":58,"threads_started":1}
I20260812 00:04:37.932657 7021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:37.932419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:39509 (local address 127.11.206.67:37147)
0812 00:04:37.932562 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:37.932600 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:39509: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":67,"threads_started":1}
I20260812 00:04:38.701819 7022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:38.701601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:39509 (local address 127.11.206.65:42639)
0812 00:04:38.701725 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:38.701762 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:39509: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":62,"threads_started":1}
I20260812 00:04:38.812283 7024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:38.812077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:39509 (local address 127.11.206.66:46847)
0812 00:04:38.812199 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:38.812236 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:39509: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":61,"threads_started":1}
I20260812 00:04:38.933373 7026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:38.933173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:39509 (local address 127.11.206.67:59309)
0812 00:04:38.933297 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:38.933329 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:39509: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":57,"threads_started":1}
I20260812 00:04:39.702538 7029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:39.702317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:39509 (local address 127.11.206.65:38731)
0812 00:04:39.702447 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:39.702488 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:39509: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":66,"threads_started":1}
I20260812 00:04:39.813024 7030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:39.812788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:39509 (local address 127.11.206.66:41485)
0812 00:04:39.812930 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:39.812975 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:39509: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":70,"threads_started":1}
I20260812 00:04:39.934079 7031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:39.933841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:39509 (local address 127.11.206.67:59027)
0812 00:04:39.933984 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:39.934032 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:39509: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":63,"threads_started":1}
I20260812 00:04:40.703161 7032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:40.702920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:39509 (local address 127.11.206.65:57975)
0812 00:04:40.703053 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:40.703089 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:39509: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":80,"threads_started":1}
I20260812 00:04:40.813692 7033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:40.813477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:39509 (local address 127.11.206.66:58921)
0812 00:04:40.813615 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:40.813647 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:39509: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":88,"threads_started":1}
I20260812 00:04:40.934724 7037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:40.934519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:39509 (local address 127.11.206.67:51657)
0812 00:04:40.934646 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:40.934681 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:39509: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":75,"threads_started":1}
I20260812 00:04:41.703893 7038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:41.703685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:39509 (local address 127.11.206.65:50427)
0812 00:04:41.703810 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:41.703847 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:39509: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":72,"threads_started":1}
I20260812 00:04:41.814411 7039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:41.814186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:39509 (local address 127.11.206.66:50229)
0812 00:04:41.814316 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:41.814361 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:39509: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":76,"threads_started":1}
I20260812 00:04:41.935002 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 6161
I20260812 00:04:41.940125 7040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:41.935229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:39509 (local address 127.11.206.67:49955)
0812 00:04:41.940016 (+ 4787us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:41.940068 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:39509: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":4763,"thread_start_us":71,"threads_started":1}
I20260812 00:04:41.979043 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 6463
I20260812 00:04:41.989728 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 6701
2026-08-12T00:04:41Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (18907 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:04:42 dist-test-slave-f0tn krb5kdc[7044](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:04:42 dist-test-slave-f0tn krb5kdc[7044](info): set up 2 sockets
Aug 12 00:04:42 dist-test-slave-f0tn krb5kdc[7044](info): commencing operation
krb5kdc: starting...
W20260812 00:04:43.180461 12089 mini_kdc.cc:121] Time spent starting KDC: real 1.166s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/krb5kdc/test-user.keytab.
Aug 12 00:04:43 dist-test-slave-f0tn krb5kdc[7044](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493083, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:04:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:04:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.206.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab.
Entry for principal kudu/127.11.206.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab.
I20260812 00:04:43.294219 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:38625
--webserver_interface=127.11.206.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab
--principal=kudu/127.11.206.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:40415
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.206.126:38625
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:04:43.375823 7068 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:04:43.376024 7068 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:04:43.376044 7068 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:04:43.377185 7068 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260812 00:04:43.377226 7068 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260812 00:04:43.377238 7068 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260812 00:04:43.377249 7068 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:04:43.377261 7068 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:04:43.377274 7068 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:04:43.377296 7068 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:04:43.377321 7068 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:04:43.378830 7068 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:40415
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.11.206.126:38625
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab
--principal=kudu/127.11.206.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:38625
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.206.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7068
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:04:43.379067 7068 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:04:43.379281 7068 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:04:43.384398 7079 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:43.384423 7075 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:43.384361 7074 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:43.384564 7068 server_base.cc:1034] running on GCE node
I20260812 00:04:43.384800 7068 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:04:43.385084 7068 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:04:43.386242 7068 hybrid_clock.cc:648] HybridClock initialized: now 1786493083386225 us; error 35 us; skew 500 ppm
Aug 12 00:04:43 dist-test-slave-f0tn krb5kdc[7044](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493083, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:04:43.388661 7068 init.cc:377] Logged in from keytab as kudu/127.11.206.126@KRBTEST.COM (short username kudu)
I20260812 00:04:43.389123 7068 webserver.cc:460] Webserver started at http://127.11.206.126:39517/ using document root <none> and password file <none>
I20260812 00:04:43.389324 7068 fs_manager.cc:359] Metadata directory not provided
I20260812 00:04:43.389371 7068 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:04:43.389524 7068 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:04:43.390564 7068 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/master-0/data/instance:
uuid: "7d2f9fecf22244cbaa8408406566baa6"
format_stamp: "Formatted at 2026-08-12 00:04:43 on dist-test-slave-f0tn"
server_key: "41ba2f9203c8c0f16f37c0074a5c56c9"
server_key_iv: "4fec244f546a79e4deffcd0f943a15b1"
server_key_version: "encryptionkey@0"
I20260812 00:04:43.390910 7068 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/master-0/wal/instance:
uuid: "7d2f9fecf22244cbaa8408406566baa6"
format_stamp: "Formatted at 2026-08-12 00:04:43 on dist-test-slave-f0tn"
server_key: "41ba2f9203c8c0f16f37c0074a5c56c9"
server_key_iv: "4fec244f546a79e4deffcd0f943a15b1"
server_key_version: "encryptionkey@0"
I20260812 00:04:43.392215 7068 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:04:43.392910 7092 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:43.393069 7068 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:04:43.393154 7068 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/master-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/master-0/wal
uuid: "7d2f9fecf22244cbaa8408406566baa6"
format_stamp: "Formatted at 2026-08-12 00:04:43 on dist-test-slave-f0tn"
server_key: "41ba2f9203c8c0f16f37c0074a5c56c9"
server_key_iv: "4fec244f546a79e4deffcd0f943a15b1"
server_key_version: "encryptionkey@0"
I20260812 00:04:43.393218 7068 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:04:43.401753 7068 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:04:43.403384 7068 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:04:43.403512 7068 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:04:43.407416 7068 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.126:38625
I20260812 00:04:43.407449 7184 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.126:38625 every 8 connection(s)
I20260812 00:04:43.407765 7068 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
I20260812 00:04:43.408578 7185 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:04:43.408908 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 7068
I20260812 00:04:43.409029 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/master-0/wal/instance
I20260812 00:04:43.409273 12089 external_mini_cluster.cc:1428] Setting key 6b9005b829e2eadb451dea2d60767ce3
I20260812 00:04:43.411551 7185 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7d2f9fecf22244cbaa8408406566baa6: Bootstrap starting.
I20260812 00:04:43.412200 7185 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7d2f9fecf22244cbaa8408406566baa6: Neither blocks nor log segments found. Creating new log.
I20260812 00:04:43.412477 7185 log.cc:824] T 00000000000000000000000000000000 P 7d2f9fecf22244cbaa8408406566baa6: Log is configured to *not* fsync() on all Append() calls
I20260812 00:04:43.413206 7185 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7d2f9fecf22244cbaa8408406566baa6: No bootstrap required, opened a new log
I20260812 00:04:43.415529 7185 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7d2f9fecf22244cbaa8408406566baa6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d2f9fecf22244cbaa8408406566baa6" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 38625 } }
I20260812 00:04:43.415673 7185 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7d2f9fecf22244cbaa8408406566baa6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:04:43.415695 7185 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7d2f9fecf22244cbaa8408406566baa6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2f9fecf22244cbaa8408406566baa6, State: Initialized, Role: FOLLOWER
Aug 12 00:04:43 dist-test-slave-f0tn krb5kdc[7044](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493083, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:04:43.415804 7185 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7d2f9fecf22244cbaa8408406566baa6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d2f9fecf22244cbaa8408406566baa6" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 38625 } }
I20260812 00:04:43.415872 7185 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7d2f9fecf22244cbaa8408406566baa6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:04:43.415906 7185 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7d2f9fecf22244cbaa8408406566baa6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:04:43.415948 7185 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7d2f9fecf22244cbaa8408406566baa6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:04:43.416464 7185 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7d2f9fecf22244cbaa8408406566baa6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d2f9fecf22244cbaa8408406566baa6" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 38625 } }
I20260812 00:04:43.416566 7185 leader_election.cc:302] T 00000000000000000000000000000000 P 7d2f9fecf22244cbaa8408406566baa6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7d2f9fecf22244cbaa8408406566baa6; no voters:
I20260812 00:04:43.416733 7185 leader_election.cc:288] T 00000000000000000000000000000000 P 7d2f9fecf22244cbaa8408406566baa6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:04:43.416772 7194 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7d2f9fecf22244cbaa8408406566baa6 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:04:43.416885 7194 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7d2f9fecf22244cbaa8408406566baa6 [term 1 LEADER]: Becoming Leader. State: Replica: 7d2f9fecf22244cbaa8408406566baa6, State: Running, Role: LEADER
I20260812 00:04:43.417004 7185 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7d2f9fecf22244cbaa8408406566baa6 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:04:43.417025 7194 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7d2f9fecf22244cbaa8408406566baa6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d2f9fecf22244cbaa8408406566baa6" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 38625 } }
I20260812 00:04:43.417665 7195 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7d2f9fecf22244cbaa8408406566baa6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7d2f9fecf22244cbaa8408406566baa6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d2f9fecf22244cbaa8408406566baa6" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 38625 } } }
I20260812 00:04:43.417666 7196 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7d2f9fecf22244cbaa8408406566baa6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7d2f9fecf22244cbaa8408406566baa6. Latest consensus state: current_term: 1 leader_uuid: "7d2f9fecf22244cbaa8408406566baa6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d2f9fecf22244cbaa8408406566baa6" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 38625 } } }
I20260812 00:04:43.417850 7195 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7d2f9fecf22244cbaa8408406566baa6 [sys.catalog]: This master's current role is: LEADER
I20260812 00:04:43.417876 7196 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7d2f9fecf22244cbaa8408406566baa6 [sys.catalog]: This master's current role is: LEADER
I20260812 00:04:43.418210 7200 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:04:43.418672 7200 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:04:43.420125 7189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:43.409813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34650 (local address 127.11.206.126:38625)
0812 00:04:43.409981 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:43.409989 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:43.410013 (+ 24us) server_negotiation.cc:407] Connection header received
0812 00:04:43.410404 (+ 391us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:43.410410 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:43.410455 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:43.410566 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:43.411304 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:43.412221 (+ 917us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:43.413185 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:43.413691 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:43.413778 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:43.416319 (+ 2541us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:43.416322 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:43.416323 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:04:43.416332 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:43.418361 (+ 2029us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:43.418768 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:43.418771 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:43.418772 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:43.418873 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:43.419081 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:43.419082 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:43.419082 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:43.419396 (+ 314us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:43.419565 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:43.419781 (+ 216us) server_negotiation.cc:299] Negotiation successful
0812 00:04:43.419917 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":66,"threads_started":1}
I20260812 00:04:43.420594 7200 catalog_manager.cc:1347] Generated new cluster ID: ca84d59e1d19460cb118af64f2c3e7f9
I20260812 00:04:43.420646 7200 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:04:43.434005 7200 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:04:43.434556 7200 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:04:43.436846 7200 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7d2f9fecf22244cbaa8408406566baa6: Generated new TSK 0
I20260812 00:04:43.437014 7200 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.206.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.65.keytab.
Entry for principal kudu/127.11.206.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.65.keytab.
I20260812 00:04:43.468036 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.65:0
--local_ip_for_outbound_sockets=127.11.206.65
--webserver_interface=127.11.206.65
--webserver_port=0
--tserver_master_addrs=127.11.206.126:38625
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.65.keytab
--principal=kudu/127.11.206.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:40415
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:04:43.568738 7225 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:04:43.568950 7225 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:04:43.568984 7225 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:04:43.570161 7225 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:04:43.570205 7225 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:04:43.570240 7225 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.65
I20260812 00:04:43.571751 7225 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:40415
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.65.keytab
--principal=kudu/127.11.206.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.206.65
--webserver_port=0
--tserver_master_addrs=127.11.206.126:38625
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7225
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.65
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:04:43.572005 7225 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:04:43.572225 7225 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 00:04:43.577334 7225 server_base.cc:1034] running on GCE node
W20260812 00:04:43.577337 7237 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:43.577306 7242 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:43.577306 7239 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:43.577832 7225 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:04:43.578068 7225 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:04:43.579217 7225 hybrid_clock.cc:648] HybridClock initialized: now 1786493083579203 us; error 35 us; skew 500 ppm
Aug 12 00:04:43 dist-test-slave-f0tn krb5kdc[7044](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493083, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:04:43.581955 7225 init.cc:377] Logged in from keytab as kudu/127.11.206.65@KRBTEST.COM (short username kudu)
I20260812 00:04:43.582412 7225 webserver.cc:460] Webserver started at http://127.11.206.65:43343/ using document root <none> and password file <none>
I20260812 00:04:43.582646 7225 fs_manager.cc:359] Metadata directory not provided
I20260812 00:04:43.582695 7225 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:04:43.582823 7225 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:04:43.583895 7225 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-0/data/instance:
uuid: "f4d8d8d0958e4137ba9aa4b11fb6a256"
format_stamp: "Formatted at 2026-08-12 00:04:43 on dist-test-slave-f0tn"
server_key: "7314ca9aa040922a0d6d83a53294dc20"
server_key_iv: "8318863b460a508ccf07c0ace85b1fae"
server_key_version: "encryptionkey@0"
I20260812 00:04:43.584232 7225 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-0/wal/instance:
uuid: "f4d8d8d0958e4137ba9aa4b11fb6a256"
format_stamp: "Formatted at 2026-08-12 00:04:43 on dist-test-slave-f0tn"
server_key: "7314ca9aa040922a0d6d83a53294dc20"
server_key_iv: "8318863b460a508ccf07c0ace85b1fae"
server_key_version: "encryptionkey@0"
I20260812 00:04:43.585481 7225 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 00:04:43.586184 7252 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:43.586339 7225 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:04:43.586423 7225 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-0/wal
uuid: "f4d8d8d0958e4137ba9aa4b11fb6a256"
format_stamp: "Formatted at 2026-08-12 00:04:43 on dist-test-slave-f0tn"
server_key: "7314ca9aa040922a0d6d83a53294dc20"
server_key_iv: "8318863b460a508ccf07c0ace85b1fae"
server_key_version: "encryptionkey@0"
I20260812 00:04:43.586488 7225 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:04:43.603068 7225 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:04:43.605016 7225 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:04:43.605167 7225 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:04:43.605453 7225 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:04:43.605767 7225 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:04:43.605801 7225 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:43.605830 7225 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:04:43.605863 7225 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:43.611219 7225 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.65:42235
I20260812 00:04:43.611263 7439 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.65:42235 every 8 connection(s)
I20260812 00:04:43.611574 7225 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
I20260812 00:04:43.613533 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 7225
I20260812 00:04:43.613667 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-0/wal/instance
I20260812 00:04:43.613873 12089 external_mini_cluster.cc:1428] Setting key 593ee0b08a6ab8002747a98f18bef60a
Aug 12 00:04:43 dist-test-slave-f0tn krb5kdc[7044](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493083, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.65@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:04:43.621505 7189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:43.612277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.65:51047 (local address 127.11.206.126:38625)
0812 00:04:43.612336 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:43.612338 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:43.612515 (+ 177us) server_negotiation.cc:407] Connection header received
0812 00:04:43.613015 (+ 500us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:43.613016 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:43.613028 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:43.613081 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:43.614312 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:43.614857 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:43.615884 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:43.616108 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:43.616169 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:43.618724 (+ 2555us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:43.618726 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:43.618726 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:04:43.618733 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:43.620055 (+ 1322us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:43.620544 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:43.620545 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:43.620545 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:43.620599 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:43.620856 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:43.620856 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:43.620856 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:43.620955 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:43.620998 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:43.621324 (+ 326us) server_negotiation.cc:299] Negotiation successful
0812 00:04:43.621434 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260812 00:04:43.621734 7447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:43.612248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:38625 (local address 127.11.206.65:51047)
0812 00:04:43.612400 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:43.612436 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:43.612918 (+ 482us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:43.613152 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:43.613156 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:43.613965 (+ 809us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:04:43.614228 (+ 263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:43.614235 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:43.614941 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:43.614942 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:43.615793 (+ 851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:43.615798 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:43.616189 (+ 391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:43.616190 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:43.616338 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:43.616901 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:04:43.616912 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:04:43.618619 (+ 1707us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:04:43.620166 (+ 1547us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:43.620173 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:43.620176 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:43.620475 (+ 299us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:43.620660 (+ 185us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:43.620661 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:43.620661 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:43.620797 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:43.621009 (+ 212us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:04:43.621015 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:04:43.621179 (+ 164us) client_negotiation.cc:769] Sending connection context
0812 00:04:43.621300 (+ 121us) client_negotiation.cc:240] Negotiation successful
0812 00:04:43.621492 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":71,"threads_started":1}
I20260812 00:04:43.622370 7444 heartbeater.cc:347] Connected to a master server at 127.11.206.126:38625
I20260812 00:04:43.622478 7444 heartbeater.cc:464] Registering TS with master...
I20260812 00:04:43.622682 7444 heartbeater.cc:511] Master 127.11.206.126:38625 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.11.206.66@KRBTEST.COM; defaulting to no policy
I20260812 00:04:43.623170 7119 ts_manager.cc:194] Registered new tserver with Master: f4d8d8d0958e4137ba9aa4b11fb6a256 (127.11.206.65:42235)
I20260812 00:04:43.623811 7119 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.206.65@KRBTEST.COM'} at 127.11.206.65:51047
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.66.keytab.
Entry for principal kudu/127.11.206.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.66.keytab.
I20260812 00:04:43.638139 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.66:0
--local_ip_for_outbound_sockets=127.11.206.66
--webserver_interface=127.11.206.66
--webserver_port=0
--tserver_master_addrs=127.11.206.126:38625
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.66.keytab
--principal=kudu/127.11.206.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:40415
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:04:43.718677 7450 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:04:43.718878 7450 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:04:43.718900 7450 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:04:43.720022 7450 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:04:43.720060 7450 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:04:43.720085 7450 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.66
I20260812 00:04:43.721508 7450 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:40415
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.66.keytab
--principal=kudu/127.11.206.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.206.66
--webserver_port=0
--tserver_master_addrs=127.11.206.126:38625
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7450
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.66
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:04:43.721704 7450 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:04:43.721903 7450 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:04:43.726693 7459 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:43.726684 7465 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:43.726748 7462 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:43.726764 7450 server_base.cc:1034] running on GCE node
I20260812 00:04:43.727093 7450 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:04:43.727349 7450 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:04:43.728488 7450 hybrid_clock.cc:648] HybridClock initialized: now 1786493083728476 us; error 30 us; skew 500 ppm
Aug 12 00:04:43 dist-test-slave-f0tn krb5kdc[7044](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493083, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:04:43.730975 7450 init.cc:377] Logged in from keytab as kudu/127.11.206.66@KRBTEST.COM (short username kudu)
I20260812 00:04:43.731379 7450 webserver.cc:460] Webserver started at http://127.11.206.66:36945/ using document root <none> and password file <none>
I20260812 00:04:43.731602 7450 fs_manager.cc:359] Metadata directory not provided
I20260812 00:04:43.731655 7450 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:04:43.731786 7450 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:04:43.732841 7450 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-1/data/instance:
uuid: "ad0579eb47574d1c9ac95e43e57aaa2e"
format_stamp: "Formatted at 2026-08-12 00:04:43 on dist-test-slave-f0tn"
server_key: "7e25b54933d1ce01d206981093ec0610"
server_key_iv: "0203e6efb12bd9c8efc6dd8afbd1f798"
server_key_version: "encryptionkey@0"
I20260812 00:04:43.733177 7450 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-1/wal/instance:
uuid: "ad0579eb47574d1c9ac95e43e57aaa2e"
format_stamp: "Formatted at 2026-08-12 00:04:43 on dist-test-slave-f0tn"
server_key: "7e25b54933d1ce01d206981093ec0610"
server_key_iv: "0203e6efb12bd9c8efc6dd8afbd1f798"
server_key_version: "encryptionkey@0"
I20260812 00:04:43.734431 7450 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:04:43.735081 7476 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:43.735214 7450 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:04:43.735297 7450 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-1/wal
uuid: "ad0579eb47574d1c9ac95e43e57aaa2e"
format_stamp: "Formatted at 2026-08-12 00:04:43 on dist-test-slave-f0tn"
server_key: "7e25b54933d1ce01d206981093ec0610"
server_key_iv: "0203e6efb12bd9c8efc6dd8afbd1f798"
server_key_version: "encryptionkey@0"
I20260812 00:04:43.735358 7450 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:04:43.748291 7450 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:04:43.750077 7450 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:04:43.750212 7450 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:04:43.750412 7450 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:04:43.750707 7450 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:04:43.750741 7450 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:43.750768 7450 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:04:43.750787 7450 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:43.756210 7450 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.66:37711
I20260812 00:04:43.756256 7677 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.66:37711 every 8 connection(s)
I20260812 00:04:43.756563 7450 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
Aug 12 00:04:43 dist-test-slave-f0tn krb5kdc[7044](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493083, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.66@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:04:43.762813 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 7450
I20260812 00:04:43.762905 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-1/wal/instance
I20260812 00:04:43.763073 12089 external_mini_cluster.cc:1428] Setting key 540f9f6319fbe42bf82cb23ab9c62c3a
I20260812 00:04:43.765282 7189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:43.757255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.66:38375 (local address 127.11.206.126:38625)
0812 00:04:43.757315 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:43.757317 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:43.757537 (+ 220us) server_negotiation.cc:407] Connection header received
0812 00:04:43.758010 (+ 473us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:43.758011 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:43.758020 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:43.758076 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:43.758976 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:43.759470 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:43.760423 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:43.760601 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:43.760649 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:43.762727 (+ 2078us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:43.762729 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:43.762729 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:04:43.762735 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:43.764043 (+ 1308us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:43.764418 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:43.764420 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:43.764420 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:43.764472 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:43.764687 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:43.764688 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:43.764688 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:43.764796 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:43.764852 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:43.765112 (+ 260us) server_negotiation.cc:299] Negotiation successful
0812 00:04:43.765193 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260812 00:04:43.765548 7689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:43.757223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:38625 (local address 127.11.206.66:38375)
0812 00:04:43.757411 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:43.757454 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:43.757930 (+ 476us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:43.758136 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:43.758145 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:43.758702 (+ 557us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:04:43.758897 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:43.758902 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:43.759537 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:43.759538 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:43.760357 (+ 819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:43.760359 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:43.760666 (+ 307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:43.760667 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:43.760768 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:43.761215 (+ 447us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:04:43.761222 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:04:43.762615 (+ 1393us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:04:43.764114 (+ 1499us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:43.764121 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:43.764123 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:43.764351 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:43.764526 (+ 175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:43.764527 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:43.764527 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:43.764632 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:43.764851 (+ 219us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:04:43.764858 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:04:43.764994 (+ 136us) client_negotiation.cc:769] Sending connection context
0812 00:04:43.765084 (+ 90us) client_negotiation.cc:240] Negotiation successful
0812 00:04:43.765250 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":71,"threads_started":1}
I20260812 00:04:43.765991 7679 heartbeater.cc:347] Connected to a master server at 127.11.206.126:38625
I20260812 00:04:43.766083 7679 heartbeater.cc:464] Registering TS with master...
I20260812 00:04:43.766261 7679 heartbeater.cc:511] Master 127.11.206.126:38625 requested a full tablet report, sending...
I20260812 00:04:43.766634 7119 ts_manager.cc:194] Registered new tserver with Master: ad0579eb47574d1c9ac95e43e57aaa2e (127.11.206.66:37711)
I20260812 00:04:43.767102 7119 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.206.66@KRBTEST.COM'} at 127.11.206.66:38375
WARNING: no policy specified for kudu/127.11.206.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.67.keytab.
Entry for principal kudu/127.11.206.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.67.keytab.
I20260812 00:04:43.788486 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.67:0
--local_ip_for_outbound_sockets=127.11.206.67
--webserver_interface=127.11.206.67
--webserver_port=0
--tserver_master_addrs=127.11.206.126:38625
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.67.keytab
--principal=kudu/127.11.206.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:40415
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:04:43.869923 7692 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:04:43.870123 7692 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:04:43.870146 7692 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:04:43.871236 7692 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:04:43.871274 7692 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:04:43.871299 7692 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.67
I20260812 00:04:43.872718 7692 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:40415
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.67.keytab
--principal=kudu/127.11.206.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.206.67
--webserver_port=0
--tserver_master_addrs=127.11.206.126:38625
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7692
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.67
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:04:43.872898 7692 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:04:43.873103 7692 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:04:43.878075 7700 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:43.878082 7702 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:04:43.878101 7704 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:04:43.878134 7692 server_base.cc:1034] running on GCE node
I20260812 00:04:43.878528 7692 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:04:43.878774 7692 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:04:43.879910 7692 hybrid_clock.cc:648] HybridClock initialized: now 1786493083879899 us; error 29 us; skew 500 ppm
Aug 12 00:04:43 dist-test-slave-f0tn krb5kdc[7044](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493083, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:04:43.882416 7692 init.cc:377] Logged in from keytab as kudu/127.11.206.67@KRBTEST.COM (short username kudu)
I20260812 00:04:43.882830 7692 webserver.cc:460] Webserver started at http://127.11.206.67:44303/ using document root <none> and password file <none>
I20260812 00:04:43.883054 7692 fs_manager.cc:359] Metadata directory not provided
I20260812 00:04:43.883102 7692 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:04:43.883225 7692 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:04:43.884222 7692 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-2/data/instance:
uuid: "e993531ff48748e79f91e14c16d46ece"
format_stamp: "Formatted at 2026-08-12 00:04:43 on dist-test-slave-f0tn"
server_key: "36e5655dd3d2d91834129e1ae48a6800"
server_key_iv: "c113d41ebff120c6d0cd3e1ccd2f27f8"
server_key_version: "encryptionkey@0"
I20260812 00:04:43.884552 7692 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-2/wal/instance:
uuid: "e993531ff48748e79f91e14c16d46ece"
format_stamp: "Formatted at 2026-08-12 00:04:43 on dist-test-slave-f0tn"
server_key: "36e5655dd3d2d91834129e1ae48a6800"
server_key_iv: "c113d41ebff120c6d0cd3e1ccd2f27f8"
server_key_version: "encryptionkey@0"
I20260812 00:04:43.885991 7692 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 00:04:43.886703 7714 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:43.886873 7692 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:43.886955 7692 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-2/wal
uuid: "e993531ff48748e79f91e14c16d46ece"
format_stamp: "Formatted at 2026-08-12 00:04:43 on dist-test-slave-f0tn"
server_key: "36e5655dd3d2d91834129e1ae48a6800"
server_key_iv: "c113d41ebff120c6d0cd3e1ccd2f27f8"
server_key_version: "encryptionkey@0"
I20260812 00:04:43.887014 7692 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:04:43.898643 7692 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:04:43.900451 7692 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:04:43.900589 7692 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:04:43.900807 7692 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:04:43.901093 7692 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:04:43.901126 7692 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:43.901157 7692 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:04:43.901175 7692 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:04:43.906780 7692 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.67:44219
I20260812 00:04:43.906818 7912 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.67:44219 every 8 connection(s)
I20260812 00:04:43.907128 7692 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
Aug 12 00:04:43 dist-test-slave-f0tn krb5kdc[7044](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493083, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.67@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:04:43.913661 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 7692
I20260812 00:04:43.913784 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-2/wal/instance
I20260812 00:04:43.913975 12089 external_mini_cluster.cc:1428] Setting key 1ccf4f77f9f8f3321e38b430cea0422a
I20260812 00:04:43.916131 7189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:43.907826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.67:49061 (local address 127.11.206.126:38625)
0812 00:04:43.907871 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:43.907873 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:43.908135 (+ 262us) server_negotiation.cc:407] Connection header received
0812 00:04:43.908578 (+ 443us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:43.908579 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:43.908591 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:43.908681 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:43.909655 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:43.910170 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:43.911131 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:43.911323 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:43.911373 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:43.913304 (+ 1931us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:43.913305 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:43.913305 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:04:43.913312 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:43.914922 (+ 1610us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:43.915293 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:43.915294 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:43.915295 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:43.915364 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:43.915583 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:43.915584 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:43.915584 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:43.915711 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:43.915776 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:43.915991 (+ 215us) server_negotiation.cc:299] Negotiation successful
0812 00:04:43.916063 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 00:04:43.916266 7919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:43.907800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:38625 (local address 127.11.206.67:49061)
0812 00:04:43.907955 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:43.907999 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:43.908466 (+ 467us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:43.908740 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:43.908743 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:43.909313 (+ 570us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:04:43.909571 (+ 258us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:43.909577 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:43.910240 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:43.910241 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:43.911055 (+ 814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:43.911058 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:43.911382 (+ 324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:43.911383 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:43.911477 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:43.911893 (+ 416us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:04:43.911901 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:04:43.913224 (+ 1323us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:04:43.914982 (+ 1758us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:43.914988 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:43.914990 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:43.915207 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:43.915431 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:04:43.915431 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:04:43.915432 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:04:43.915538 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:04:43.915771 (+ 233us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:04:43.915774 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:04:43.915891 (+ 117us) client_negotiation.cc:769] Sending connection context
0812 00:04:43.915968 (+ 77us) client_negotiation.cc:240] Negotiation successful
0812 00:04:43.916087 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":68,"threads_started":1}
I20260812 00:04:43.916709 7913 heartbeater.cc:347] Connected to a master server at 127.11.206.126:38625
I20260812 00:04:43.916810 7913 heartbeater.cc:464] Registering TS with master...
I20260812 00:04:43.916994 7913 heartbeater.cc:511] Master 127.11.206.126:38625 requested a full tablet report, sending...
I20260812 00:04:43.917424 7119 ts_manager.cc:194] Registered new tserver with Master: e993531ff48748e79f91e14c16d46ece (127.11.206.67:44219)
I20260812 00:04:43.917832 7119 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.206.67@KRBTEST.COM'} at 127.11.206.67:49061
I20260812 00:04:43.925694 12089 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:04:43.934316 7189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:43.926953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34662 (local address 127.11.206.126:38625)
0812 00:04:43.927008 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:43.927010 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:43.927070 (+ 60us) server_negotiation.cc:407] Connection header received
0812 00:04:43.927136 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:43.927137 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:43.927146 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:43.927192 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:04:43.927832 (+ 640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:43.928581 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:43.929620 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:43.929910 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:43.929974 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:43.931410 (+ 1436us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:04:43.931412 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:04:43.931412 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:04:43.931419 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:04:43.933059 (+ 1640us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:43.933486 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:43.933487 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:43.933487 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:43.933548 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:04:43.933743 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:04:43.933744 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:04:43.933744 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:04:43.933936 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:04:43.934034 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:43.934144 (+ 110us) server_negotiation.cc:299] Negotiation successful
0812 00:04:43.934226 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260812 00:04:43.936365 7119 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34662:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:04:43.938136 7119 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:04:43.944235 7932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:43.940273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.65:42235 (local address 127.0.0.1:33662)
0812 00:04:43.940406 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:43.940447 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:43.940507 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:43.940804 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:43.940808 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:43.940810 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:04:43.940878 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:43.940880 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:43.942033 (+ 1153us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:43.942034 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:43.943116 (+ 1082us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:43.943119 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:43.943957 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:43.943958 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:43.944032 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:43.944046 (+ 14us) client_negotiation.cc:769] Sending connection context
0812 00:04:43.944109 (+ 63us) client_negotiation.cc:240] Negotiation successful
0812 00:04:43.944164 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":51,"threads_started":1}
I20260812 00:04:43.944255 7933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:43.940411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33662 (local address 127.11.206.65:42235)
0812 00:04:43.940575 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:43.940580 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:43.940590 (+ 10us) server_negotiation.cc:407] Connection header received
0812 00:04:43.940629 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:43.940632 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:43.940649 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:43.940731 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:04:43.941096 (+ 365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:43.941943 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:43.943209 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:43.943889 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:43.943947 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:43.944008 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:43.944142 (+ 134us) server_negotiation.cc:299] Negotiation successful
0812 00:04:43.944180 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":74,"threads_started":1}
I20260812 00:04:43.944547 7931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:43.940274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.67:44219 (local address 127.0.0.1:36798)
0812 00:04:43.940771 (+ 497us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:43.940781 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:43.940837 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:43.940986 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:43.940986 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:43.940988 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:04:43.941031 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:43.941032 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:43.942526 (+ 1494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:43.942527 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:43.943441 (+ 914us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:43.943444 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:43.944312 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:43.944313 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:43.944383 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:43.944388 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 00:04:43.944437 (+ 49us) client_negotiation.cc:240] Negotiation successful
0812 00:04:43.944474 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":483,"mutex_wait_us":35,"thread_start_us":78,"threads_started":1}
I20260812 00:04:43.944599 7939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:43.940584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36798 (local address 127.11.206.67:44219)
0812 00:04:43.940768 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:43.940772 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:43.940826 (+ 54us) server_negotiation.cc:407] Connection header received
0812 00:04:43.940899 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:43.940902 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:43.940917 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:43.940993 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:04:43.941161 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:43.942408 (+ 1247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:43.943512 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:43.944154 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:43.944221 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:43.944273 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:43.944468 (+ 195us) server_negotiation.cc:299] Negotiation successful
0812 00:04:43.944510 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":104,"threads_started":1}
I20260812 00:04:43.945035 7937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:43.940466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.66:37711 (local address 127.0.0.1:55266)
0812 00:04:43.940823 (+ 357us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:43.940832 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:43.940868 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:43.941276 (+ 408us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:43.941277 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:43.941280 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:04:43.941321 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:43.941322 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:43.942567 (+ 1245us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:43.942568 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:43.943657 (+ 1089us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:43.943660 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:43.944801 (+ 1141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:43.944802 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:43.944862 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:43.944867 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 00:04:43.944930 (+ 63us) client_negotiation.cc:240] Negotiation successful
0812 00:04:43.944966 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":342,"mutex_wait_us":20,"thread_start_us":70,"threads_started":1}
I20260812 00:04:43.945153 7941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:43.940651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55266 (local address 127.11.206.66:37711)
0812 00:04:43.941052 (+ 401us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:43.941055 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:43.941064 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:04:43.941100 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:43.941101 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:43.941115 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:43.941196 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:04:43.941412 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:43.942466 (+ 1054us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:43.943736 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:43.944558 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:43.944779 (+ 221us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:43.944834 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:43.944944 (+ 110us) server_negotiation.cc:299] Negotiation successful
0812 00:04:43.944984 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":363,"thread_start_us":78,"threads_started":1}
I20260812 00:04:43.945269 7334 tablet_service.cc:1467] Processing CreateTablet for tablet 0e3d51dd34fa43e8b83ecdd4242659cb (DEFAULT_TABLE table=test-table [id=db72ef200570413684d4ebc97b433273]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:04:43.945302 7795 tablet_service.cc:1467] Processing CreateTablet for tablet 0e3d51dd34fa43e8b83ecdd4242659cb (DEFAULT_TABLE table=test-table [id=db72ef200570413684d4ebc97b433273]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:04:43.945653 7334 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e3d51dd34fa43e8b83ecdd4242659cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:04:43.945672 7795 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e3d51dd34fa43e8b83ecdd4242659cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:04:43.945792 7565 tablet_service.cc:1467] Processing CreateTablet for tablet 0e3d51dd34fa43e8b83ecdd4242659cb (DEFAULT_TABLE table=test-table [id=db72ef200570413684d4ebc97b433273]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:04:43.946060 7565 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e3d51dd34fa43e8b83ecdd4242659cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:04:43.948315 7942 tablet_bootstrap.cc:492] T 0e3d51dd34fa43e8b83ecdd4242659cb P f4d8d8d0958e4137ba9aa4b11fb6a256: Bootstrap starting.
I20260812 00:04:43.948916 7942 tablet_bootstrap.cc:654] T 0e3d51dd34fa43e8b83ecdd4242659cb P f4d8d8d0958e4137ba9aa4b11fb6a256: Neither blocks nor log segments found. Creating new log.
I20260812 00:04:43.948958 7945 tablet_bootstrap.cc:492] T 0e3d51dd34fa43e8b83ecdd4242659cb P ad0579eb47574d1c9ac95e43e57aaa2e: Bootstrap starting.
I20260812 00:04:43.949008 7944 tablet_bootstrap.cc:492] T 0e3d51dd34fa43e8b83ecdd4242659cb P e993531ff48748e79f91e14c16d46ece: Bootstrap starting.
I20260812 00:04:43.949592 7945 tablet_bootstrap.cc:654] T 0e3d51dd34fa43e8b83ecdd4242659cb P ad0579eb47574d1c9ac95e43e57aaa2e: Neither blocks nor log segments found. Creating new log.
I20260812 00:04:43.949571 7942 log.cc:824] T 0e3d51dd34fa43e8b83ecdd4242659cb P f4d8d8d0958e4137ba9aa4b11fb6a256: Log is configured to *not* fsync() on all Append() calls
I20260812 00:04:43.949673 7944 tablet_bootstrap.cc:654] T 0e3d51dd34fa43e8b83ecdd4242659cb P e993531ff48748e79f91e14c16d46ece: Neither blocks nor log segments found. Creating new log.
I20260812 00:04:43.950176 7945 log.cc:824] T 0e3d51dd34fa43e8b83ecdd4242659cb P ad0579eb47574d1c9ac95e43e57aaa2e: Log is configured to *not* fsync() on all Append() calls
I20260812 00:04:43.950186 7944 log.cc:824] T 0e3d51dd34fa43e8b83ecdd4242659cb P e993531ff48748e79f91e14c16d46ece: Log is configured to *not* fsync() on all Append() calls
I20260812 00:04:43.950357 7942 tablet_bootstrap.cc:492] T 0e3d51dd34fa43e8b83ecdd4242659cb P f4d8d8d0958e4137ba9aa4b11fb6a256: No bootstrap required, opened a new log
I20260812 00:04:43.950428 7942 ts_tablet_manager.cc:1397] T 0e3d51dd34fa43e8b83ecdd4242659cb P f4d8d8d0958e4137ba9aa4b11fb6a256: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 00:04:43.950800 7945 tablet_bootstrap.cc:492] T 0e3d51dd34fa43e8b83ecdd4242659cb P ad0579eb47574d1c9ac95e43e57aaa2e: No bootstrap required, opened a new log
I20260812 00:04:43.950860 7945 ts_tablet_manager.cc:1397] T 0e3d51dd34fa43e8b83ecdd4242659cb P ad0579eb47574d1c9ac95e43e57aaa2e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 00:04:43.950863 7944 tablet_bootstrap.cc:492] T 0e3d51dd34fa43e8b83ecdd4242659cb P e993531ff48748e79f91e14c16d46ece: No bootstrap required, opened a new log
I20260812 00:04:43.950920 7944 ts_tablet_manager.cc:1397] T 0e3d51dd34fa43e8b83ecdd4242659cb P e993531ff48748e79f91e14c16d46ece: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260812 00:04:43.952312 7945 raft_consensus.cc:348] T 0e3d51dd34fa43e8b83ecdd4242659cb P ad0579eb47574d1c9ac95e43e57aaa2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4d8d8d0958e4137ba9aa4b11fb6a256" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 42235 } } peers { permanent_uuid: "e993531ff48748e79f91e14c16d46ece" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 44219 } } peers { permanent_uuid: "ad0579eb47574d1c9ac95e43e57aaa2e" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37711 } }
I20260812 00:04:43.952450 7945 raft_consensus.cc:374] T 0e3d51dd34fa43e8b83ecdd4242659cb P ad0579eb47574d1c9ac95e43e57aaa2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:04:43.952325 7942 raft_consensus.cc:348] T 0e3d51dd34fa43e8b83ecdd4242659cb P f4d8d8d0958e4137ba9aa4b11fb6a256 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4d8d8d0958e4137ba9aa4b11fb6a256" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 42235 } } peers { permanent_uuid: "e993531ff48748e79f91e14c16d46ece" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 44219 } } peers { permanent_uuid: "ad0579eb47574d1c9ac95e43e57aaa2e" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37711 } }
I20260812 00:04:43.952484 7945 raft_consensus.cc:729] T 0e3d51dd34fa43e8b83ecdd4242659cb P ad0579eb47574d1c9ac95e43e57aaa2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad0579eb47574d1c9ac95e43e57aaa2e, State: Initialized, Role: FOLLOWER
I20260812 00:04:43.952493 7942 raft_consensus.cc:374] T 0e3d51dd34fa43e8b83ecdd4242659cb P f4d8d8d0958e4137ba9aa4b11fb6a256 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:04:43.952525 7942 raft_consensus.cc:729] T 0e3d51dd34fa43e8b83ecdd4242659cb P f4d8d8d0958e4137ba9aa4b11fb6a256 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4d8d8d0958e4137ba9aa4b11fb6a256, State: Initialized, Role: FOLLOWER
I20260812 00:04:43.952615 7945 consensus_queue.cc:260] T 0e3d51dd34fa43e8b83ecdd4242659cb P ad0579eb47574d1c9ac95e43e57aaa2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4d8d8d0958e4137ba9aa4b11fb6a256" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 42235 } } peers { permanent_uuid: "e993531ff48748e79f91e14c16d46ece" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 44219 } } peers { permanent_uuid: "ad0579eb47574d1c9ac95e43e57aaa2e" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37711 } }
I20260812 00:04:43.952670 7942 consensus_queue.cc:260] T 0e3d51dd34fa43e8b83ecdd4242659cb P f4d8d8d0958e4137ba9aa4b11fb6a256 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4d8d8d0958e4137ba9aa4b11fb6a256" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 42235 } } peers { permanent_uuid: "e993531ff48748e79f91e14c16d46ece" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 44219 } } peers { permanent_uuid: "ad0579eb47574d1c9ac95e43e57aaa2e" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37711 } }
I20260812 00:04:43.952742 7944 raft_consensus.cc:348] T 0e3d51dd34fa43e8b83ecdd4242659cb P e993531ff48748e79f91e14c16d46ece [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4d8d8d0958e4137ba9aa4b11fb6a256" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 42235 } } peers { permanent_uuid: "e993531ff48748e79f91e14c16d46ece" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 44219 } } peers { permanent_uuid: "ad0579eb47574d1c9ac95e43e57aaa2e" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37711 } }
I20260812 00:04:43.952884 7945 ts_tablet_manager.cc:1428] T 0e3d51dd34fa43e8b83ecdd4242659cb P ad0579eb47574d1c9ac95e43e57aaa2e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 00:04:43.952894 7944 raft_consensus.cc:374] T 0e3d51dd34fa43e8b83ecdd4242659cb P e993531ff48748e79f91e14c16d46ece [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:04:43.952931 7944 raft_consensus.cc:729] T 0e3d51dd34fa43e8b83ecdd4242659cb P e993531ff48748e79f91e14c16d46ece [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e993531ff48748e79f91e14c16d46ece, State: Initialized, Role: FOLLOWER
I20260812 00:04:43.952953 7942 ts_tablet_manager.cc:1428] T 0e3d51dd34fa43e8b83ecdd4242659cb P f4d8d8d0958e4137ba9aa4b11fb6a256: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260812 00:04:43.953011 7679 heartbeater.cc:503] Master 127.11.206.126:38625 was elected leader, sending a full tablet report...
I20260812 00:04:43.953037 7944 consensus_queue.cc:260] T 0e3d51dd34fa43e8b83ecdd4242659cb P e993531ff48748e79f91e14c16d46ece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4d8d8d0958e4137ba9aa4b11fb6a256" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 42235 } } peers { permanent_uuid: "e993531ff48748e79f91e14c16d46ece" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 44219 } } peers { permanent_uuid: "ad0579eb47574d1c9ac95e43e57aaa2e" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37711 } }
I20260812 00:04:43.953083 7444 heartbeater.cc:503] Master 127.11.206.126:38625 was elected leader, sending a full tablet report...
I20260812 00:04:43.953297 7944 ts_tablet_manager.cc:1428] T 0e3d51dd34fa43e8b83ecdd4242659cb P e993531ff48748e79f91e14c16d46ece: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260812 00:04:43.953310 7913 heartbeater.cc:503] Master 127.11.206.126:38625 was elected leader, sending a full tablet report...
W20260812 00:04:44.007138 7686 tablet.cc:2369] T 0e3d51dd34fa43e8b83ecdd4242659cb P ad0579eb47574d1c9ac95e43e57aaa2e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:04:44.014132 7958 raft_consensus.cc:482] T 0e3d51dd34fa43e8b83ecdd4242659cb P f4d8d8d0958e4137ba9aa4b11fb6a256 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:04:44.014249 7958 raft_consensus.cc:504] T 0e3d51dd34fa43e8b83ecdd4242659cb P f4d8d8d0958e4137ba9aa4b11fb6a256 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4d8d8d0958e4137ba9aa4b11fb6a256" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 42235 } } peers { permanent_uuid: "e993531ff48748e79f91e14c16d46ece" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 44219 } } peers { permanent_uuid: "ad0579eb47574d1c9ac95e43e57aaa2e" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37711 } }
I20260812 00:04:44.014614 7958 leader_election.cc:288] T 0e3d51dd34fa43e8b83ecdd4242659cb P f4d8d8d0958e4137ba9aa4b11fb6a256 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e993531ff48748e79f91e14c16d46ece (127.11.206.67:44219), ad0579eb47574d1c9ac95e43e57aaa2e (127.11.206.66:37711)
I20260812 00:04:44.017309 7939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:44.014872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.65:49085 (local address 127.11.206.67:44219)
0812 00:04:44.014922 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:44.014924 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:44.014933 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:04:44.014963 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:44.014963 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:44.014972 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:44.015024 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:04:44.015222 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:44.015696 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:44.016610 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:44.016991 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:44.017053 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:44.017064 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:44.017210 (+ 146us) server_negotiation.cc:299] Negotiation successful
0812 00:04:44.017245 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 00:04:44.017309 7447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:44.014774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.67:44219 (local address 127.11.206.65:49085)
0812 00:04:44.014817 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:44.014830 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:44.014893 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:44.015085 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:44.015087 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:44.015088 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:04:44.015148 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:44.015155 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:44.015765 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:44.015766 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:44.016510 (+ 744us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:44.016512 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:44.017074 (+ 562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:44.017075 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:44.017147 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:44.017150 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:04:44.017194 (+ 44us) client_negotiation.cc:240] Negotiation successful
0812 00:04:44.017233 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20}
I20260812 00:04:44.017530 7961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:44.014883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.66:37711 (local address 127.11.206.65:59363)
0812 00:04:44.015055 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:44.015064 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:04:44.015115 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:04:44.015258 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:04:44.015258 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:04:44.015260 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:04:44.015339 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:44.015341 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:44.015924 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:44.015925 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:44.016734 (+ 809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:04:44.016737 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:04:44.017259 (+ 522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:04:44.017260 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:04:44.017330 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:44.017333 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:04:44.017404 (+ 71us) client_negotiation.cc:240] Negotiation successful
0812 00:04:44.017443 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":111,"threads_started":1}
I20260812 00:04:44.017643 7941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:44.014971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.65:59363 (local address 127.11.206.66:37711)
0812 00:04:44.015012 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:44.015014 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:44.015118 (+ 104us) server_negotiation.cc:407] Connection header received
0812 00:04:44.015197 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:44.015198 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:44.015210 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:44.015251 (+ 41us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:04:44.015397 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:44.015855 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:44.016813 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:44.017185 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:44.017247 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:44.017254 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:44.017530 (+ 276us) server_negotiation.cc:299] Negotiation successful
0812 00:04:44.017571 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 00:04:44.017694 7833 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e3d51dd34fa43e8b83ecdd4242659cb" candidate_uuid: "f4d8d8d0958e4137ba9aa4b11fb6a256" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e993531ff48748e79f91e14c16d46ece" is_pre_election: true
I20260812 00:04:44.017848 7833 raft_consensus.cc:2454] T 0e3d51dd34fa43e8b83ecdd4242659cb P e993531ff48748e79f91e14c16d46ece [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4d8d8d0958e4137ba9aa4b11fb6a256 in term 0.
I20260812 00:04:44.017938 7608 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e3d51dd34fa43e8b83ecdd4242659cb" candidate_uuid: "f4d8d8d0958e4137ba9aa4b11fb6a256" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad0579eb47574d1c9ac95e43e57aaa2e" is_pre_election: true
I20260812 00:04:44.018090 7258 leader_election.cc:302] T 0e3d51dd34fa43e8b83ecdd4242659cb P f4d8d8d0958e4137ba9aa4b11fb6a256 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e993531ff48748e79f91e14c16d46ece, f4d8d8d0958e4137ba9aa4b11fb6a256; no voters:
I20260812 00:04:44.018105 7608 raft_consensus.cc:2454] T 0e3d51dd34fa43e8b83ecdd4242659cb P ad0579eb47574d1c9ac95e43e57aaa2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4d8d8d0958e4137ba9aa4b11fb6a256 in term 0.
I20260812 00:04:44.018224 7958 raft_consensus.cc:2781] T 0e3d51dd34fa43e8b83ecdd4242659cb P f4d8d8d0958e4137ba9aa4b11fb6a256 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:04:44.018278 7958 raft_consensus.cc:482] T 0e3d51dd34fa43e8b83ecdd4242659cb P f4d8d8d0958e4137ba9aa4b11fb6a256 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:04:44.018301 7958 raft_consensus.cc:3037] T 0e3d51dd34fa43e8b83ecdd4242659cb P f4d8d8d0958e4137ba9aa4b11fb6a256 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:04:44.018977 7958 raft_consensus.cc:504] T 0e3d51dd34fa43e8b83ecdd4242659cb P f4d8d8d0958e4137ba9aa4b11fb6a256 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4d8d8d0958e4137ba9aa4b11fb6a256" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 42235 } } peers { permanent_uuid: "e993531ff48748e79f91e14c16d46ece" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 44219 } } peers { permanent_uuid: "ad0579eb47574d1c9ac95e43e57aaa2e" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37711 } }
I20260812 00:04:44.019080 7958 leader_election.cc:288] T 0e3d51dd34fa43e8b83ecdd4242659cb P f4d8d8d0958e4137ba9aa4b11fb6a256 [CANDIDATE]: Term 1 election: Requested vote from peers e993531ff48748e79f91e14c16d46ece (127.11.206.67:44219), ad0579eb47574d1c9ac95e43e57aaa2e (127.11.206.66:37711)
I20260812 00:04:44.019239 7833 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e3d51dd34fa43e8b83ecdd4242659cb" candidate_uuid: "f4d8d8d0958e4137ba9aa4b11fb6a256" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e993531ff48748e79f91e14c16d46ece"
I20260812 00:04:44.019289 7608 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e3d51dd34fa43e8b83ecdd4242659cb" candidate_uuid: "f4d8d8d0958e4137ba9aa4b11fb6a256" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad0579eb47574d1c9ac95e43e57aaa2e"
I20260812 00:04:44.019315 7833 raft_consensus.cc:3037] T 0e3d51dd34fa43e8b83ecdd4242659cb P e993531ff48748e79f91e14c16d46ece [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:04:44.019356 7608 raft_consensus.cc:3037] T 0e3d51dd34fa43e8b83ecdd4242659cb P ad0579eb47574d1c9ac95e43e57aaa2e [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:04:44.019992 7833 raft_consensus.cc:2454] T 0e3d51dd34fa43e8b83ecdd4242659cb P e993531ff48748e79f91e14c16d46ece [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4d8d8d0958e4137ba9aa4b11fb6a256 in term 1.
I20260812 00:04:44.020090 7608 raft_consensus.cc:2454] T 0e3d51dd34fa43e8b83ecdd4242659cb P ad0579eb47574d1c9ac95e43e57aaa2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4d8d8d0958e4137ba9aa4b11fb6a256 in term 1.
I20260812 00:04:44.020175 7258 leader_election.cc:302] T 0e3d51dd34fa43e8b83ecdd4242659cb P f4d8d8d0958e4137ba9aa4b11fb6a256 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e993531ff48748e79f91e14c16d46ece, f4d8d8d0958e4137ba9aa4b11fb6a256; no voters:
I20260812 00:04:44.020306 7958 raft_consensus.cc:2781] T 0e3d51dd34fa43e8b83ecdd4242659cb P f4d8d8d0958e4137ba9aa4b11fb6a256 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:04:44.020448 7958 raft_consensus.cc:686] T 0e3d51dd34fa43e8b83ecdd4242659cb P f4d8d8d0958e4137ba9aa4b11fb6a256 [term 1 LEADER]: Becoming Leader. State: Replica: f4d8d8d0958e4137ba9aa4b11fb6a256, State: Running, Role: LEADER
I20260812 00:04:44.020530 7958 consensus_queue.cc:237] T 0e3d51dd34fa43e8b83ecdd4242659cb P f4d8d8d0958e4137ba9aa4b11fb6a256 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4d8d8d0958e4137ba9aa4b11fb6a256" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 42235 } } peers { permanent_uuid: "e993531ff48748e79f91e14c16d46ece" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 44219 } } peers { permanent_uuid: "ad0579eb47574d1c9ac95e43e57aaa2e" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37711 } }
I20260812 00:04:44.021332 7116 catalog_manager.cc:5495] T 0e3d51dd34fa43e8b83ecdd4242659cb P f4d8d8d0958e4137ba9aa4b11fb6a256 reported cstate change: term changed from 0 to 1, leader changed from <none> to f4d8d8d0958e4137ba9aa4b11fb6a256 (127.11.206.65). New cstate: current_term: 1 leader_uuid: "f4d8d8d0958e4137ba9aa4b11fb6a256" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4d8d8d0958e4137ba9aa4b11fb6a256" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 42235 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e993531ff48748e79f91e14c16d46ece" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 44219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad0579eb47574d1c9ac95e43e57aaa2e" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37711 } health_report { overall_health: UNKNOWN } } }
I20260812 00:04:44.035007 7933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:44.032736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33678 (local address 127.11.206.65:42235)
0812 00:04:44.032795 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0812 00:04:44.032797 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:04:44.032809 (+ 12us) server_negotiation.cc:407] Connection header received
0812 00:04:44.032886 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:04:44.032887 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:04:44.032904 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:04:44.032961 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:04:44.033071 (+ 110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:44.033675 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:44.034399 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:04:44.034591 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:04:44.034641 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:04:44.034747 (+ 106us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:04:44.034839 (+ 92us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:04:44.034894 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0812 00:04:44.034907 (+ 13us) server_negotiation.cc:299] Negotiation successful
0812 00:04:44.034923 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260812 00:04:44.036749 7833 raft_consensus.cc:1261] T 0e3d51dd34fa43e8b83ecdd4242659cb P e993531ff48748e79f91e14c16d46ece [term 1 FOLLOWER]: Refusing update from remote peer f4d8d8d0958e4137ba9aa4b11fb6a256: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:04:44.036751 7608 raft_consensus.cc:1261] T 0e3d51dd34fa43e8b83ecdd4242659cb P ad0579eb47574d1c9ac95e43e57aaa2e [term 1 FOLLOWER]: Refusing update from remote peer f4d8d8d0958e4137ba9aa4b11fb6a256: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:04:44.037113 7962 consensus_queue.cc:1035] T 0e3d51dd34fa43e8b83ecdd4242659cb P f4d8d8d0958e4137ba9aa4b11fb6a256 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e993531ff48748e79f91e14c16d46ece" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 44219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:04:44.037253 7958 consensus_queue.cc:1035] T 0e3d51dd34fa43e8b83ecdd4242659cb P f4d8d8d0958e4137ba9aa4b11fb6a256 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad0579eb47574d1c9ac95e43e57aaa2e" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:04:44.039775 7974 mvcc.cc:205] Tried to move back new op lower bound from 7317475672211791872 to 7317475672148692992. Current Snapshot: MvccSnapshot[applied={T|T < 7317475672211791872}]
I20260812 00:04:44.041831 7119 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34662:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:04:44.041909 7119 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34662:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:04:44.042578 7119 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7d2f9fecf22244cbaa8408406566baa6: Sending DeleteTablet for 3 replicas of tablet 0e3d51dd34fa43e8b83ecdd4242659cb
I20260812 00:04:44.042876 7334 tablet_service.cc:1514] Processing DeleteTablet for tablet 0e3d51dd34fa43e8b83ecdd4242659cb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:04:44 UTC) from {username='kudu', principal='kudu/127.11.206.126@KRBTEST.COM'} at 127.0.0.1:33662
I20260812 00:04:44.042970 7795 tablet_service.cc:1514] Processing DeleteTablet for tablet 0e3d51dd34fa43e8b83ecdd4242659cb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:04:44 UTC) from {username='kudu', principal='kudu/127.11.206.126@KRBTEST.COM'} at 127.0.0.1:36798
I20260812 00:04:44.042970 7565 tablet_service.cc:1514] Processing DeleteTablet for tablet 0e3d51dd34fa43e8b83ecdd4242659cb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:04:44 UTC) from {username='kudu', principal='kudu/127.11.206.126@KRBTEST.COM'} at 127.0.0.1:55266
I20260812 00:04:44.043143 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 7225
I20260812 00:04:44.054674 7989 tablet_replica.cc:330] T 0e3d51dd34fa43e8b83ecdd4242659cb P e993531ff48748e79f91e14c16d46ece: stopping tablet replica
I20260812 00:04:44.054965 7989 raft_consensus.cc:2229] T 0e3d51dd34fa43e8b83ecdd4242659cb P e993531ff48748e79f91e14c16d46ece [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:04:44.055281 7989 raft_consensus.cc:2258] T 0e3d51dd34fa43e8b83ecdd4242659cb P e993531ff48748e79f91e14c16d46ece [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:04:44.056206 7990 tablet_replica.cc:330] T 0e3d51dd34fa43e8b83ecdd4242659cb P ad0579eb47574d1c9ac95e43e57aaa2e: stopping tablet replica
I20260812 00:04:44.056334 7990 raft_consensus.cc:2229] T 0e3d51dd34fa43e8b83ecdd4242659cb P ad0579eb47574d1c9ac95e43e57aaa2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:04:44.056429 7990 raft_consensus.cc:2258] T 0e3d51dd34fa43e8b83ecdd4242659cb P ad0579eb47574d1c9ac95e43e57aaa2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:04:44.060703 7989 ts_tablet_manager.cc:1905] T 0e3d51dd34fa43e8b83ecdd4242659cb P e993531ff48748e79f91e14c16d46ece: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:04:44.062319 7989 ts_tablet_manager.cc:1918] T 0e3d51dd34fa43e8b83ecdd4242659cb P e993531ff48748e79f91e14c16d46ece: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:04:44.062402 7989 log.cc:1196] T 0e3d51dd34fa43e8b83ecdd4242659cb P e993531ff48748e79f91e14c16d46ece: Deleting WAL directory at /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-2/wal/wals/0e3d51dd34fa43e8b83ecdd4242659cb
I20260812 00:04:44.062635 7989 ts_tablet_manager.cc:1939] T 0e3d51dd34fa43e8b83ecdd4242659cb P e993531ff48748e79f91e14c16d46ece: Deleting consensus metadata
I20260812 00:04:44.064103 7990 ts_tablet_manager.cc:1905] T 0e3d51dd34fa43e8b83ecdd4242659cb P ad0579eb47574d1c9ac95e43e57aaa2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:04:44.064368 7096 catalog_manager.cc:4841] TS e993531ff48748e79f91e14c16d46ece (127.11.206.67:44219): tablet 0e3d51dd34fa43e8b83ecdd4242659cb (table test-table [id=db72ef200570413684d4ebc97b433273]) successfully deleted
I20260812 00:04:44.065780 7990 ts_tablet_manager.cc:1918] T 0e3d51dd34fa43e8b83ecdd4242659cb P ad0579eb47574d1c9ac95e43e57aaa2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:04:44.065871 7990 log.cc:1196] T 0e3d51dd34fa43e8b83ecdd4242659cb P ad0579eb47574d1c9ac95e43e57aaa2e: Deleting WAL directory at /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-1/wal/wals/0e3d51dd34fa43e8b83ecdd4242659cb
I20260812 00:04:44.066147 7990 ts_tablet_manager.cc:1939] T 0e3d51dd34fa43e8b83ecdd4242659cb P ad0579eb47574d1c9ac95e43e57aaa2e: Deleting consensus metadata
I20260812 00:04:44.066588 7096 catalog_manager.cc:4841] TS ad0579eb47574d1c9ac95e43e57aaa2e (127.11.206.66:37711): tablet 0e3d51dd34fa43e8b83ecdd4242659cb (table test-table [id=db72ef200570413684d4ebc97b433273]) successfully deleted
W20260812 00:04:44.069653 7097 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.206.65:42235 (error 108)
I20260812 00:04:44.069836 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 7450
I20260812 00:04:44.072268 7937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:04:44.072131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.65:42235 (local address 127.0.0.1:33686)
0812 00:04:44.072184 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0812 00:04:44.072225 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.65:42235: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260812 00:04:44.073621 7097 catalog_manager.cc:4584] TS f4d8d8d0958e4137ba9aa4b11fb6a256 (127.11.206.65:42235): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 0e3d51dd34fa43e8b83ecdd4242659cb: Network error: Client connection negotiation failed: client connection to 127.11.206.65:42235: connect: Connection refused (error 111)
I20260812 00:04:44.081548 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 7692
I20260812 00:04:44.088335 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 7068
I20260812 00:05:04.099231 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:38625
--webserver_interface=127.11.206.126
--webserver_port=39517
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab
--principal=kudu/127.11.206.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:40415
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.206.126:38625
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:05:04.181057 7993 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:04.181267 7993 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:04.181288 7993 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:04.182477 7993 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260812 00:05:04.182521 7993 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260812 00:05:04.182533 7993 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260812 00:05:04.182544 7993 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:05:04.182556 7993 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:04.182579 7993 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:04.182595 7993 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:05:04.182619 7993 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:05:04.184089 7993 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:40415
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.11.206.126:38625
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab
--principal=kudu/127.11.206.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:38625
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.206.126
--webserver_port=39517
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7993
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:05:04.184319 7993 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:04.184527 7993 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 00:05:04.193356 7993 server_base.cc:1034] running on GCE node
W20260812 00:05:04.193460 8008 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:04.193480 8010 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:04.193514 7999 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:04.193859 7993 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:04.194168 7993 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:04.195327 7993 hybrid_clock.cc:648] HybridClock initialized: now 1786493104195313 us; error 35 us; skew 500 ppm
Aug 12 00:05:04 dist-test-slave-f0tn krb5kdc[7044](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493104, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:04.197942 7993 init.cc:377] Logged in from keytab as kudu/127.11.206.126@KRBTEST.COM (short username kudu)
I20260812 00:05:04.198367 7993 webserver.cc:460] Webserver started at http://127.11.206.126:39517/ using document root <none> and password file <none>
I20260812 00:05:04.198603 7993 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:04.198673 7993 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:04.200073 7993 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:05:04.200742 8024 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:04.200889 7993 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:05:04.200975 7993 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/master-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/master-0/wal
uuid: "7d2f9fecf22244cbaa8408406566baa6"
format_stamp: "Formatted at 2026-08-12 00:04:43 on dist-test-slave-f0tn"
server_key: "41ba2f9203c8c0f16f37c0074a5c56c9"
server_key_iv: "4fec244f546a79e4deffcd0f943a15b1"
server_key_version: "encryptionkey@0"
I20260812 00:05:04.201407 7993 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:04.214341 7993 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:04.216696 7993 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:04.216849 7993 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:04.220907 7993 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.126:38625
I20260812 00:05:04.220952 8120 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.126:38625 every 8 connection(s)
I20260812 00:05:04.221364 7993 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
I20260812 00:05:04.223080 8121 sys_catalog.cc:263] Verifying existing consensus state
I20260812 00:05:04.223871 8121 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7d2f9fecf22244cbaa8408406566baa6: Bootstrap starting.
I20260812 00:05:04.224951 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 7993
I20260812 00:05:04.225282 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.65:42235
--local_ip_for_outbound_sockets=127.11.206.65
--tserver_master_addrs=127.11.206.126:38625
--webserver_port=43343
--webserver_interface=127.11.206.65
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.65.keytab
--principal=kudu/127.11.206.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:40415
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:05:04.232538 8121 log.cc:824] T 00000000000000000000000000000000 P 7d2f9fecf22244cbaa8408406566baa6: Log is configured to *not* fsync() on all Append() calls
I20260812 00:05:04.234620 8121 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7d2f9fecf22244cbaa8408406566baa6: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 00:05:04.234928 8121 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7d2f9fecf22244cbaa8408406566baa6: Bootstrap complete.
I20260812 00:05:04.237056 8121 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7d2f9fecf22244cbaa8408406566baa6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d2f9fecf22244cbaa8408406566baa6" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 38625 } }
I20260812 00:05:04.237293 8121 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7d2f9fecf22244cbaa8408406566baa6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2f9fecf22244cbaa8408406566baa6, State: Initialized, Role: FOLLOWER
I20260812 00:05:04.237462 8121 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7d2f9fecf22244cbaa8408406566baa6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d2f9fecf22244cbaa8408406566baa6" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 38625 } }
I20260812 00:05:04.237531 8121 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7d2f9fecf22244cbaa8408406566baa6 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:05:04.237566 8121 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7d2f9fecf22244cbaa8408406566baa6 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:05:04.237613 8121 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7d2f9fecf22244cbaa8408406566baa6 [term 1 FOLLOWER]: Advancing to term 2
I20260812 00:05:04.238611 8121 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7d2f9fecf22244cbaa8408406566baa6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d2f9fecf22244cbaa8408406566baa6" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 38625 } }
I20260812 00:05:04.238715 8121 leader_election.cc:302] T 00000000000000000000000000000000 P 7d2f9fecf22244cbaa8408406566baa6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7d2f9fecf22244cbaa8408406566baa6; no voters:
I20260812 00:05:04.238890 8121 leader_election.cc:288] T 00000000000000000000000000000000 P 7d2f9fecf22244cbaa8408406566baa6 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260812 00:05:04.238940 8126 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7d2f9fecf22244cbaa8408406566baa6 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 00:05:04.239066 8126 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7d2f9fecf22244cbaa8408406566baa6 [term 2 LEADER]: Becoming Leader. State: Replica: 7d2f9fecf22244cbaa8408406566baa6, State: Running, Role: LEADER
I20260812 00:05:04.239166 8121 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7d2f9fecf22244cbaa8408406566baa6 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:05:04.239243 8126 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7d2f9fecf22244cbaa8408406566baa6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d2f9fecf22244cbaa8408406566baa6" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 38625 } }
I20260812 00:05:04.239638 8126 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7d2f9fecf22244cbaa8408406566baa6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7d2f9fecf22244cbaa8408406566baa6. Latest consensus state: current_term: 2 leader_uuid: "7d2f9fecf22244cbaa8408406566baa6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d2f9fecf22244cbaa8408406566baa6" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 38625 } } }
I20260812 00:05:04.239727 8126 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7d2f9fecf22244cbaa8408406566baa6 [sys.catalog]: This master's current role is: LEADER
I20260812 00:05:04.239878 8134 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7d2f9fecf22244cbaa8408406566baa6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "7d2f9fecf22244cbaa8408406566baa6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d2f9fecf22244cbaa8408406566baa6" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 38625 } } }
I20260812 00:05:04.240013 8134 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7d2f9fecf22244cbaa8408406566baa6 [sys.catalog]: This master's current role is: LEADER
I20260812 00:05:04.240477 8148 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:05:04.241253 8148 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:05:04.241351 8148 catalog_manager.cc:1259] Loaded cluster ID: ca84d59e1d19460cb118af64f2c3e7f9
I20260812 00:05:04.241415 8148 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:05:04.242230 8148 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:05:04.242394 8148 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 7d2f9fecf22244cbaa8408406566baa6: Loaded TSK: 0
I20260812 00:05:04.248847 8148 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7d2f9fecf22244cbaa8408406566baa6: Generated new TSK 1
I20260812 00:05:04.248932 8148 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 00:05:04.339315 8124 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:04.339639 8124 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:04.339687 8124 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:04.341526 8124 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:04.341599 8124 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:04.341645 8124 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.65
I20260812 00:05:04.343935 8124 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:40415
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.65.keytab
--principal=kudu/127.11.206.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.65:42235
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.206.65
--webserver_port=43343
--tserver_master_addrs=127.11.206.126:38625
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8124
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.65
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:05:04.344225 8124 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:04.344521 8124 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:04.350139 8175 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:04.350231 8166 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:04.350242 8165 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:04.350522 8124 server_base.cc:1034] running on GCE node
I20260812 00:05:04.350818 8124 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:04.351140 8124 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:04.352340 8124 hybrid_clock.cc:648] HybridClock initialized: now 1786493104352328 us; error 44 us; skew 500 ppm
Aug 12 00:05:04 dist-test-slave-f0tn krb5kdc[7044](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493104, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:04.355775 8124 init.cc:377] Logged in from keytab as kudu/127.11.206.65@KRBTEST.COM (short username kudu)
I20260812 00:05:04.356410 8124 webserver.cc:460] Webserver started at http://127.11.206.65:43343/ using document root <none> and password file <none>
I20260812 00:05:04.356688 8124 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:04.356773 8124 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:04.358667 8124 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:05:04.359467 8185 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:04.359638 8124 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:05:04.359747 8124 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-0/wal
uuid: "f4d8d8d0958e4137ba9aa4b11fb6a256"
format_stamp: "Formatted at 2026-08-12 00:04:43 on dist-test-slave-f0tn"
server_key: "7314ca9aa040922a0d6d83a53294dc20"
server_key_iv: "8318863b460a508ccf07c0ace85b1fae"
server_key_version: "encryptionkey@0"
I20260812 00:05:04.360229 8124 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:04.376668 8124 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:04.379351 8124 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:04.379514 8124 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:04.379789 8124 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:05:04.380350 8196 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260812 00:05:04.381987 8124 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 00:05:04.382057 8124 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260812 00:05:04.382095 8124 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260812 00:05:04.382958 8124 ts_tablet_manager.cc:610] Registered 1 tablets
I20260812 00:05:04.383003 8124 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260812 00:05:04.383103 8196 tablet_bootstrap.cc:492] T 0e3d51dd34fa43e8b83ecdd4242659cb P f4d8d8d0958e4137ba9aa4b11fb6a256: Bootstrap starting.
I20260812 00:05:04.390254 8124 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.65:42235
I20260812 00:05:04.390743 8124 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
I20260812 00:05:04.391323 8372 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.65:42235 every 8 connection(s)
I20260812 00:05:04.392082 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 8124
I20260812 00:05:04.392432 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.66:37711
--local_ip_for_outbound_sockets=127.11.206.66
--tserver_master_addrs=127.11.206.126:38625
--webserver_port=36945
--webserver_interface=127.11.206.66
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.66.keytab
--principal=kudu/127.11.206.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:40415
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:05:04.393558 8196 log.cc:824] T 0e3d51dd34fa43e8b83ecdd4242659cb P f4d8d8d0958e4137ba9aa4b11fb6a256: Log is configured to *not* fsync() on all Append() calls
I20260812 00:05:04.395906 8196 tablet_bootstrap.cc:492] T 0e3d51dd34fa43e8b83ecdd4242659cb P f4d8d8d0958e4137ba9aa4b11fb6a256: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 00:05:04.396232 8196 tablet_bootstrap.cc:492] T 0e3d51dd34fa43e8b83ecdd4242659cb P f4d8d8d0958e4137ba9aa4b11fb6a256: Bootstrap complete.
I20260812 00:05:04.397287 8196 ts_tablet_manager.cc:1397] T 0e3d51dd34fa43e8b83ecdd4242659cb P f4d8d8d0958e4137ba9aa4b11fb6a256: Time spent bootstrapping tablet: real 0.014s user 0.005s sys 0.007s
I20260812 00:05:04.399086 8196 raft_consensus.cc:348] T 0e3d51dd34fa43e8b83ecdd4242659cb P f4d8d8d0958e4137ba9aa4b11fb6a256 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4d8d8d0958e4137ba9aa4b11fb6a256" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 42235 } } peers { permanent_uuid: "e993531ff48748e79f91e14c16d46ece" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 44219 } } peers { permanent_uuid: "ad0579eb47574d1c9ac95e43e57aaa2e" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37711 } }
I20260812 00:05:04.399435 8196 raft_consensus.cc:729] T 0e3d51dd34fa43e8b83ecdd4242659cb P f4d8d8d0958e4137ba9aa4b11fb6a256 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4d8d8d0958e4137ba9aa4b11fb6a256, State: Initialized, Role: FOLLOWER
I20260812 00:05:04.399573 8196 consensus_queue.cc:260] T 0e3d51dd34fa43e8b83ecdd4242659cb P f4d8d8d0958e4137ba9aa4b11fb6a256 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4d8d8d0958e4137ba9aa4b11fb6a256" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 42235 } } peers { permanent_uuid: "e993531ff48748e79f91e14c16d46ece" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 44219 } } peers { permanent_uuid: "ad0579eb47574d1c9ac95e43e57aaa2e" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37711 } }
Aug 12 00:05:04 dist-test-slave-f0tn krb5kdc[7044](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493104, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.65@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:05:04.399849 8196 ts_tablet_manager.cc:1428] T 0e3d51dd34fa43e8b83ecdd4242659cb P f4d8d8d0958e4137ba9aa4b11fb6a256: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260812 00:05:04.403728 8380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:04.391602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:38625 (local address 127.11.206.65:42957)
0812 00:05:04.391825 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:04.391874 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:04.392513 (+ 639us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:04.393189 (+ 676us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:04.393193 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:04.393591 (+ 398us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:04.393883 (+ 292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:04.393891 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:04.395600 (+ 1709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:04.395601 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:04.396857 (+ 1256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:04.396861 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:04.397724 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:04.397726 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:04.397876 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:04.398433 (+ 557us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:04.398443 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:04.400279 (+ 1836us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:04.402128 (+ 1849us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:04.402136 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:04.402138 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:04.402381 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:04.402634 (+ 253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:04.402635 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:04.402635 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:04.402747 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:04.403110 (+ 363us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:04.403118 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:04.403252 (+ 134us) client_negotiation.cc:769] Sending connection context
0812 00:05:04.403340 (+ 88us) client_negotiation.cc:240] Negotiation successful
0812 00:05:04.403521 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":126,"threads_started":1}
I20260812 00:05:04.403741 8379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:04.391623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.65:42957 (local address 127.11.206.126:38625)
0812 00:05:04.392727 (+ 1104us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:04.392735 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:04.392778 (+ 43us) server_negotiation.cc:407] Connection header received
0812 00:05:04.392913 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:04.392919 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:04.392973 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:04.393844 (+ 871us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:04.394050 (+ 206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:04.395440 (+ 1390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:04.396968 (+ 1528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:04.397613 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:04.397730 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:04.400406 (+ 2676us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:04.400412 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:04.400412 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:04.400426 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:04.402045 (+ 1619us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:04.402460 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:04.402463 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:04.402463 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:04.402569 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:04.402804 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:04.402805 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:04.402805 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:04.403036 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:04.403113 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:04.403409 (+ 296us) server_negotiation.cc:299] Negotiation successful
0812 00:05:04.403531 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1051,"thread_start_us":84,"threads_started":1}
I20260812 00:05:04.404768 8376 heartbeater.cc:347] Connected to a master server at 127.11.206.126:38625
I20260812 00:05:04.404867 8376 heartbeater.cc:464] Registering TS with master...
I20260812 00:05:04.405069 8376 heartbeater.cc:511] Master 127.11.206.126:38625 requested a full tablet report, sending...
I20260812 00:05:04.405802 8055 ts_manager.cc:194] Registered new tserver with Master: f4d8d8d0958e4137ba9aa4b11fb6a256 (127.11.206.65:42235)
I20260812 00:05:04.406855 8055 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.206.65@KRBTEST.COM'} at 127.11.206.65:42957
I20260812 00:05:04.407680 8376 heartbeater.cc:503] Master 127.11.206.126:38625 was elected leader, sending a full tablet report...
I20260812 00:05:04.412992 8386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:04.406365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.65:42235 (local address 127.0.0.1:49202)
0812 00:05:04.409515 (+ 3150us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:04.409555 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:04.409614 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:04.409873 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:04.409876 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:04.409879 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:05:04.409968 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:04.409970 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:04.410775 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:04.410776 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:04.411985 (+ 1209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:04.411988 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:04.412666 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:04.412667 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:04.412770 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:04.412784 (+ 14us) client_negotiation.cc:769] Sending connection context
0812 00:05:04.412847 (+ 63us) client_negotiation.cc:240] Negotiation successful
0812 00:05:04.412909 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3112,"thread_start_us":114,"threads_started":1}
I20260812 00:05:04.412992 8388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:04.406630 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49202 (local address 127.11.206.65:42235)
0812 00:05:04.409743 (+ 3113us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:04.409747 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:04.409755 (+ 8us) server_negotiation.cc:407] Connection header received
0812 00:05:04.409780 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:04.409782 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:04.409793 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:04.409858 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:05:04.410029 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:04.410699 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:04.412081 (+ 1382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:04.412586 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:04.412651 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:04.412714 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:04.412868 (+ 154us) server_negotiation.cc:299] Negotiation successful
0812 00:05:04.412908 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3079,"thread_start_us":67,"threads_started":1}
I20260812 00:05:04.413651 8264 tablet_service.cc:1514] Processing DeleteTablet for tablet 0e3d51dd34fa43e8b83ecdd4242659cb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:04:44 UTC) from {username='kudu', principal='kudu/127.11.206.126@KRBTEST.COM'} at 127.0.0.1:49202
I20260812 00:05:04.419961 8389 tablet_replica.cc:330] stopping tablet replica
I20260812 00:05:04.420120 8389 raft_consensus.cc:2229] T 0e3d51dd34fa43e8b83ecdd4242659cb P f4d8d8d0958e4137ba9aa4b11fb6a256 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:05:04.420208 8389 raft_consensus.cc:2258] T 0e3d51dd34fa43e8b83ecdd4242659cb P f4d8d8d0958e4137ba9aa4b11fb6a256 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:05:04.420588 8389 ts_tablet_manager.cc:1905] T 0e3d51dd34fa43e8b83ecdd4242659cb P f4d8d8d0958e4137ba9aa4b11fb6a256: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:05:04.423223 8389 ts_tablet_manager.cc:1918] T 0e3d51dd34fa43e8b83ecdd4242659cb P f4d8d8d0958e4137ba9aa4b11fb6a256: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:05:04.423324 8389 log.cc:1196] T 0e3d51dd34fa43e8b83ecdd4242659cb P f4d8d8d0958e4137ba9aa4b11fb6a256: Deleting WAL directory at /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-0/wal/wals/0e3d51dd34fa43e8b83ecdd4242659cb
I20260812 00:05:04.423542 8389 ts_tablet_manager.cc:1939] T 0e3d51dd34fa43e8b83ecdd4242659cb P f4d8d8d0958e4137ba9aa4b11fb6a256: Deleting consensus metadata
I20260812 00:05:04.424136 8030 catalog_manager.cc:4841] TS f4d8d8d0958e4137ba9aa4b11fb6a256 (127.11.206.65:42235): tablet 0e3d51dd34fa43e8b83ecdd4242659cb (table test-table [id=db72ef200570413684d4ebc97b433273]) successfully deleted
W20260812 00:05:04.487396 8383 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:04.487630 8383 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:04.487654 8383 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:04.488816 8383 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:04.488854 8383 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:04.488880 8383 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.66
I20260812 00:05:04.490437 8383 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:40415
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.66.keytab
--principal=kudu/127.11.206.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.66:37711
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.206.66
--webserver_port=36945
--tserver_master_addrs=127.11.206.126:38625
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8383
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.66
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:05:04.490655 8383 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:04.490860 8383 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:04.496146 8402 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:04.496264 8398 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:04.496161 8399 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:04.496419 8383 server_base.cc:1034] running on GCE node
I20260812 00:05:04.496622 8383 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:04.496872 8383 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:04.498011 8383 hybrid_clock.cc:648] HybridClock initialized: now 1786493104497996 us; error 35 us; skew 500 ppm
Aug 12 00:05:04 dist-test-slave-f0tn krb5kdc[7044](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493104, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:04.500638 8383 init.cc:377] Logged in from keytab as kudu/127.11.206.66@KRBTEST.COM (short username kudu)
I20260812 00:05:04.501118 8383 webserver.cc:460] Webserver started at http://127.11.206.66:36945/ using document root <none> and password file <none>
I20260812 00:05:04.501358 8383 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:04.501457 8383 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:04.502856 8383 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:05:04.503466 8421 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:04.503618 8383 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:05:04.503705 8383 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-1/wal
uuid: "ad0579eb47574d1c9ac95e43e57aaa2e"
format_stamp: "Formatted at 2026-08-12 00:04:43 on dist-test-slave-f0tn"
server_key: "7e25b54933d1ce01d206981093ec0610"
server_key_iv: "0203e6efb12bd9c8efc6dd8afbd1f798"
server_key_version: "encryptionkey@0"
I20260812 00:05:04.504055 8383 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:04.533839 8383 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:04.535691 8383 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:04.535837 8383 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:04.536069 8383 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:05:04.536382 8383 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:05:04.536417 8383 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:04.536446 8383 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:05:04.536469 8383 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:04.542346 8383 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.66:37711
I20260812 00:05:04.542393 8633 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.66:37711 every 8 connection(s)
I20260812 00:05:04.542753 8383 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
Aug 12 00:05:04 dist-test-slave-f0tn krb5kdc[7044](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493104, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.66@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:05:04.551857 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 8383
I20260812 00:05:04.552211 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.67:44219
--local_ip_for_outbound_sockets=127.11.206.67
--tserver_master_addrs=127.11.206.126:38625
--webserver_port=44303
--webserver_interface=127.11.206.67
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.67.keytab
--principal=kudu/127.11.206.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:40415
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:05:04.552474 8379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:04.543512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.66:52531 (local address 127.11.206.126:38625)
0812 00:05:04.543563 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:04.543565 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:04.543774 (+ 209us) server_negotiation.cc:407] Connection header received
0812 00:05:04.544291 (+ 517us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:04.544292 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:04.544305 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:04.544370 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:04.545347 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:04.545928 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:04.547075 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:04.547315 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:04.547374 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:04.549704 (+ 2330us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:04.549705 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:04.549705 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:04.549713 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:04.550968 (+ 1255us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:04.551406 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:04.551406 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:04.551407 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:04.551471 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:04.551694 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:04.551695 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:04.551695 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:04.551838 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:04.551901 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:04.552259 (+ 358us) server_negotiation.cc:299] Negotiation successful
0812 00:05:04.552376 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 00:05:04.552747 8638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:04.543469 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:38625 (local address 127.11.206.66:52531)
0812 00:05:04.543643 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:04.543695 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:04.544184 (+ 489us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:04.544439 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:04.544442 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:04.545035 (+ 593us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:04.545238 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:04.545244 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:04.546001 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:04.546002 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:04.546964 (+ 962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:04.546967 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:04.547391 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:04.547392 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:04.547504 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:04.548070 (+ 566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:04.548079 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:04.549607 (+ 1528us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:04.551092 (+ 1485us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:04.551099 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:04.551102 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:04.551341 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:04.551518 (+ 177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:04.551519 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:04.551519 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:04.551619 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:04.551905 (+ 286us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:04.551913 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:04.552108 (+ 195us) client_negotiation.cc:769] Sending connection context
0812 00:05:04.552227 (+ 119us) client_negotiation.cc:240] Negotiation successful
0812 00:05:04.552411 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":84,"threads_started":1}
I20260812 00:05:04.553428 8634 heartbeater.cc:347] Connected to a master server at 127.11.206.126:38625
I20260812 00:05:04.553539 8634 heartbeater.cc:464] Registering TS with master...
I20260812 00:05:04.553768 8634 heartbeater.cc:511] Master 127.11.206.126:38625 requested a full tablet report, sending...
I20260812 00:05:04.554287 8055 ts_manager.cc:194] Registered new tserver with Master: ad0579eb47574d1c9ac95e43e57aaa2e (127.11.206.66:37711)
I20260812 00:05:04.554687 8055 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.206.66@KRBTEST.COM'} at 127.11.206.66:52531
W20260812 00:05:04.636998 8642 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:04.637233 8642 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:04.637257 8642 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:04.638512 8642 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:04.638566 8642 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:04.638595 8642 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.67
I20260812 00:05:04.640225 8642 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:40415
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.67.keytab
--principal=kudu/127.11.206.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.67:44219
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.206.67
--webserver_port=44303
--tserver_master_addrs=127.11.206.126:38625
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8642
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.67
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:05:04.640478 8642 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:04.640713 8642 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:04.645813 8653 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:04.645813 8651 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:04.645886 8655 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:04.645943 8642 server_base.cc:1034] running on GCE node
I20260812 00:05:04.646173 8642 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:04.646404 8642 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:04.647571 8642 hybrid_clock.cc:648] HybridClock initialized: now 1786493104647559 us; error 28 us; skew 500 ppm
Aug 12 00:05:04 dist-test-slave-f0tn krb5kdc[7044](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493104, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:04.650251 8642 init.cc:377] Logged in from keytab as kudu/127.11.206.67@KRBTEST.COM (short username kudu)
I20260812 00:05:04.650663 8642 webserver.cc:460] Webserver started at http://127.11.206.67:44303/ using document root <none> and password file <none>
I20260812 00:05:04.650861 8642 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:04.650919 8642 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:04.652338 8642 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 00:05:04.652951 8673 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:04.653126 8642 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 00:05:04.653204 8642 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-2/wal
uuid: "e993531ff48748e79f91e14c16d46ece"
format_stamp: "Formatted at 2026-08-12 00:04:43 on dist-test-slave-f0tn"
server_key: "36e5655dd3d2d91834129e1ae48a6800"
server_key_iv: "c113d41ebff120c6d0cd3e1ccd2f27f8"
server_key_version: "encryptionkey@0"
I20260812 00:05:04.653600 8642 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:04.664057 8642 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:04.666385 8642 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:04.666513 8642 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:04.666757 8642 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:05:04.667057 8642 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:05:04.667091 8642 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:04.667114 8642 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:05:04.667124 8642 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:04.672657 8642 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.67:44219
I20260812 00:05:04.672712 8879 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.67:44219 every 8 connection(s)
I20260812 00:05:04.673036 8642 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
I20260812 00:05:04.678591 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 8642
Aug 12 00:05:04 dist-test-slave-f0tn krb5kdc[7044](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493104, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.67@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:05:04.682374 8379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:04.673774 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.67:60265 (local address 127.11.206.126:38625)
0812 00:05:04.673821 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:04.673824 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:04.674036 (+ 212us) server_negotiation.cc:407] Connection header received
0812 00:05:04.674584 (+ 548us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:04.674586 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:04.674596 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:04.674647 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:04.675687 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:04.676224 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:04.677198 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:04.677440 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:04.677535 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:04.679748 (+ 2213us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:04.679750 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:04.679750 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:04.679757 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:04.681028 (+ 1271us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:04.681437 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:04.681438 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:04.681439 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:04.681500 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:04.681735 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:04.681735 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:04.681736 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:04.681858 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:04.681915 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:04.682195 (+ 280us) server_negotiation.cc:299] Negotiation successful
0812 00:05:04.682282 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 00:05:04.682550 8882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:04.673744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:38625 (local address 127.11.206.67:60265)
0812 00:05:04.673903 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:04.673947 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:04.674465 (+ 518us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:04.674716 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:04.674719 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:04.675376 (+ 657us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:04.675580 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:04.675586 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:04.676299 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:04.676299 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:04.677104 (+ 805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:04.677106 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:04.677543 (+ 437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:04.677544 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:04.677658 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:04.678140 (+ 482us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:04.678175 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:04.679654 (+ 1479us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:04.681111 (+ 1457us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:04.681119 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:04.681122 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:04.681346 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:04.681556 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:04.681557 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:04.681558 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:04.681676 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:04.681913 (+ 237us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:04.681920 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:04.682063 (+ 143us) client_negotiation.cc:769] Sending connection context
0812 00:05:04.682157 (+ 94us) client_negotiation.cc:240] Negotiation successful
0812 00:05:04.682321 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":91,"threads_started":1}
I20260812 00:05:04.683121 8880 heartbeater.cc:347] Connected to a master server at 127.11.206.126:38625
I20260812 00:05:04.683225 8880 heartbeater.cc:464] Registering TS with master...
I20260812 00:05:04.683415 8880 heartbeater.cc:511] Master 127.11.206.126:38625 requested a full tablet report, sending...
I20260812 00:05:04.683825 8055 ts_manager.cc:194] Registered new tserver with Master: e993531ff48748e79f91e14c16d46ece (127.11.206.67:44219)
I20260812 00:05:04.684307 8055 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.206.67@KRBTEST.COM'} at 127.11.206.67:60265
I20260812 00:05:04.685497 8890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:04.679026 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38742 (local address 127.11.206.126:38625)
0812 00:05:04.679145 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:04.679147 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:04.679209 (+ 62us) server_negotiation.cc:407] Connection header received
0812 00:05:04.679273 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:04.679274 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:04.679286 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:04.679347 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:04.679959 (+ 612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:04.680597 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:04.681369 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:04.681608 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:04.681674 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:04.682900 (+ 1226us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:04.682901 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:04.682902 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:04.682907 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:04.684450 (+ 1543us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:04.684804 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:04.684805 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:04.684805 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:04.684860 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:04.685046 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:04.685046 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:04.685046 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:04.685135 (+ 89us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:04.685251 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:04.685318 (+ 67us) server_negotiation.cc:299] Negotiation successful
0812 00:05:04.685408 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96,"thread_start_us":68,"threads_started":1}
I20260812 00:05:04.686211 12089 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:05:04.688584 8890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:04.686507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38748 (local address 127.11.206.126:38625)
0812 00:05:04.686547 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:04.686549 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:04.686647 (+ 98us) server_negotiation.cc:407] Connection header received
0812 00:05:04.686703 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:04.686704 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:04.686732 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:04.686780 (+ 48us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:05:04.686857 (+ 77us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:04.687305 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:04.687967 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:04.688154 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:04.688197 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:04.688305 (+ 108us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:05:04.688346 (+ 41us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0812 00:05:04.688541 (+ 195us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:38748: token expired
Metrics: {"server-negotiator.queue_time_us":22}
W20260812 00:05:04.688635 8890 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:38748: token expired
W20260812 00:05:04.688630 7921 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.11.206.126:38625)
I20260812 00:05:04.696877 8890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:04.688889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38762 (local address 127.11.206.126:38625)
0812 00:05:04.688924 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:04.688926 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:04.688934 (+ 8us) server_negotiation.cc:407] Connection header received
0812 00:05:04.688973 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:04.688974 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:04.688981 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:04.689020 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:04.689461 (+ 441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:04.689894 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:04.690517 (+ 623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:04.690682 (+ 165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:04.690721 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:04.694653 (+ 3932us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:04.694655 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:04.694655 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:04.694663 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:04.695758 (+ 1095us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:04.696114 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:04.696115 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:04.696116 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:04.696178 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:04.696340 (+ 162us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:04.696341 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:04.696341 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:04.696495 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:04.696572 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:04.696735 (+ 163us) server_negotiation.cc:299] Negotiation successful
0812 00:05:04.696809 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260812 00:05:04.698112 8055 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38762:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:05:04.699644 8055 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:05:04.701795 8264 tablet_service.cc:1467] Processing CreateTablet for tablet 3aee40177a6f4c7ab32cab53d99b6aa0 (DEFAULT_TABLE table=test-table [id=b73dd73f2bd448e78dd7a6d3c9c853b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:05:04.702013 8264 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3aee40177a6f4c7ab32cab53d99b6aa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:04.703305 8196 tablet_bootstrap.cc:492] T 3aee40177a6f4c7ab32cab53d99b6aa0 P f4d8d8d0958e4137ba9aa4b11fb6a256: Bootstrap starting.
I20260812 00:05:04.703670 8196 tablet_bootstrap.cc:654] T 3aee40177a6f4c7ab32cab53d99b6aa0 P f4d8d8d0958e4137ba9aa4b11fb6a256: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:04.704216 8196 tablet_bootstrap.cc:492] T 3aee40177a6f4c7ab32cab53d99b6aa0 P f4d8d8d0958e4137ba9aa4b11fb6a256: No bootstrap required, opened a new log
I20260812 00:05:04.704257 8196 ts_tablet_manager.cc:1397] T 3aee40177a6f4c7ab32cab53d99b6aa0 P f4d8d8d0958e4137ba9aa4b11fb6a256: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260812 00:05:04.704360 8196 raft_consensus.cc:348] T 3aee40177a6f4c7ab32cab53d99b6aa0 P f4d8d8d0958e4137ba9aa4b11fb6a256 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e993531ff48748e79f91e14c16d46ece" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 44219 } } peers { permanent_uuid: "ad0579eb47574d1c9ac95e43e57aaa2e" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37711 } } peers { permanent_uuid: "f4d8d8d0958e4137ba9aa4b11fb6a256" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 42235 } }
I20260812 00:05:04.704430 8196 raft_consensus.cc:374] T 3aee40177a6f4c7ab32cab53d99b6aa0 P f4d8d8d0958e4137ba9aa4b11fb6a256 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:04.704475 8196 raft_consensus.cc:729] T 3aee40177a6f4c7ab32cab53d99b6aa0 P f4d8d8d0958e4137ba9aa4b11fb6a256 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4d8d8d0958e4137ba9aa4b11fb6a256, State: Initialized, Role: FOLLOWER
I20260812 00:05:04.704523 8196 consensus_queue.cc:260] T 3aee40177a6f4c7ab32cab53d99b6aa0 P f4d8d8d0958e4137ba9aa4b11fb6a256 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e993531ff48748e79f91e14c16d46ece" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 44219 } } peers { permanent_uuid: "ad0579eb47574d1c9ac95e43e57aaa2e" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37711 } } peers { permanent_uuid: "f4d8d8d0958e4137ba9aa4b11fb6a256" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 42235 } }
I20260812 00:05:04.704609 8196 ts_tablet_manager.cc:1428] T 3aee40177a6f4c7ab32cab53d99b6aa0 P f4d8d8d0958e4137ba9aa4b11fb6a256: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:04.705987 8903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:04.701876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44540 (local address 127.11.206.66:37711)
0812 00:05:04.702091 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:04.702096 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:04.702107 (+ 11us) server_negotiation.cc:407] Connection header received
0812 00:05:04.702149 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:04.702151 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:04.702167 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:04.702238 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:05:04.702382 (+ 144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:04.703171 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:04.704819 (+ 1648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:04.705658 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:04.705734 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:04.705800 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:04.705891 (+ 91us) server_negotiation.cc:299] Negotiation successful
0812 00:05:04.705923 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":90,"threads_started":1}
I20260812 00:05:04.705994 8896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:04.701619 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.66:37711 (local address 127.0.0.1:44540)
0812 00:05:04.701734 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:04.701744 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:04.701801 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:04.702245 (+ 444us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:04.702246 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:04.702248 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:05:04.702303 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:04.702305 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:04.703247 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:04.703249 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:04.704269 (+ 1020us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:04.704273 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:04.705732 (+ 1459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:04.705733 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:04.705814 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:04.705819 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 00:05:04.705878 (+ 59us) client_negotiation.cc:240] Negotiation successful
0812 00:05:04.705921 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":72,"threads_started":1}
I20260812 00:05:04.706758 8513 tablet_service.cc:1467] Processing CreateTablet for tablet 3aee40177a6f4c7ab32cab53d99b6aa0 (DEFAULT_TABLE table=test-table [id=b73dd73f2bd448e78dd7a6d3c9c853b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:05:04.707070 8386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:04.701498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.67:44219 (local address 127.0.0.1:55584)
0812 00:05:04.701546 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:04.701556 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:04.701588 (+ 32us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:04.703550 (+ 1962us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:04.703551 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:04.703553 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:05:04.703591 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:04.703592 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:04.704651 (+ 1059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:04.704653 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:04.705732 (+ 1079us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:04.705735 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:04.706850 (+ 1115us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:04.706851 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:04.706914 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:04.706917 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:05:04.706966 (+ 49us) client_negotiation.cc:240] Negotiation successful
0812 00:05:04.707009 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
I20260812 00:05:04.707175 8513 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3aee40177a6f4c7ab32cab53d99b6aa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:04.707262 8901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:04.701595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55584 (local address 127.11.206.67:44219)
0812 00:05:04.703391 (+ 1796us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:04.703396 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:04.703406 (+ 10us) server_negotiation.cc:407] Connection header received
0812 00:05:04.703446 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:04.703448 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:04.703464 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:04.703544 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:05:04.703641 (+ 97us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:04.704583 (+ 942us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:04.705820 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:04.706734 (+ 914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:04.706847 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:04.706908 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:04.706995 (+ 87us) server_negotiation.cc:299] Negotiation successful
0812 00:05:04.707034 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1754,"thread_start_us":101,"threads_started":1}
I20260812 00:05:04.707831 8764 tablet_service.cc:1467] Processing CreateTablet for tablet 3aee40177a6f4c7ab32cab53d99b6aa0 (DEFAULT_TABLE table=test-table [id=b73dd73f2bd448e78dd7a6d3c9c853b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:05:04.708113 8764 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3aee40177a6f4c7ab32cab53d99b6aa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:04.710108 8910 tablet_bootstrap.cc:492] T 3aee40177a6f4c7ab32cab53d99b6aa0 P ad0579eb47574d1c9ac95e43e57aaa2e: Bootstrap starting.
I20260812 00:05:04.710775 8910 tablet_bootstrap.cc:654] T 3aee40177a6f4c7ab32cab53d99b6aa0 P ad0579eb47574d1c9ac95e43e57aaa2e: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:04.710988 8912 tablet_bootstrap.cc:492] T 3aee40177a6f4c7ab32cab53d99b6aa0 P e993531ff48748e79f91e14c16d46ece: Bootstrap starting.
I20260812 00:05:04.711257 8910 log.cc:824] T 3aee40177a6f4c7ab32cab53d99b6aa0 P ad0579eb47574d1c9ac95e43e57aaa2e: Log is configured to *not* fsync() on all Append() calls
I20260812 00:05:04.711620 8912 tablet_bootstrap.cc:654] T 3aee40177a6f4c7ab32cab53d99b6aa0 P e993531ff48748e79f91e14c16d46ece: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:04.711884 8910 tablet_bootstrap.cc:492] T 3aee40177a6f4c7ab32cab53d99b6aa0 P ad0579eb47574d1c9ac95e43e57aaa2e: No bootstrap required, opened a new log
I20260812 00:05:04.711937 8910 ts_tablet_manager.cc:1397] T 3aee40177a6f4c7ab32cab53d99b6aa0 P ad0579eb47574d1c9ac95e43e57aaa2e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 00:05:04.712091 8912 log.cc:824] T 3aee40177a6f4c7ab32cab53d99b6aa0 P e993531ff48748e79f91e14c16d46ece: Log is configured to *not* fsync() on all Append() calls
I20260812 00:05:04.712787 8912 tablet_bootstrap.cc:492] T 3aee40177a6f4c7ab32cab53d99b6aa0 P e993531ff48748e79f91e14c16d46ece: No bootstrap required, opened a new log
I20260812 00:05:04.712843 8912 ts_tablet_manager.cc:1397] T 3aee40177a6f4c7ab32cab53d99b6aa0 P e993531ff48748e79f91e14c16d46ece: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 00:05:04.713613 8910 raft_consensus.cc:348] T 3aee40177a6f4c7ab32cab53d99b6aa0 P ad0579eb47574d1c9ac95e43e57aaa2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e993531ff48748e79f91e14c16d46ece" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 44219 } } peers { permanent_uuid: "ad0579eb47574d1c9ac95e43e57aaa2e" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37711 } } peers { permanent_uuid: "f4d8d8d0958e4137ba9aa4b11fb6a256" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 42235 } }
I20260812 00:05:04.713753 8910 raft_consensus.cc:374] T 3aee40177a6f4c7ab32cab53d99b6aa0 P ad0579eb47574d1c9ac95e43e57aaa2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:04.713785 8910 raft_consensus.cc:729] T 3aee40177a6f4c7ab32cab53d99b6aa0 P ad0579eb47574d1c9ac95e43e57aaa2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad0579eb47574d1c9ac95e43e57aaa2e, State: Initialized, Role: FOLLOWER
I20260812 00:05:04.713891 8910 consensus_queue.cc:260] T 3aee40177a6f4c7ab32cab53d99b6aa0 P ad0579eb47574d1c9ac95e43e57aaa2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e993531ff48748e79f91e14c16d46ece" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 44219 } } peers { permanent_uuid: "ad0579eb47574d1c9ac95e43e57aaa2e" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37711 } } peers { permanent_uuid: "f4d8d8d0958e4137ba9aa4b11fb6a256" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 42235 } }
I20260812 00:05:04.714119 8910 ts_tablet_manager.cc:1428] T 3aee40177a6f4c7ab32cab53d99b6aa0 P ad0579eb47574d1c9ac95e43e57aaa2e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 00:05:04.714145 8634 heartbeater.cc:503] Master 127.11.206.126:38625 was elected leader, sending a full tablet report...
I20260812 00:05:04.714578 8912 raft_consensus.cc:348] T 3aee40177a6f4c7ab32cab53d99b6aa0 P e993531ff48748e79f91e14c16d46ece [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e993531ff48748e79f91e14c16d46ece" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 44219 } } peers { permanent_uuid: "ad0579eb47574d1c9ac95e43e57aaa2e" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37711 } } peers { permanent_uuid: "f4d8d8d0958e4137ba9aa4b11fb6a256" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 42235 } }
I20260812 00:05:04.714737 8912 raft_consensus.cc:374] T 3aee40177a6f4c7ab32cab53d99b6aa0 P e993531ff48748e79f91e14c16d46ece [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:04.714783 8912 raft_consensus.cc:729] T 3aee40177a6f4c7ab32cab53d99b6aa0 P e993531ff48748e79f91e14c16d46ece [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e993531ff48748e79f91e14c16d46ece, State: Initialized, Role: FOLLOWER
I20260812 00:05:04.714890 8912 consensus_queue.cc:260] T 3aee40177a6f4c7ab32cab53d99b6aa0 P e993531ff48748e79f91e14c16d46ece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e993531ff48748e79f91e14c16d46ece" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 44219 } } peers { permanent_uuid: "ad0579eb47574d1c9ac95e43e57aaa2e" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37711 } } peers { permanent_uuid: "f4d8d8d0958e4137ba9aa4b11fb6a256" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 42235 } }
I20260812 00:05:04.715173 8880 heartbeater.cc:503] Master 127.11.206.126:38625 was elected leader, sending a full tablet report...
I20260812 00:05:04.715174 8912 ts_tablet_manager.cc:1428] T 3aee40177a6f4c7ab32cab53d99b6aa0 P e993531ff48748e79f91e14c16d46ece: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
W20260812 00:05:04.793457 8636 tablet.cc:2369] T 3aee40177a6f4c7ab32cab53d99b6aa0 P ad0579eb47574d1c9ac95e43e57aaa2e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:05:04.813361 8918 raft_consensus.cc:482] T 3aee40177a6f4c7ab32cab53d99b6aa0 P ad0579eb47574d1c9ac95e43e57aaa2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:05:04.813513 8918 raft_consensus.cc:504] T 3aee40177a6f4c7ab32cab53d99b6aa0 P ad0579eb47574d1c9ac95e43e57aaa2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e993531ff48748e79f91e14c16d46ece" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 44219 } } peers { permanent_uuid: "ad0579eb47574d1c9ac95e43e57aaa2e" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37711 } } peers { permanent_uuid: "f4d8d8d0958e4137ba9aa4b11fb6a256" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 42235 } }
I20260812 00:05:04.813872 8918 leader_election.cc:288] T 3aee40177a6f4c7ab32cab53d99b6aa0 P ad0579eb47574d1c9ac95e43e57aaa2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e993531ff48748e79f91e14c16d46ece (127.11.206.67:44219), f4d8d8d0958e4137ba9aa4b11fb6a256 (127.11.206.65:42235)
I20260812 00:05:04.816751 8901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:04.814149 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.66:37085 (local address 127.11.206.67:44219)
0812 00:05:04.814212 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:04.814214 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:04.814410 (+ 196us) server_negotiation.cc:407] Connection header received
0812 00:05:04.814448 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:04.814449 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:04.814459 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:04.814535 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:05:04.814682 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:04.815131 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:04.816067 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:04.816438 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:04.816504 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:04.816512 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:04.816642 (+ 130us) server_negotiation.cc:299] Negotiation successful
0812 00:05:04.816683 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260812 00:05:04.816764 8388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:04.814232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.66:50411 (local address 127.11.206.65:42235)
0812 00:05:04.814284 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:04.814286 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:04.814296 (+ 10us) server_negotiation.cc:407] Connection header received
0812 00:05:04.814330 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:04.814332 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:04.814341 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:04.814402 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:05:04.814625 (+ 223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:04.815123 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:04.816060 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:04.816422 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:04.816481 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:04.816490 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:04.816640 (+ 150us) server_negotiation.cc:299] Negotiation successful
0812 00:05:04.816698 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260812 00:05:04.816790 8920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:04.814074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.67:44219 (local address 127.11.206.66:37085)
0812 00:05:04.814265 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:04.814276 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:04.814344 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:04.814541 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:04.814542 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:04.814543 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:05:04.814611 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:04.814613 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:04.815237 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:04.815238 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:04.815979 (+ 741us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:04.815981 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:04.816517 (+ 536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:04.816518 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:04.816576 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:04.816579 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:05:04.816626 (+ 47us) client_negotiation.cc:240] Negotiation successful
0812 00:05:04.816681 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":174,"mutex_wait_us":1,"thread_start_us":109,"threads_started":1}
I20260812 00:05:04.817093 8638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:04.814063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.65:42235 (local address 127.11.206.66:50411)
0812 00:05:04.814114 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:04.814156 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:04.814209 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:04.814446 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:04.814448 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:04.814450 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:05:04.814532 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:04.814534 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:04.815207 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:04.815208 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:04.815973 (+ 765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:04.815975 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:04.816499 (+ 524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:04.816500 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:04.816577 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:04.816579 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 00:05:04.816625 (+ 46us) client_negotiation.cc:240] Negotiation successful
0812 00:05:04.816683 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30,"mutex_wait_us":20}
I20260812 00:05:04.817184 8795 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3aee40177a6f4c7ab32cab53d99b6aa0" candidate_uuid: "ad0579eb47574d1c9ac95e43e57aaa2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e993531ff48748e79f91e14c16d46ece" is_pre_election: true
I20260812 00:05:04.817348 8795 raft_consensus.cc:2454] T 3aee40177a6f4c7ab32cab53d99b6aa0 P e993531ff48748e79f91e14c16d46ece [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad0579eb47574d1c9ac95e43e57aaa2e in term 0.
I20260812 00:05:04.817397 8303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3aee40177a6f4c7ab32cab53d99b6aa0" candidate_uuid: "ad0579eb47574d1c9ac95e43e57aaa2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4d8d8d0958e4137ba9aa4b11fb6a256" is_pre_election: true
I20260812 00:05:04.817546 8303 raft_consensus.cc:2454] T 3aee40177a6f4c7ab32cab53d99b6aa0 P f4d8d8d0958e4137ba9aa4b11fb6a256 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad0579eb47574d1c9ac95e43e57aaa2e in term 0.
I20260812 00:05:04.817624 8423 leader_election.cc:302] T 3aee40177a6f4c7ab32cab53d99b6aa0 P ad0579eb47574d1c9ac95e43e57aaa2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad0579eb47574d1c9ac95e43e57aaa2e, e993531ff48748e79f91e14c16d46ece; no voters:
I20260812 00:05:04.817778 8918 raft_consensus.cc:2781] T 3aee40177a6f4c7ab32cab53d99b6aa0 P ad0579eb47574d1c9ac95e43e57aaa2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:05:04.817838 8918 raft_consensus.cc:482] T 3aee40177a6f4c7ab32cab53d99b6aa0 P ad0579eb47574d1c9ac95e43e57aaa2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:05:04.817855 8918 raft_consensus.cc:3037] T 3aee40177a6f4c7ab32cab53d99b6aa0 P ad0579eb47574d1c9ac95e43e57aaa2e [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:04.818734 8918 raft_consensus.cc:504] T 3aee40177a6f4c7ab32cab53d99b6aa0 P ad0579eb47574d1c9ac95e43e57aaa2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e993531ff48748e79f91e14c16d46ece" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 44219 } } peers { permanent_uuid: "ad0579eb47574d1c9ac95e43e57aaa2e" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37711 } } peers { permanent_uuid: "f4d8d8d0958e4137ba9aa4b11fb6a256" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 42235 } }
I20260812 00:05:04.818873 8918 leader_election.cc:288] T 3aee40177a6f4c7ab32cab53d99b6aa0 P ad0579eb47574d1c9ac95e43e57aaa2e [CANDIDATE]: Term 1 election: Requested vote from peers e993531ff48748e79f91e14c16d46ece (127.11.206.67:44219), f4d8d8d0958e4137ba9aa4b11fb6a256 (127.11.206.65:42235)
I20260812 00:05:04.819036 8303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3aee40177a6f4c7ab32cab53d99b6aa0" candidate_uuid: "ad0579eb47574d1c9ac95e43e57aaa2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4d8d8d0958e4137ba9aa4b11fb6a256"
I20260812 00:05:04.819031 8795 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3aee40177a6f4c7ab32cab53d99b6aa0" candidate_uuid: "ad0579eb47574d1c9ac95e43e57aaa2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e993531ff48748e79f91e14c16d46ece"
I20260812 00:05:04.819118 8303 raft_consensus.cc:3037] T 3aee40177a6f4c7ab32cab53d99b6aa0 P f4d8d8d0958e4137ba9aa4b11fb6a256 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:04.819134 8795 raft_consensus.cc:3037] T 3aee40177a6f4c7ab32cab53d99b6aa0 P e993531ff48748e79f91e14c16d46ece [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:04.819871 8795 raft_consensus.cc:2454] T 3aee40177a6f4c7ab32cab53d99b6aa0 P e993531ff48748e79f91e14c16d46ece [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad0579eb47574d1c9ac95e43e57aaa2e in term 1.
I20260812 00:05:04.820034 8423 leader_election.cc:302] T 3aee40177a6f4c7ab32cab53d99b6aa0 P ad0579eb47574d1c9ac95e43e57aaa2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad0579eb47574d1c9ac95e43e57aaa2e, e993531ff48748e79f91e14c16d46ece; no voters:
I20260812 00:05:04.820168 8918 raft_consensus.cc:2781] T 3aee40177a6f4c7ab32cab53d99b6aa0 P ad0579eb47574d1c9ac95e43e57aaa2e [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:05:04.820183 8303 raft_consensus.cc:2454] T 3aee40177a6f4c7ab32cab53d99b6aa0 P f4d8d8d0958e4137ba9aa4b11fb6a256 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad0579eb47574d1c9ac95e43e57aaa2e in term 1.
I20260812 00:05:04.820329 8918 raft_consensus.cc:686] T 3aee40177a6f4c7ab32cab53d99b6aa0 P ad0579eb47574d1c9ac95e43e57aaa2e [term 1 LEADER]: Becoming Leader. State: Replica: ad0579eb47574d1c9ac95e43e57aaa2e, State: Running, Role: LEADER
I20260812 00:05:04.820430 8918 consensus_queue.cc:237] T 3aee40177a6f4c7ab32cab53d99b6aa0 P ad0579eb47574d1c9ac95e43e57aaa2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e993531ff48748e79f91e14c16d46ece" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 44219 } } peers { permanent_uuid: "ad0579eb47574d1c9ac95e43e57aaa2e" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37711 } } peers { permanent_uuid: "f4d8d8d0958e4137ba9aa4b11fb6a256" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 42235 } }
I20260812 00:05:04.821311 8055 catalog_manager.cc:5495] T 3aee40177a6f4c7ab32cab53d99b6aa0 P ad0579eb47574d1c9ac95e43e57aaa2e reported cstate change: term changed from 0 to 1, leader changed from <none> to ad0579eb47574d1c9ac95e43e57aaa2e (127.11.206.66). New cstate: current_term: 1 leader_uuid: "ad0579eb47574d1c9ac95e43e57aaa2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e993531ff48748e79f91e14c16d46ece" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 44219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad0579eb47574d1c9ac95e43e57aaa2e" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4d8d8d0958e4137ba9aa4b11fb6a256" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 42235 } health_report { overall_health: UNKNOWN } } }
I20260812 00:05:04.850579 8903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:04.848261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44550 (local address 127.11.206.66:37711)
0812 00:05:04.848326 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:04.848328 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:04.848335 (+ 7us) server_negotiation.cc:407] Connection header received
0812 00:05:04.848371 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:04.848371 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:04.848393 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:04.848456 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:05:04.848578 (+ 122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:04.849053 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:04.849829 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:04.850022 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:04.850077 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:04.850222 (+ 145us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:05:04.850333 (+ 111us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:05:04.850435 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:04.850453 (+ 18us) server_negotiation.cc:299] Negotiation successful
0812 00:05:04.850476 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260812 00:05:04.852496 8795 raft_consensus.cc:1261] T 3aee40177a6f4c7ab32cab53d99b6aa0 P e993531ff48748e79f91e14c16d46ece [term 1 FOLLOWER]: Refusing update from remote peer ad0579eb47574d1c9ac95e43e57aaa2e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:05:04.852501 8303 raft_consensus.cc:1261] T 3aee40177a6f4c7ab32cab53d99b6aa0 P f4d8d8d0958e4137ba9aa4b11fb6a256 [term 1 FOLLOWER]: Refusing update from remote peer ad0579eb47574d1c9ac95e43e57aaa2e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:05:04.852871 8918 consensus_queue.cc:1035] T 3aee40177a6f4c7ab32cab53d99b6aa0 P ad0579eb47574d1c9ac95e43e57aaa2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e993531ff48748e79f91e14c16d46ece" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 44219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:05:04.853013 8923 consensus_queue.cc:1035] T 3aee40177a6f4c7ab32cab53d99b6aa0 P ad0579eb47574d1c9ac95e43e57aaa2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4d8d8d0958e4137ba9aa4b11fb6a256" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 42235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:05:04.855031 8926 mvcc.cc:205] Tried to move back new op lower bound from 7317475757473132544 to 7317475757344956416. Current Snapshot: MvccSnapshot[applied={T|T < 7317475757473132544}]
I20260812 00:05:04.855672 8927 mvcc.cc:205] Tried to move back new op lower bound from 7317475757473132544 to 7317475757344956416. Current Snapshot: MvccSnapshot[applied={T|T < 7317475757473132544}]
I20260812 00:05:04.855808 8929 mvcc.cc:205] Tried to move back new op lower bound from 7317475757473132544 to 7317475757344956416. Current Snapshot: MvccSnapshot[applied={T|T < 7317475757473132544}]
I20260812 00:05:04.857337 8054 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38762:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:05:04.857463 8054 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38762:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:05:04.858203 8054 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7d2f9fecf22244cbaa8408406566baa6: Sending DeleteTablet for 3 replicas of tablet 3aee40177a6f4c7ab32cab53d99b6aa0
I20260812 00:05:04.858461 8264 tablet_service.cc:1514] Processing DeleteTablet for tablet 3aee40177a6f4c7ab32cab53d99b6aa0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:05:04 UTC) from {username='kudu', principal='kudu/127.11.206.126@KRBTEST.COM'} at 127.0.0.1:49202
I20260812 00:05:04.858537 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 8124
I20260812 00:05:04.858531 8764 tablet_service.cc:1514] Processing DeleteTablet for tablet 3aee40177a6f4c7ab32cab53d99b6aa0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:05:04 UTC) from {username='kudu', principal='kudu/127.11.206.126@KRBTEST.COM'} at 127.0.0.1:55584
I20260812 00:05:04.858803 8954 tablet_replica.cc:330] T 3aee40177a6f4c7ab32cab53d99b6aa0 P e993531ff48748e79f91e14c16d46ece: stopping tablet replica
I20260812 00:05:04.858892 8954 raft_consensus.cc:2229] T 3aee40177a6f4c7ab32cab53d99b6aa0 P e993531ff48748e79f91e14c16d46ece [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:05:04.858978 8954 raft_consensus.cc:2258] T 3aee40177a6f4c7ab32cab53d99b6aa0 P e993531ff48748e79f91e14c16d46ece [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:05:04.861661 8513 tablet_service.cc:1514] Processing DeleteTablet for tablet 3aee40177a6f4c7ab32cab53d99b6aa0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:05:04 UTC) from {username='kudu', principal='kudu/127.11.206.126@KRBTEST.COM'} at 127.0.0.1:44540
I20260812 00:05:04.861914 8956 tablet_replica.cc:330] T 3aee40177a6f4c7ab32cab53d99b6aa0 P ad0579eb47574d1c9ac95e43e57aaa2e: stopping tablet replica
I20260812 00:05:04.862059 8956 raft_consensus.cc:2229] T 3aee40177a6f4c7ab32cab53d99b6aa0 P ad0579eb47574d1c9ac95e43e57aaa2e [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:05:04.862226 8956 raft_consensus.cc:2258] T 3aee40177a6f4c7ab32cab53d99b6aa0 P ad0579eb47574d1c9ac95e43e57aaa2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:05:04.864279 8956 ts_tablet_manager.cc:1905] T 3aee40177a6f4c7ab32cab53d99b6aa0 P ad0579eb47574d1c9ac95e43e57aaa2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:05:04.866182 8956 ts_tablet_manager.cc:1918] T 3aee40177a6f4c7ab32cab53d99b6aa0 P ad0579eb47574d1c9ac95e43e57aaa2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:05:04.866315 8956 log.cc:1196] T 3aee40177a6f4c7ab32cab53d99b6aa0 P ad0579eb47574d1c9ac95e43e57aaa2e: Deleting WAL directory at /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-1/wal/wals/3aee40177a6f4c7ab32cab53d99b6aa0
I20260812 00:05:04.866540 8954 ts_tablet_manager.cc:1905] T 3aee40177a6f4c7ab32cab53d99b6aa0 P e993531ff48748e79f91e14c16d46ece: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:05:04.866780 8956 ts_tablet_manager.cc:1939] T 3aee40177a6f4c7ab32cab53d99b6aa0 P ad0579eb47574d1c9ac95e43e57aaa2e: Deleting consensus metadata
I20260812 00:05:04.867295 8029 catalog_manager.cc:4841] TS ad0579eb47574d1c9ac95e43e57aaa2e (127.11.206.66:37711): tablet 3aee40177a6f4c7ab32cab53d99b6aa0 (table test-table [id=b73dd73f2bd448e78dd7a6d3c9c853b4]) successfully deleted
I20260812 00:05:04.868161 8954 ts_tablet_manager.cc:1918] T 3aee40177a6f4c7ab32cab53d99b6aa0 P e993531ff48748e79f91e14c16d46ece: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:05:04.868251 8954 log.cc:1196] T 3aee40177a6f4c7ab32cab53d99b6aa0 P e993531ff48748e79f91e14c16d46ece: Deleting WAL directory at /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-2/wal/wals/3aee40177a6f4c7ab32cab53d99b6aa0
I20260812 00:05:04.868589 8954 ts_tablet_manager.cc:1939] T 3aee40177a6f4c7ab32cab53d99b6aa0 P e993531ff48748e79f91e14c16d46ece: Deleting consensus metadata
I20260812 00:05:04.869091 8029 catalog_manager.cc:4841] TS e993531ff48748e79f91e14c16d46ece (127.11.206.67:44219): tablet 3aee40177a6f4c7ab32cab53d99b6aa0 (table test-table [id=b73dd73f2bd448e78dd7a6d3c9c853b4]) successfully deleted
W20260812 00:05:04.874488 8030 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.206.65:42235 (error 108)
I20260812 00:05:04.874898 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 8383
I20260812 00:05:04.875031 8386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:04.874869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.65:42235 (local address 127.0.0.1:56038)
0812 00:05:04.874936 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:04.874997 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.65:42235: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260812 00:05:04.882115 8030 catalog_manager.cc:4584] TS f4d8d8d0958e4137ba9aa4b11fb6a256 (127.11.206.65:42235): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 3aee40177a6f4c7ab32cab53d99b6aa0: Network error: Client connection negotiation failed: client connection to 127.11.206.65:42235: connect: Connection refused (error 111)
I20260812 00:05:04.891708 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 8642
I20260812 00:05:04.903131 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 7993
I20260812 00:05:24.917966 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:38625
--webserver_interface=127.11.206.126
--webserver_port=39517
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab
--principal=kudu/127.11.206.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:40415
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.206.126:38625
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:05:25.000253 8959 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:25.000474 8959 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:25.000496 8959 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:25.001644 8959 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260812 00:05:25.001684 8959 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260812 00:05:25.001696 8959 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260812 00:05:25.001706 8959 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:05:25.001718 8959 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:25.001729 8959 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:25.001740 8959 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:05:25.001751 8959 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:05:25.003233 8959 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:40415
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.11.206.126:38625
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab
--principal=kudu/127.11.206.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:38625
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.206.126
--webserver_port=39517
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8959
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:05:25.003432 8959 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:25.003609 8959 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 00:05:25.008850 8959 server_base.cc:1034] running on GCE node
W20260812 00:05:25.008811 8966 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:25.008842 8965 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:25.008811 8971 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:25.009289 8959 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:25.009649 8959 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:25.010797 8959 hybrid_clock.cc:648] HybridClock initialized: now 1786493125010777 us; error 33 us; skew 500 ppm
Aug 12 00:05:25 dist-test-slave-f0tn krb5kdc[7044](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493125, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:25.021929 8959 init.cc:377] Logged in from keytab as kudu/127.11.206.126@KRBTEST.COM (short username kudu)
I20260812 00:05:25.022379 8959 webserver.cc:460] Webserver started at http://127.11.206.126:39517/ using document root <none> and password file <none>
I20260812 00:05:25.022569 8959 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:25.022619 8959 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:25.024020 8959 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:05:25.024763 8982 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:25.025022 8959 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260812 00:05:25.025142 8959 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/master-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/master-0/wal
uuid: "7d2f9fecf22244cbaa8408406566baa6"
format_stamp: "Formatted at 2026-08-12 00:04:43 on dist-test-slave-f0tn"
server_key: "41ba2f9203c8c0f16f37c0074a5c56c9"
server_key_iv: "4fec244f546a79e4deffcd0f943a15b1"
server_key_version: "encryptionkey@0"
I20260812 00:05:25.025552 8959 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:25.047724 8959 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:25.049950 8959 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:25.050096 8959 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:25.053956 8959 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.126:38625
I20260812 00:05:25.053992 9063 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.126:38625 every 8 connection(s)
I20260812 00:05:25.054379 8959 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
I20260812 00:05:25.055903 9064 sys_catalog.cc:263] Verifying existing consensus state
I20260812 00:05:25.056542 9064 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7d2f9fecf22244cbaa8408406566baa6: Bootstrap starting.
I20260812 00:05:25.063966 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 8959
I20260812 00:05:25.064291 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.65:42235
--local_ip_for_outbound_sockets=127.11.206.65
--tserver_master_addrs=127.11.206.126:38625
--webserver_port=43343
--webserver_interface=127.11.206.65
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.65.keytab
--principal=kudu/127.11.206.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:40415
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:05:25.064429 9064 log.cc:824] T 00000000000000000000000000000000 P 7d2f9fecf22244cbaa8408406566baa6: Log is configured to *not* fsync() on all Append() calls
I20260812 00:05:25.066673 9064 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7d2f9fecf22244cbaa8408406566baa6: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 00:05:25.066957 9064 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7d2f9fecf22244cbaa8408406566baa6: Bootstrap complete.
I20260812 00:05:25.069021 9064 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7d2f9fecf22244cbaa8408406566baa6 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d2f9fecf22244cbaa8408406566baa6" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 38625 } }
I20260812 00:05:25.069247 9064 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7d2f9fecf22244cbaa8408406566baa6 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2f9fecf22244cbaa8408406566baa6, State: Initialized, Role: FOLLOWER
I20260812 00:05:25.069407 9064 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7d2f9fecf22244cbaa8408406566baa6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d2f9fecf22244cbaa8408406566baa6" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 38625 } }
I20260812 00:05:25.069479 9064 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7d2f9fecf22244cbaa8408406566baa6 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:05:25.069521 9064 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7d2f9fecf22244cbaa8408406566baa6 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:05:25.069567 9064 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7d2f9fecf22244cbaa8408406566baa6 [term 2 FOLLOWER]: Advancing to term 3
I20260812 00:05:25.070549 9064 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7d2f9fecf22244cbaa8408406566baa6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d2f9fecf22244cbaa8408406566baa6" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 38625 } }
I20260812 00:05:25.070641 9064 leader_election.cc:302] T 00000000000000000000000000000000 P 7d2f9fecf22244cbaa8408406566baa6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7d2f9fecf22244cbaa8408406566baa6; no voters:
I20260812 00:05:25.070798 9064 leader_election.cc:288] T 00000000000000000000000000000000 P 7d2f9fecf22244cbaa8408406566baa6 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260812 00:05:25.070845 9071 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7d2f9fecf22244cbaa8408406566baa6 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 00:05:25.070969 9071 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7d2f9fecf22244cbaa8408406566baa6 [term 3 LEADER]: Becoming Leader. State: Replica: 7d2f9fecf22244cbaa8408406566baa6, State: Running, Role: LEADER
I20260812 00:05:25.071069 9064 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7d2f9fecf22244cbaa8408406566baa6 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:05:25.071055 9071 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7d2f9fecf22244cbaa8408406566baa6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d2f9fecf22244cbaa8408406566baa6" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 38625 } }
I20260812 00:05:25.071457 9075 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7d2f9fecf22244cbaa8408406566baa6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "7d2f9fecf22244cbaa8408406566baa6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d2f9fecf22244cbaa8408406566baa6" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 38625 } } }
I20260812 00:05:25.071544 9075 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7d2f9fecf22244cbaa8408406566baa6 [sys.catalog]: This master's current role is: LEADER
I20260812 00:05:25.071702 9077 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7d2f9fecf22244cbaa8408406566baa6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7d2f9fecf22244cbaa8408406566baa6. Latest consensus state: current_term: 3 leader_uuid: "7d2f9fecf22244cbaa8408406566baa6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d2f9fecf22244cbaa8408406566baa6" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 38625 } } }
I20260812 00:05:25.071761 9077 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7d2f9fecf22244cbaa8408406566baa6 [sys.catalog]: This master's current role is: LEADER
I20260812 00:05:25.071933 9086 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:05:25.072757 9086 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:05:25.072860 9086 catalog_manager.cc:1259] Loaded cluster ID: ca84d59e1d19460cb118af64f2c3e7f9
I20260812 00:05:25.072892 9086 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:05:25.073845 9086 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:05:25.074009 9086 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 7d2f9fecf22244cbaa8408406566baa6: Loaded TSK: 0
I20260812 00:05:25.074046 9086 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 7d2f9fecf22244cbaa8408406566baa6: Loaded TSK: 1
F20260812 00:05:25.074252 9086 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fe7ab1ba9ad google::LogMessage::Fail() at ??:0
@ 0x7fe7ab1bd88a google::LogMessage::SendToLog() at ??:0
@ 0x7fe7ab1ba4de google::LogMessage::Flush() at ??:0
@ 0x7fe7ab1bba19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fe7ad927104 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7fe7ad924d41 kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7fe7b31181cd kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7fe7b311848e kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7fe7b3118594 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7fe7b30dec48 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7fe7b30e8ad0 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fe7ad0880d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fe7ad07d954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7fe7adee16db start_thread at ??:0
@ 0x7fe7a9cb861f clone at ??:0
W20260812 00:05:25.161659 9070 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:25.161885 9070 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:25.161917 9070 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:25.163089 9070 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:25.163131 9070 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:25.163166 9070 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.65
I20260812 00:05:25.164609 9070 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:40415
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.65.keytab
--principal=kudu/127.11.206.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.65:42235
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.206.65
--webserver_port=43343
--tserver_master_addrs=127.11.206.126:38625
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9070
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.65
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:05:25.164842 9070 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:25.165064 9070 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:25.171279 9149 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:25.171322 9148 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:25.171491 9070 server_base.cc:1034] running on GCE node
W20260812 00:05:25.171298 9157 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:25.171782 9070 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:25.172024 9070 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:25.173177 9070 hybrid_clock.cc:648] HybridClock initialized: now 1786493125173161 us; error 32 us; skew 500 ppm
Aug 12 00:05:25 dist-test-slave-f0tn krb5kdc[7044](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493125, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:25.175726 9070 init.cc:377] Logged in from keytab as kudu/127.11.206.65@KRBTEST.COM (short username kudu)
I20260812 00:05:25.176182 9070 webserver.cc:460] Webserver started at http://127.11.206.65:43343/ using document root <none> and password file <none>
I20260812 00:05:25.176391 9070 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:25.176435 9070 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:25.177832 9070 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:05:25.178537 9166 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:25.178735 9070 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:05:25.178823 9070 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-0/wal
uuid: "f4d8d8d0958e4137ba9aa4b11fb6a256"
format_stamp: "Formatted at 2026-08-12 00:04:43 on dist-test-slave-f0tn"
server_key: "7314ca9aa040922a0d6d83a53294dc20"
server_key_iv: "8318863b460a508ccf07c0ace85b1fae"
server_key_version: "encryptionkey@0"
I20260812 00:05:25.179178 9070 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:25.202298 9070 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:25.204747 9070 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:25.204900 9070 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:25.205170 9070 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:05:25.205691 9181 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260812 00:05:25.207726 9070 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 00:05:25.207774 9070 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260812 00:05:25.207808 9070 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260812 00:05:25.208479 9070 ts_tablet_manager.cc:610] Registered 1 tablets
I20260812 00:05:25.208513 9070 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260812 00:05:25.208607 9181 tablet_bootstrap.cc:492] T 3aee40177a6f4c7ab32cab53d99b6aa0 P f4d8d8d0958e4137ba9aa4b11fb6a256: Bootstrap starting.
I20260812 00:05:25.216351 9070 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.65:42235
I20260812 00:05:25.216428 9356 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.65:42235 every 8 connection(s)
I20260812 00:05:25.216917 9070 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
I20260812 00:05:25.219170 9181 log.cc:824] T 3aee40177a6f4c7ab32cab53d99b6aa0 P f4d8d8d0958e4137ba9aa4b11fb6a256: Log is configured to *not* fsync() on all Append() calls
I20260812 00:05:25.220032 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 9070
I20260812 00:05:25.220371 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.66:37711
--local_ip_for_outbound_sockets=127.11.206.66
--tserver_master_addrs=127.11.206.126:38625
--webserver_port=36945
--webserver_interface=127.11.206.66
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.66.keytab
--principal=kudu/127.11.206.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:40415
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:05:25.222146 9181 tablet_bootstrap.cc:492] T 3aee40177a6f4c7ab32cab53d99b6aa0 P f4d8d8d0958e4137ba9aa4b11fb6a256: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 00:05:25.222422 9181 tablet_bootstrap.cc:492] T 3aee40177a6f4c7ab32cab53d99b6aa0 P f4d8d8d0958e4137ba9aa4b11fb6a256: Bootstrap complete.
I20260812 00:05:25.223179 9181 ts_tablet_manager.cc:1397] T 3aee40177a6f4c7ab32cab53d99b6aa0 P f4d8d8d0958e4137ba9aa4b11fb6a256: Time spent bootstrapping tablet: real 0.015s user 0.008s sys 0.004s
I20260812 00:05:25.224210 9181 raft_consensus.cc:348] T 3aee40177a6f4c7ab32cab53d99b6aa0 P f4d8d8d0958e4137ba9aa4b11fb6a256 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e993531ff48748e79f91e14c16d46ece" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 44219 } } peers { permanent_uuid: "ad0579eb47574d1c9ac95e43e57aaa2e" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37711 } } peers { permanent_uuid: "f4d8d8d0958e4137ba9aa4b11fb6a256" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 42235 } }
I20260812 00:05:25.224439 9181 raft_consensus.cc:729] T 3aee40177a6f4c7ab32cab53d99b6aa0 P f4d8d8d0958e4137ba9aa4b11fb6a256 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4d8d8d0958e4137ba9aa4b11fb6a256, State: Initialized, Role: FOLLOWER
I20260812 00:05:25.224591 9181 consensus_queue.cc:260] T 3aee40177a6f4c7ab32cab53d99b6aa0 P f4d8d8d0958e4137ba9aa4b11fb6a256 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e993531ff48748e79f91e14c16d46ece" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 44219 } } peers { permanent_uuid: "ad0579eb47574d1c9ac95e43e57aaa2e" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37711 } } peers { permanent_uuid: "f4d8d8d0958e4137ba9aa4b11fb6a256" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 42235 } }
I20260812 00:05:25.224872 9181 ts_tablet_manager.cc:1428] T 3aee40177a6f4c7ab32cab53d99b6aa0 P f4d8d8d0958e4137ba9aa4b11fb6a256: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
W20260812 00:05:25.292850 9361 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:05:25.217877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:38625 (local address 127.11.206.65:45599)
0812 00:05:25.218107 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:25.218161 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:25.218798 (+ 637us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:25.292629 (+ 73831us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:38625: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":111,"threads_started":1}
W20260812 00:05:25.293121 9359 heartbeater.cc:644] Failed to heartbeat to 127.11.206.126:38625 (0 consecutive failures): Network error: Failed to ping master at 127.11.206.126:38625: Client connection negotiation failed: client connection to 127.11.206.126:38625: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 00:05:25.293505 9361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:25.293359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:38625 (local address 127.11.206.65:35757)
0812 00:05:25.293440 (+ 81us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:25.293484 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:38625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260812 00:05:25.293825 9361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:25.293741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:38625 (local address 127.11.206.65:44509)
0812 00:05:25.293777 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:25.293801 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:38625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
W20260812 00:05:25.293941 9359 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 00:05:25.324887 9363 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:25.325098 9363 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:25.325131 9363 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:25.326357 9363 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:25.326411 9363 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:25.326447 9363 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.66
I20260812 00:05:25.328011 9363 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:40415
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.66.keytab
--principal=kudu/127.11.206.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.66:37711
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.206.66
--webserver_port=36945
--tserver_master_addrs=127.11.206.126:38625
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9363
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.66
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:05:25.328274 9363 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:25.328500 9363 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:25.333653 9379 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:25.333683 9363 server_base.cc:1034] running on GCE node
W20260812 00:05:25.333719 9373 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:25.333743 9371 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:25.334033 9363 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:25.334262 9363 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:25.335395 9363 hybrid_clock.cc:648] HybridClock initialized: now 1786493125335384 us; error 29 us; skew 500 ppm
Aug 12 00:05:25 dist-test-slave-f0tn krb5kdc[7044](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493125, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:25.337800 9363 init.cc:377] Logged in from keytab as kudu/127.11.206.66@KRBTEST.COM (short username kudu)
I20260812 00:05:25.338203 9363 webserver.cc:460] Webserver started at http://127.11.206.66:36945/ using document root <none> and password file <none>
I20260812 00:05:25.338413 9363 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:25.338462 9363 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:25.339802 9363 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:05:25.340400 9397 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:25.340570 9363 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:25.340667 9363 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-1/wal
uuid: "ad0579eb47574d1c9ac95e43e57aaa2e"
format_stamp: "Formatted at 2026-08-12 00:04:43 on dist-test-slave-f0tn"
server_key: "7e25b54933d1ce01d206981093ec0610"
server_key_iv: "0203e6efb12bd9c8efc6dd8afbd1f798"
server_key_version: "encryptionkey@0"
I20260812 00:05:25.341010 9363 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:25.355976 9363 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:25.357868 9363 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:25.358006 9363 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:25.358227 9363 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:05:25.358533 9363 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:05:25.358574 9363 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:25.358603 9363 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:05:25.358635 9363 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:25.364279 9363 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.66:37711
I20260812 00:05:25.364337 9593 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.66:37711 every 8 connection(s)
I20260812 00:05:25.364672 9363 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
I20260812 00:05:25.365707 9601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:25.365315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:38625 (local address 127.11.206.66:34319)
0812 00:05:25.365481 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:25.365554 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:38625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":89,"threads_started":1}
W20260812 00:05:25.366101 9599 heartbeater.cc:644] Failed to heartbeat to 127.11.206.126:38625 (0 consecutive failures): Network error: Failed to ping master at 127.11.206.126:38625: Client connection negotiation failed: client connection to 127.11.206.126:38625: connect: Connection refused (error 111)
I20260812 00:05:25.366370 9601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:25.366290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:38625 (local address 127.11.206.66:34711)
0812 00:05:25.366328 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:25.366352 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:38625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
I20260812 00:05:25.366647 9601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:25.366540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:38625 (local address 127.11.206.66:37589)
0812 00:05:25.366582 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:25.366624 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:38625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260812 00:05:25.366758 9599 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260812 00:05:25.370162 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 9363
I20260812 00:05:25.370416 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.67:44219
--local_ip_for_outbound_sockets=127.11.206.67
--tserver_master_addrs=127.11.206.126:38625
--webserver_port=44303
--webserver_interface=127.11.206.67
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.67.keytab
--principal=kudu/127.11.206.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:40415
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:05:25.451293 9605 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:25.451485 9605 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:25.451507 9605 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:25.452577 9605 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:25.452620 9605 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:25.452646 9605 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.67
I20260812 00:05:25.454051 9605 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:40415
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.67.keytab
--principal=kudu/127.11.206.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.67:44219
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.206.67
--webserver_port=44303
--tserver_master_addrs=127.11.206.126:38625
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9605
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.67
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:05:25.454238 9605 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:25.454412 9605 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:25.459455 9620 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:25.459447 9625 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:25.459447 9621 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:25.459596 9605 server_base.cc:1034] running on GCE node
I20260812 00:05:25.459892 9605 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:25.460132 9605 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:25.461282 9605 hybrid_clock.cc:648] HybridClock initialized: now 1786493125461267 us; error 27 us; skew 500 ppm
Aug 12 00:05:25 dist-test-slave-f0tn krb5kdc[7044](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493125, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:25.463630 9605 init.cc:377] Logged in from keytab as kudu/127.11.206.67@KRBTEST.COM (short username kudu)
I20260812 00:05:25.464030 9605 webserver.cc:460] Webserver started at http://127.11.206.67:44303/ using document root <none> and password file <none>
I20260812 00:05:25.464279 9605 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:25.464330 9605 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:25.465953 9605 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 00:05:25.466572 9633 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:25.466753 9605 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:05:25.466835 9605 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-2/wal
uuid: "e993531ff48748e79f91e14c16d46ece"
format_stamp: "Formatted at 2026-08-12 00:04:43 on dist-test-slave-f0tn"
server_key: "36e5655dd3d2d91834129e1ae48a6800"
server_key_iv: "c113d41ebff120c6d0cd3e1ccd2f27f8"
server_key_version: "encryptionkey@0"
I20260812 00:05:25.467211 9605 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:25.487498 9605 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:25.489741 9605 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:25.489862 9605 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:25.490042 9605 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:05:25.490355 9605 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:05:25.490389 9605 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:25.490422 9605 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:05:25.490444 9605 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:25.495877 9605 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.67:44219
I20260812 00:05:25.495944 9827 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.67:44219 every 8 connection(s)
I20260812 00:05:25.496270 9605 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
I20260812 00:05:25.497354 9830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:25.496935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:38625 (local address 127.11.206.67:34511)
0812 00:05:25.497096 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:25.497175 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:38625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":85,"threads_started":1}
W20260812 00:05:25.497756 9828 heartbeater.cc:644] Failed to heartbeat to 127.11.206.126:38625 (0 consecutive failures): Network error: Failed to ping master at 127.11.206.126:38625: Client connection negotiation failed: client connection to 127.11.206.126:38625: connect: Connection refused (error 111)
I20260812 00:05:25.497999 9830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:25.497917 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:38625 (local address 127.11.206.67:55359)
0812 00:05:25.497955 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:25.497981 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:38625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
I20260812 00:05:25.498221 9830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:25.498162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:38625 (local address 127.11.206.67:53239)
0812 00:05:25.498191 (+ 29us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:25.498208 (+ 17us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:38625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":20}
W20260812 00:05:25.498301 9828 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260812 00:05:25.505895 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 9605
I20260812 00:05:26.294530 9834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:26.294290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:38625 (local address 127.11.206.65:45785)
0812 00:05:26.294444 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:26.294482 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:38625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":61,"threads_started":1}
I20260812 00:05:26.352447 9835 raft_consensus.cc:482] T 3aee40177a6f4c7ab32cab53d99b6aa0 P f4d8d8d0958e4137ba9aa4b11fb6a256 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:05:26.352569 9835 raft_consensus.cc:504] T 3aee40177a6f4c7ab32cab53d99b6aa0 P f4d8d8d0958e4137ba9aa4b11fb6a256 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e993531ff48748e79f91e14c16d46ece" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 44219 } } peers { permanent_uuid: "ad0579eb47574d1c9ac95e43e57aaa2e" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37711 } } peers { permanent_uuid: "f4d8d8d0958e4137ba9aa4b11fb6a256" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 42235 } }
I20260812 00:05:26.352916 9835 leader_election.cc:288] T 3aee40177a6f4c7ab32cab53d99b6aa0 P f4d8d8d0958e4137ba9aa4b11fb6a256 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e993531ff48748e79f91e14c16d46ece (127.11.206.67:44219), ad0579eb47574d1c9ac95e43e57aaa2e (127.11.206.66:37711)
Aug 12 00:05:26 dist-test-slave-f0tn krb5kdc[7044](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493125, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.65@KRBTEST.COM for kudu/127.11.206.66@KRBTEST.COM
Aug 12 00:05:26 dist-test-slave-f0tn krb5kdc[7044](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493125, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.65@KRBTEST.COM for kudu/127.11.206.67@KRBTEST.COM
I20260812 00:05:26.362588 9841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:26.353403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.65:37795 (local address 127.11.206.66:37711)
0812 00:05:26.353546 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:26.353555 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:26.353573 (+ 18us) server_negotiation.cc:407] Connection header received
0812 00:05:26.353985 (+ 412us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:26.353987 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:26.354032 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:26.354174 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:26.354850 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:26.355831 (+ 981us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:26.356829 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:26.357215 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:26.357317 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:26.359444 (+ 2127us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:26.359449 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:26.359449 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:26.359461 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:26.361072 (+ 1611us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:26.361484 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:26.361488 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:26.361488 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:26.361571 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:26.361809 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:26.361810 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:26.361810 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:26.362027 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:26.362096 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:26.362379 (+ 283us) server_negotiation.cc:299] Negotiation successful
0812 00:05:26.362489 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":79,"threads_started":1}
I20260812 00:05:26.362596 9838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:26.353207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.65:43051 (local address 127.11.206.67:44219)
0812 00:05:26.353348 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:26.353363 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:26.353415 (+ 52us) server_negotiation.cc:407] Connection header received
0812 00:05:26.353923 (+ 508us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:26.353926 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:26.353983 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:26.354097 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:26.354851 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:26.355849 (+ 998us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:26.356829 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:26.357215 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:26.357311 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:26.359734 (+ 2423us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:26.359737 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:26.359737 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:26.359747 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:26.361135 (+ 1388us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:26.361616 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:26.361619 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:26.361620 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:26.361717 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:26.361915 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:26.361915 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:26.361916 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:26.362131 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:26.362226 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:26.362378 (+ 152us) server_negotiation.cc:299] Negotiation successful
0812 00:05:26.362500 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102,"thread_start_us":59,"threads_started":1}
I20260812 00:05:26.362613 9834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:26.353078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.67:44219 (local address 127.11.206.65:43051)
0812 00:05:26.353129 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:26.353142 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:26.353224 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:26.354169 (+ 945us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:26.354172 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:26.354556 (+ 384us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:26.354735 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:26.354742 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:26.355943 (+ 1201us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:26.355944 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:26.356745 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:26.356748 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:26.357297 (+ 549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:26.357298 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:26.357429 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:26.357936 (+ 507us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:26.357943 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:26.359645 (+ 1702us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:26.361232 (+ 1587us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:26.361233 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:26.361234 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:26.361536 (+ 302us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:26.361794 (+ 258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:26.361795 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:26.361795 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:26.361862 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:26.362198 (+ 336us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:26.362199 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:26.362246 (+ 47us) client_negotiation.cc:769] Sending connection context
0812 00:05:26.362306 (+ 60us) client_negotiation.cc:240] Negotiation successful
0812 00:05:26.362494 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30,"mutex_wait_us":48}
I20260812 00:05:26.362686 9837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:26.353207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.66:37711 (local address 127.11.206.65:37795)
0812 00:05:26.353302 (+ 95us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:26.353311 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:26.353370 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:26.354180 (+ 810us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:26.354181 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:26.354555 (+ 374us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:26.354735 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:26.354742 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:26.355924 (+ 1182us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:26.355925 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:26.356744 (+ 819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:26.356747 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:26.357296 (+ 549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:26.357297 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:26.357425 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:26.357979 (+ 554us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:26.357983 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:26.359346 (+ 1363us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:26.361148 (+ 1802us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:26.361155 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:26.361158 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:26.361421 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:26.361632 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:26.361633 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:26.361633 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:26.361735 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:26.362089 (+ 354us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:26.362095 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:26.362224 (+ 129us) client_negotiation.cc:769] Sending connection context
0812 00:05:26.362302 (+ 78us) client_negotiation.cc:240] Negotiation successful
0812 00:05:26.362567 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":80,"mutex_wait_us":165,"thread_start_us":45,"threads_started":1}
W20260812 00:05:26.363603 9169 leader_election.cc:341] T 3aee40177a6f4c7ab32cab53d99b6aa0 P f4d8d8d0958e4137ba9aa4b11fb6a256 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e993531ff48748e79f91e14c16d46ece (127.11.206.67:44219): Not found: Tablet not found: 3aee40177a6f4c7ab32cab53d99b6aa0
W20260812 00:05:26.363818 9169 leader_election.cc:341] T 3aee40177a6f4c7ab32cab53d99b6aa0 P f4d8d8d0958e4137ba9aa4b11fb6a256 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ad0579eb47574d1c9ac95e43e57aaa2e (127.11.206.66:37711): Not found: Tablet not found: 3aee40177a6f4c7ab32cab53d99b6aa0
I20260812 00:05:26.363869 9169 leader_election.cc:302] T 3aee40177a6f4c7ab32cab53d99b6aa0 P f4d8d8d0958e4137ba9aa4b11fb6a256 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4d8d8d0958e4137ba9aa4b11fb6a256; no voters: ad0579eb47574d1c9ac95e43e57aaa2e, e993531ff48748e79f91e14c16d46ece
I20260812 00:05:26.363993 9835 raft_consensus.cc:2726] T 3aee40177a6f4c7ab32cab53d99b6aa0 P f4d8d8d0958e4137ba9aa4b11fb6a256 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 00:05:26.367152 9842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:26.366991 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:38625 (local address 127.11.206.66:51651)
0812 00:05:26.367090 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:26.367123 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:38625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88,"thread_start_us":62,"threads_started":1}
I20260812 00:05:26.498867 9848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:26.498647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:38625 (local address 127.11.206.67:52717)
0812 00:05:26.498782 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:26.498829 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:38625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":62,"threads_started":1}
I20260812 00:05:27.295296 9849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:27.295031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:38625 (local address 127.11.206.65:42587)
0812 00:05:27.295197 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:27.295242 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:38625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":68,"threads_started":1}
I20260812 00:05:27.367837 9855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:27.367586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:38625 (local address 127.11.206.66:43597)
0812 00:05:27.367740 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:27.367790 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:38625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":67,"threads_started":1}
I20260812 00:05:27.499481 9856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:27.499273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:38625 (local address 127.11.206.67:54857)
0812 00:05:27.499408 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:27.499445 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:38625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":77,"threads_started":1}
I20260812 00:05:28.295964 9857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:28.295720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:38625 (local address 127.11.206.65:34223)
0812 00:05:28.295869 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:28.295915 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:38625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":63,"threads_started":1}
I20260812 00:05:28.368577 9858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:28.368351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:38625 (local address 127.11.206.66:53563)
0812 00:05:28.368480 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:28.368521 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:38625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":71,"threads_started":1}
I20260812 00:05:28.472061 9859 raft_consensus.cc:482] T 3aee40177a6f4c7ab32cab53d99b6aa0 P f4d8d8d0958e4137ba9aa4b11fb6a256 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:05:28.472160 9859 raft_consensus.cc:504] T 3aee40177a6f4c7ab32cab53d99b6aa0 P f4d8d8d0958e4137ba9aa4b11fb6a256 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e993531ff48748e79f91e14c16d46ece" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 44219 } } peers { permanent_uuid: "ad0579eb47574d1c9ac95e43e57aaa2e" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37711 } } peers { permanent_uuid: "f4d8d8d0958e4137ba9aa4b11fb6a256" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 42235 } }
I20260812 00:05:28.472301 9859 leader_election.cc:288] T 3aee40177a6f4c7ab32cab53d99b6aa0 P f4d8d8d0958e4137ba9aa4b11fb6a256 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e993531ff48748e79f91e14c16d46ece (127.11.206.67:44219), ad0579eb47574d1c9ac95e43e57aaa2e (127.11.206.66:37711)
W20260812 00:05:28.472698 9169 leader_election.cc:341] T 3aee40177a6f4c7ab32cab53d99b6aa0 P f4d8d8d0958e4137ba9aa4b11fb6a256 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e993531ff48748e79f91e14c16d46ece (127.11.206.67:44219): Not found: Tablet not found: 3aee40177a6f4c7ab32cab53d99b6aa0
W20260812 00:05:28.472779 9169 leader_election.cc:341] T 3aee40177a6f4c7ab32cab53d99b6aa0 P f4d8d8d0958e4137ba9aa4b11fb6a256 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ad0579eb47574d1c9ac95e43e57aaa2e (127.11.206.66:37711): Not found: Tablet not found: 3aee40177a6f4c7ab32cab53d99b6aa0
I20260812 00:05:28.472795 9169 leader_election.cc:302] T 3aee40177a6f4c7ab32cab53d99b6aa0 P f4d8d8d0958e4137ba9aa4b11fb6a256 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4d8d8d0958e4137ba9aa4b11fb6a256; no voters: ad0579eb47574d1c9ac95e43e57aaa2e, e993531ff48748e79f91e14c16d46ece
I20260812 00:05:28.472885 9859 raft_consensus.cc:2726] T 3aee40177a6f4c7ab32cab53d99b6aa0 P f4d8d8d0958e4137ba9aa4b11fb6a256 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 00:05:28.500115 9861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:28.499910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:38625 (local address 127.11.206.67:52165)
0812 00:05:28.500033 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:28.500073 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:38625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":65,"threads_started":1}
I20260812 00:05:29.296569 9863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:29.296369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:38625 (local address 127.11.206.65:57445)
0812 00:05:29.296488 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:29.296523 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:38625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":66,"threads_started":1}
I20260812 00:05:29.369300 9864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:29.369019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:38625 (local address 127.11.206.66:45357)
0812 00:05:29.369185 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:29.369242 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:38625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":69,"threads_started":1}
I20260812 00:05:29.500746 9871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:29.500539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:38625 (local address 127.11.206.67:40403)
0812 00:05:29.500670 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:29.500702 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:38625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":74,"threads_started":1}
I20260812 00:05:30.297317 9874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:30.297073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:38625 (local address 127.11.206.65:43939)
0812 00:05:30.297234 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:30.297271 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:38625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":106,"threads_started":1}
I20260812 00:05:30.370031 9878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:30.369824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:38625 (local address 127.11.206.66:60383)
0812 00:05:30.369946 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:30.369985 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:38625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":61,"threads_started":1}
I20260812 00:05:30.501493 9879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:30.501226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:38625 (local address 127.11.206.67:47583)
0812 00:05:30.501404 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:30.501449 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:38625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":68,"threads_started":1}
I20260812 00:05:30.745607 9882 raft_consensus.cc:482] T 3aee40177a6f4c7ab32cab53d99b6aa0 P f4d8d8d0958e4137ba9aa4b11fb6a256 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:05:30.745710 9882 raft_consensus.cc:504] T 3aee40177a6f4c7ab32cab53d99b6aa0 P f4d8d8d0958e4137ba9aa4b11fb6a256 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e993531ff48748e79f91e14c16d46ece" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 44219 } } peers { permanent_uuid: "ad0579eb47574d1c9ac95e43e57aaa2e" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37711 } } peers { permanent_uuid: "f4d8d8d0958e4137ba9aa4b11fb6a256" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 42235 } }
I20260812 00:05:30.745844 9882 leader_election.cc:288] T 3aee40177a6f4c7ab32cab53d99b6aa0 P f4d8d8d0958e4137ba9aa4b11fb6a256 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e993531ff48748e79f91e14c16d46ece (127.11.206.67:44219), ad0579eb47574d1c9ac95e43e57aaa2e (127.11.206.66:37711)
W20260812 00:05:30.746271 9169 leader_election.cc:341] T 3aee40177a6f4c7ab32cab53d99b6aa0 P f4d8d8d0958e4137ba9aa4b11fb6a256 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ad0579eb47574d1c9ac95e43e57aaa2e (127.11.206.66:37711): Not found: Tablet not found: 3aee40177a6f4c7ab32cab53d99b6aa0
W20260812 00:05:30.746338 9169 leader_election.cc:341] T 3aee40177a6f4c7ab32cab53d99b6aa0 P f4d8d8d0958e4137ba9aa4b11fb6a256 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e993531ff48748e79f91e14c16d46ece (127.11.206.67:44219): Not found: Tablet not found: 3aee40177a6f4c7ab32cab53d99b6aa0
I20260812 00:05:30.746358 9169 leader_election.cc:302] T 3aee40177a6f4c7ab32cab53d99b6aa0 P f4d8d8d0958e4137ba9aa4b11fb6a256 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4d8d8d0958e4137ba9aa4b11fb6a256; no voters: ad0579eb47574d1c9ac95e43e57aaa2e, e993531ff48748e79f91e14c16d46ece
I20260812 00:05:30.746443 9882 raft_consensus.cc:2726] T 3aee40177a6f4c7ab32cab53d99b6aa0 P f4d8d8d0958e4137ba9aa4b11fb6a256 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 00:05:31.298013 9883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:31.297787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:38625 (local address 127.11.206.65:52221)
0812 00:05:31.297918 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:31.297964 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:38625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":63,"threads_started":1}
I20260812 00:05:31.370638 9884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:31.370434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:38625 (local address 127.11.206.66:49811)
0812 00:05:31.370560 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:31.370597 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:38625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":62,"threads_started":1}
I20260812 00:05:31.502112 9886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:31.501905 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:38625 (local address 127.11.206.67:35803)
0812 00:05:31.502029 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:31.502066 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:38625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":61,"threads_started":1}
I20260812 00:05:32.298751 9890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:32.298513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:38625 (local address 127.11.206.65:46209)
0812 00:05:32.298664 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:32.298706 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:38625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":80,"threads_started":1}
I20260812 00:05:32.371347 9891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:32.371124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:38625 (local address 127.11.206.66:51345)
0812 00:05:32.371259 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:32.371301 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:38625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":66,"threads_started":1}
I20260812 00:05:32.502751 9892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:32.502535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:38625 (local address 127.11.206.67:54679)
0812 00:05:32.502663 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:32.502703 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:38625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":65,"threads_started":1}
I20260812 00:05:33.299373 9893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:33.299162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:38625 (local address 127.11.206.65:44275)
0812 00:05:33.299292 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:33.299328 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:38625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":81,"threads_started":1}
I20260812 00:05:33.372009 9894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:33.371798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:38625 (local address 127.11.206.66:43293)
0812 00:05:33.371929 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:33.371965 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:38625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":79,"threads_started":1}
I20260812 00:05:33.503463 9896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:33.503215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:38625 (local address 127.11.206.67:52671)
0812 00:05:33.503357 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:33.503409 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:38625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":62,"threads_started":1}
I20260812 00:05:34.232730 9897 raft_consensus.cc:482] T 3aee40177a6f4c7ab32cab53d99b6aa0 P f4d8d8d0958e4137ba9aa4b11fb6a256 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:05:34.232839 9897 raft_consensus.cc:504] T 3aee40177a6f4c7ab32cab53d99b6aa0 P f4d8d8d0958e4137ba9aa4b11fb6a256 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e993531ff48748e79f91e14c16d46ece" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 44219 } } peers { permanent_uuid: "ad0579eb47574d1c9ac95e43e57aaa2e" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37711 } } peers { permanent_uuid: "f4d8d8d0958e4137ba9aa4b11fb6a256" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 42235 } }
I20260812 00:05:34.233003 9897 leader_election.cc:288] T 3aee40177a6f4c7ab32cab53d99b6aa0 P f4d8d8d0958e4137ba9aa4b11fb6a256 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e993531ff48748e79f91e14c16d46ece (127.11.206.67:44219), ad0579eb47574d1c9ac95e43e57aaa2e (127.11.206.66:37711)
W20260812 00:05:34.233428 9169 leader_election.cc:341] T 3aee40177a6f4c7ab32cab53d99b6aa0 P f4d8d8d0958e4137ba9aa4b11fb6a256 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e993531ff48748e79f91e14c16d46ece (127.11.206.67:44219): Not found: Tablet not found: 3aee40177a6f4c7ab32cab53d99b6aa0
W20260812 00:05:34.233502 9169 leader_election.cc:341] T 3aee40177a6f4c7ab32cab53d99b6aa0 P f4d8d8d0958e4137ba9aa4b11fb6a256 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ad0579eb47574d1c9ac95e43e57aaa2e (127.11.206.66:37711): Not found: Tablet not found: 3aee40177a6f4c7ab32cab53d99b6aa0
I20260812 00:05:34.233517 9169 leader_election.cc:302] T 3aee40177a6f4c7ab32cab53d99b6aa0 P f4d8d8d0958e4137ba9aa4b11fb6a256 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4d8d8d0958e4137ba9aa4b11fb6a256; no voters: ad0579eb47574d1c9ac95e43e57aaa2e, e993531ff48748e79f91e14c16d46ece
I20260812 00:05:34.233593 9897 raft_consensus.cc:2726] T 3aee40177a6f4c7ab32cab53d99b6aa0 P f4d8d8d0958e4137ba9aa4b11fb6a256 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 00:05:34.300036 9899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:34.299821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:38625 (local address 127.11.206.65:49937)
0812 00:05:34.299950 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:34.299991 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:38625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":66,"threads_started":1}
I20260812 00:05:34.372716 9900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:34.372491 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:38625 (local address 127.11.206.66:43621)
0812 00:05:34.372627 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:34.372671 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:38625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":66,"threads_started":1}
I20260812 00:05:34.504171 9902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:34.503902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:38625 (local address 127.11.206.67:39611)
0812 00:05:34.504052 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:34.504088 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:38625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":87,"threads_started":1}
I20260812 00:05:35.300706 9903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:35.300479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:38625 (local address 127.11.206.65:34399)
0812 00:05:35.300618 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:35.300660 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:38625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":62,"threads_started":1}
I20260812 00:05:35.373410 9905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:35.373150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:38625 (local address 127.11.206.66:33231)
0812 00:05:35.373287 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:35.373329 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:38625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":61,"threads_started":1}
I20260812 00:05:35.504908 9906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:35.504653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:38625 (local address 127.11.206.67:54613)
0812 00:05:35.504815 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:35.504859 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:38625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":80,"threads_started":1}
I20260812 00:05:36.301504 9907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:36.301198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:38625 (local address 127.11.206.65:39743)
0812 00:05:36.301372 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:36.301456 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:38625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":84,"threads_started":1}
I20260812 00:05:36.374109 9908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:36.373889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:38625 (local address 127.11.206.66:41753)
0812 00:05:36.374014 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:36.374056 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:38625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":67,"threads_started":1}
I20260812 00:05:36.505661 9909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:36.505369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:38625 (local address 127.11.206.67:44457)
0812 00:05:36.505573 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:36.505615 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:38625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":89,"threads_started":1}
I20260812 00:05:37.302232 9910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:37.301980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:38625 (local address 127.11.206.65:58425)
0812 00:05:37.302124 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:37.302169 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:38625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":85,"threads_started":1}
I20260812 00:05:37.374792 9911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:37.374583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:38625 (local address 127.11.206.66:56287)
0812 00:05:37.374708 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:37.374746 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:38625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":64,"threads_started":1}
I20260812 00:05:37.506358 9912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:37.506103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:38625 (local address 127.11.206.67:35567)
0812 00:05:37.506264 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:37.506308 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:38625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":104,"threads_started":1}
I20260812 00:05:38.302871 9913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:38.302643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:38625 (local address 127.11.206.65:60749)
0812 00:05:38.302782 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:38.302825 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:38625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":85,"threads_started":1}
I20260812 00:05:38.375530 9915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:38.375272 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:38625 (local address 127.11.206.66:48861)
0812 00:05:38.375422 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:38.375481 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:38625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":66,"threads_started":1}
I20260812 00:05:38.507054 9919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:38.506814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:38625 (local address 127.11.206.67:52957)
0812 00:05:38.506965 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:38.507006 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:38625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":63,"threads_started":1}
I20260812 00:05:39.303543 9920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:39.303303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:38625 (local address 127.11.206.65:34235)
0812 00:05:39.303444 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:39.303492 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:38625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":64,"threads_started":1}
I20260812 00:05:39.376230 9921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:39.376014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:38625 (local address 127.11.206.66:51239)
0812 00:05:39.376144 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:39.376182 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:38625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":63,"threads_started":1}
I20260812 00:05:39.507691 9922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:39.507466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:38625 (local address 127.11.206.67:58541)
0812 00:05:39.507609 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:39.507644 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:38625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":79,"threads_started":1}
I20260812 00:05:40.209975 9926 raft_consensus.cc:482] T 3aee40177a6f4c7ab32cab53d99b6aa0 P f4d8d8d0958e4137ba9aa4b11fb6a256 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:05:40.210076 9926 raft_consensus.cc:504] T 3aee40177a6f4c7ab32cab53d99b6aa0 P f4d8d8d0958e4137ba9aa4b11fb6a256 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e993531ff48748e79f91e14c16d46ece" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 44219 } } peers { permanent_uuid: "ad0579eb47574d1c9ac95e43e57aaa2e" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 37711 } } peers { permanent_uuid: "f4d8d8d0958e4137ba9aa4b11fb6a256" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 42235 } }
I20260812 00:05:40.210242 9926 leader_election.cc:288] T 3aee40177a6f4c7ab32cab53d99b6aa0 P f4d8d8d0958e4137ba9aa4b11fb6a256 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e993531ff48748e79f91e14c16d46ece (127.11.206.67:44219), ad0579eb47574d1c9ac95e43e57aaa2e (127.11.206.66:37711)
W20260812 00:05:40.210665 9169 leader_election.cc:341] T 3aee40177a6f4c7ab32cab53d99b6aa0 P f4d8d8d0958e4137ba9aa4b11fb6a256 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ad0579eb47574d1c9ac95e43e57aaa2e (127.11.206.66:37711): Not found: Tablet not found: 3aee40177a6f4c7ab32cab53d99b6aa0
W20260812 00:05:40.210741 9169 leader_election.cc:341] T 3aee40177a6f4c7ab32cab53d99b6aa0 P f4d8d8d0958e4137ba9aa4b11fb6a256 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e993531ff48748e79f91e14c16d46ece (127.11.206.67:44219): Not found: Tablet not found: 3aee40177a6f4c7ab32cab53d99b6aa0
I20260812 00:05:40.210762 9169 leader_election.cc:302] T 3aee40177a6f4c7ab32cab53d99b6aa0 P f4d8d8d0958e4137ba9aa4b11fb6a256 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4d8d8d0958e4137ba9aa4b11fb6a256; no voters: ad0579eb47574d1c9ac95e43e57aaa2e, e993531ff48748e79f91e14c16d46ece
I20260812 00:05:40.210848 9926 raft_consensus.cc:2726] T 3aee40177a6f4c7ab32cab53d99b6aa0 P f4d8d8d0958e4137ba9aa4b11fb6a256 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 00:05:40.304297 9927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:40.304065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:38625 (local address 127.11.206.65:51727)
0812 00:05:40.304205 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:40.304251 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:38625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":85,"threads_started":1}
I20260812 00:05:40.376984 9928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:40.376785 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:38625 (local address 127.11.206.66:54815)
0812 00:05:40.376902 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:40.376940 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:38625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":63,"threads_started":1}
I20260812 00:05:40.508392 9931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:40.508191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:38625 (local address 127.11.206.67:35927)
0812 00:05:40.508309 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:40.508346 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.126:38625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":66,"threads_started":1}
I20260812 00:05:40.515496 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 9070
I20260812 00:05:40.534390 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 9363
I20260812 00:05:40.564392 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 9605
2026-08-12T00:05:40Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (58576 ms)
[----------] 30 tests from SecurityITest (240602 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:05:40 dist-test-slave-f0tn krb5kdc[9937](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:05:40 dist-test-slave-f0tn krb5kdc[9937](info): set up 2 sockets
Aug 12 00:05:40 dist-test-slave-f0tn krb5kdc[9937](info): commencing operation
krb5kdc: starting...
W20260812 00:05:41.763837 12089 mini_kdc.cc:121] Time spent starting KDC: real 1.173s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/krb5kdc/test-user.keytab.
Aug 12 00:05:41 dist-test-slave-f0tn krb5kdc[9937](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493141, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:05:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:05:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.206.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab.
Entry for principal kudu/127.11.206.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab.
I20260812 00:05:41.882272 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:42231
--webserver_interface=127.11.206.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab
--principal=kudu/127.11.206.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:33527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.206.126:42231
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:05:41.966777 9957 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:41.967005 9957 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:41.967053 9957 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:41.968226 9957 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:05:41.968271 9957 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:41.968288 9957 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:41.968305 9957 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:05:41.968320 9957 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:05:41.969844 9957 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:33527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.206.126:42231
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab
--principal=kudu/127.11.206.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:42231
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.206.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9957
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:05:41.970104 9957 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:41.970317 9957 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 00:05:41.975589 9957 server_base.cc:1034] running on GCE node
W20260812 00:05:41.975564 9966 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:41.975534 9971 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:41.975539 9965 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:41.975980 9957 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:41.976284 9957 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:41.977430 9957 hybrid_clock.cc:648] HybridClock initialized: now 1786493141977417 us; error 30 us; skew 500 ppm
Aug 12 00:05:41 dist-test-slave-f0tn krb5kdc[9937](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493141, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:41.979938 9957 init.cc:377] Logged in from keytab as kudu/127.11.206.126@KRBTEST.COM (short username kudu)
I20260812 00:05:41.980433 9957 webserver.cc:460] Webserver started at http://127.11.206.126:37847/ using document root <none> and password file <none>
I20260812 00:05:41.980644 9957 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:41.980695 9957 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:41.980824 9957 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:41.981974 9957 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/minicluster-data/master-0/data/instance:
uuid: "cf621146d4f64131b38de9cff9e1ae8e"
format_stamp: "Formatted at 2026-08-12 00:05:41 on dist-test-slave-f0tn"
server_key: "802e30f2055f4dc7754a6fec856428f0"
server_key_iv: "ca39c10493eaaa98f5b925a7a25d3e9b"
server_key_version: "encryptionkey@0"
I20260812 00:05:41.982344 9957 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/minicluster-data/master-0/wal/instance:
uuid: "cf621146d4f64131b38de9cff9e1ae8e"
format_stamp: "Formatted at 2026-08-12 00:05:41 on dist-test-slave-f0tn"
server_key: "802e30f2055f4dc7754a6fec856428f0"
server_key_iv: "ca39c10493eaaa98f5b925a7a25d3e9b"
server_key_version: "encryptionkey@0"
I20260812 00:05:41.983616 9957 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 00:05:41.984300 9981 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:41.984448 9957 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:05:41.984537 9957 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/minicluster-data/master-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/minicluster-data/master-0/wal
uuid: "cf621146d4f64131b38de9cff9e1ae8e"
format_stamp: "Formatted at 2026-08-12 00:05:41 on dist-test-slave-f0tn"
server_key: "802e30f2055f4dc7754a6fec856428f0"
server_key_iv: "ca39c10493eaaa98f5b925a7a25d3e9b"
server_key_version: "encryptionkey@0"
I20260812 00:05:41.984599 9957 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:41.996589 9957 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:41.998492 9957 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:41.998641 9957 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:42.002812 9957 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.126:42231
I20260812 00:05:42.002856 10065 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.126:42231 every 8 connection(s)
I20260812 00:05:42.003221 9957 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
I20260812 00:05:42.004122 10068 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:42.006580 10068 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cf621146d4f64131b38de9cff9e1ae8e: Bootstrap starting.
I20260812 00:05:42.007191 10068 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cf621146d4f64131b38de9cff9e1ae8e: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:42.007491 10068 log.cc:824] T 00000000000000000000000000000000 P cf621146d4f64131b38de9cff9e1ae8e: Log is configured to *not* fsync() on all Append() calls
I20260812 00:05:42.007535 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 9957
I20260812 00:05:42.007645 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/minicluster-data/master-0/wal/instance
I20260812 00:05:42.007846 12089 external_mini_cluster.cc:1428] Setting key aa041ad82f7567ed5f6045c6af4e02da
I20260812 00:05:42.008287 10068 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cf621146d4f64131b38de9cff9e1ae8e: No bootstrap required, opened a new log
I20260812 00:05:42.010154 10068 raft_consensus.cc:348] T 00000000000000000000000000000000 P cf621146d4f64131b38de9cff9e1ae8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf621146d4f64131b38de9cff9e1ae8e" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 42231 } }
I20260812 00:05:42.010303 10068 raft_consensus.cc:374] T 00000000000000000000000000000000 P cf621146d4f64131b38de9cff9e1ae8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:42.010324 10068 raft_consensus.cc:729] T 00000000000000000000000000000000 P cf621146d4f64131b38de9cff9e1ae8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf621146d4f64131b38de9cff9e1ae8e, State: Initialized, Role: FOLLOWER
I20260812 00:05:42.010466 10068 consensus_queue.cc:260] T 00000000000000000000000000000000 P cf621146d4f64131b38de9cff9e1ae8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf621146d4f64131b38de9cff9e1ae8e" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 42231 } }
I20260812 00:05:42.010557 10068 raft_consensus.cc:388] T 00000000000000000000000000000000 P cf621146d4f64131b38de9cff9e1ae8e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:05:42.010589 10068 raft_consensus.cc:482] T 00000000000000000000000000000000 P cf621146d4f64131b38de9cff9e1ae8e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:05:42.010639 10068 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cf621146d4f64131b38de9cff9e1ae8e [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:42.011678 10068 raft_consensus.cc:504] T 00000000000000000000000000000000 P cf621146d4f64131b38de9cff9e1ae8e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf621146d4f64131b38de9cff9e1ae8e" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 42231 } }
I20260812 00:05:42.011787 10068 leader_election.cc:302] T 00000000000000000000000000000000 P cf621146d4f64131b38de9cff9e1ae8e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cf621146d4f64131b38de9cff9e1ae8e; no voters:
I20260812 00:05:42.011958 10068 leader_election.cc:288] T 00000000000000000000000000000000 P cf621146d4f64131b38de9cff9e1ae8e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:05:42.012002 10078 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cf621146d4f64131b38de9cff9e1ae8e [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:05:42.012152 10078 raft_consensus.cc:686] T 00000000000000000000000000000000 P cf621146d4f64131b38de9cff9e1ae8e [term 1 LEADER]: Becoming Leader. State: Replica: cf621146d4f64131b38de9cff9e1ae8e, State: Running, Role: LEADER
I20260812 00:05:42.012226 10068 sys_catalog.cc:564] T 00000000000000000000000000000000 P cf621146d4f64131b38de9cff9e1ae8e [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:05:42.012243 10078 consensus_queue.cc:237] T 00000000000000000000000000000000 P cf621146d4f64131b38de9cff9e1ae8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf621146d4f64131b38de9cff9e1ae8e" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 42231 } }
I20260812 00:05:42.012611 10078 sys_catalog.cc:455] T 00000000000000000000000000000000 P cf621146d4f64131b38de9cff9e1ae8e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cf621146d4f64131b38de9cff9e1ae8e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf621146d4f64131b38de9cff9e1ae8e" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 42231 } } }
I20260812 00:05:42.012774 10078 sys_catalog.cc:458] T 00000000000000000000000000000000 P cf621146d4f64131b38de9cff9e1ae8e [sys.catalog]: This master's current role is: LEADER
I20260812 00:05:42.012954 10078 sys_catalog.cc:455] T 00000000000000000000000000000000 P cf621146d4f64131b38de9cff9e1ae8e [sys.catalog]: SysCatalogTable state changed. Reason: New leader cf621146d4f64131b38de9cff9e1ae8e. Latest consensus state: current_term: 1 leader_uuid: "cf621146d4f64131b38de9cff9e1ae8e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf621146d4f64131b38de9cff9e1ae8e" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 42231 } } }
I20260812 00:05:42.013053 10078 sys_catalog.cc:458] T 00000000000000000000000000000000 P cf621146d4f64131b38de9cff9e1ae8e [sys.catalog]: This master's current role is: LEADER
I20260812 00:05:42.013435 10092 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:05:42.014016 10092 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:05:42.015825 10092 catalog_manager.cc:1347] Generated new cluster ID: 592fa97387fd4a6ebe8850c0c724d7f7
I20260812 00:05:42.015879 10092 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 00:05:42 dist-test-slave-f0tn krb5kdc[9937](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493141, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:05:42.020795 10077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:42.008440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40428 (local address 127.11.206.126:42231)
0812 00:05:42.008659 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:42.008670 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:42.008755 (+ 85us) server_negotiation.cc:407] Connection header received
0812 00:05:42.010177 (+ 1422us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:42.010188 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:42.010248 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:42.010407 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:42.011211 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:42.012275 (+ 1064us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:42.013361 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:42.013986 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:42.014093 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:42.016753 (+ 2660us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:42.016757 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:42.016758 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:42.016771 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:42.018789 (+ 2018us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:42.019171 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:42.019174 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:42.019175 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:42.019314 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:42.019511 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:42.019512 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:42.019512 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:42.019805 (+ 293us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:42.020365 (+ 560us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:42.020432 (+ 67us) server_negotiation.cc:299] Negotiation successful
0812 00:05:42.020557 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":111,"threads_started":1}
I20260812 00:05:42.020797 10092 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:05:42.021353 10092 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:05:42.024344 10092 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cf621146d4f64131b38de9cff9e1ae8e: Generated new TSK 0
I20260812 00:05:42.024498 10092 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.206.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.65.keytab.
Entry for principal kudu/127.11.206.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.65.keytab.
I20260812 00:05:42.058753 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.65:0
--local_ip_for_outbound_sockets=127.11.206.65
--webserver_interface=127.11.206.65
--webserver_port=0
--tserver_master_addrs=127.11.206.126:42231
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.65.keytab
--principal=kudu/127.11.206.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:33527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:05:42.164968 10110 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:42.165220 10110 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:42.165252 10110 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:42.166455 10110 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:42.166503 10110 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:42.166540 10110 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.65
I20260812 00:05:42.168365 10110 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:33527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.65.keytab
--principal=kudu/127.11.206.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.206.65
--webserver_port=0
--tserver_master_addrs=127.11.206.126:42231
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10110
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.65
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:05:42.168659 10110 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:42.168932 10110 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:42.174214 10121 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:42.174214 10116 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:42.174289 10115 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:42.174573 10110 server_base.cc:1034] running on GCE node
I20260812 00:05:42.174794 10110 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:42.175028 10110 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:42.176163 10110 hybrid_clock.cc:648] HybridClock initialized: now 1786493142176150 us; error 32 us; skew 500 ppm
Aug 12 00:05:42 dist-test-slave-f0tn krb5kdc[9937](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493142, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:42.178655 10110 init.cc:377] Logged in from keytab as kudu/127.11.206.65@KRBTEST.COM (short username kudu)
I20260812 00:05:42.179064 10110 webserver.cc:460] Webserver started at http://127.11.206.65:43979/ using document root <none> and password file <none>
I20260812 00:05:42.179283 10110 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:42.179332 10110 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:42.179459 10110 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:42.180500 10110 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/minicluster-data/ts-0/data/instance:
uuid: "86b5342cbc594caf9b9c99374968ab65"
format_stamp: "Formatted at 2026-08-12 00:05:42 on dist-test-slave-f0tn"
server_key: "8aeee50b34d7f33b8baabfd1159454de"
server_key_iv: "be1a4c8ed1cad15d72b816db9db80864"
server_key_version: "encryptionkey@0"
I20260812 00:05:42.180841 10110 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/minicluster-data/ts-0/wal/instance:
uuid: "86b5342cbc594caf9b9c99374968ab65"
format_stamp: "Formatted at 2026-08-12 00:05:42 on dist-test-slave-f0tn"
server_key: "8aeee50b34d7f33b8baabfd1159454de"
server_key_iv: "be1a4c8ed1cad15d72b816db9db80864"
server_key_version: "encryptionkey@0"
I20260812 00:05:42.182144 10110 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:05:42.182787 10134 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:42.182941 10110 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:05:42.183023 10110 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/minicluster-data/ts-0/wal
uuid: "86b5342cbc594caf9b9c99374968ab65"
format_stamp: "Formatted at 2026-08-12 00:05:42 on dist-test-slave-f0tn"
server_key: "8aeee50b34d7f33b8baabfd1159454de"
server_key_iv: "be1a4c8ed1cad15d72b816db9db80864"
server_key_version: "encryptionkey@0"
I20260812 00:05:42.183082 10110 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:42.193898 10110 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:42.195818 10110 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:42.195955 10110 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:42.196163 10110 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:05:42.196457 10110 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:05:42.196491 10110 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:42.196520 10110 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:05:42.196542 10110 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:42.202193 10110 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.65:42473
I20260812 00:05:42.202261 10348 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.65:42473 every 8 connection(s)
I20260812 00:05:42.202553 10110 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
I20260812 00:05:42.205281 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 10110
I20260812 00:05:42.205427 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/minicluster-data/ts-0/wal/instance
I20260812 00:05:42.205631 12089 external_mini_cluster.cc:1428] Setting key a0c4cf211efdd911a18095fb3fbe7ef4
Aug 12 00:05:42 dist-test-slave-f0tn krb5kdc[9937](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493142, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.65@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:05:42.212517 10077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:42.203270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.65:56965 (local address 127.11.206.126:42231)
0812 00:05:42.203358 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:42.203360 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:42.203515 (+ 155us) server_negotiation.cc:407] Connection header received
0812 00:05:42.204010 (+ 495us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:42.204012 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:42.204025 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:42.204078 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:42.204988 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:42.205768 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:42.206867 (+ 1099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:42.207164 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:42.207234 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:42.209669 (+ 2435us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:42.209671 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:42.209671 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:42.209677 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:42.210963 (+ 1286us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:42.211453 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:42.211454 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:42.211454 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:42.211501 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:42.211783 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:42.211784 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:42.211784 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:42.211894 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:42.211947 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:42.212367 (+ 420us) server_negotiation.cc:299] Negotiation successful
0812 00:05:42.212448 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260812 00:05:42.212785 10351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:42.203238 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:42231 (local address 127.11.206.65:56965)
0812 00:05:42.203397 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:42.203435 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:42.203906 (+ 471us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:42.204134 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:42.204144 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:42.204711 (+ 567us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:42.204904 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:42.204910 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:42.205863 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:42.205864 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:42.206773 (+ 909us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:42.206776 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:42.207236 (+ 460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:42.207236 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:42.207339 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:42.207902 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:42.207912 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:42.209574 (+ 1662us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:42.211040 (+ 1466us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:42.211048 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:42.211050 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:42.211379 (+ 329us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:42.211561 (+ 182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:42.211561 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:42.211562 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:42.211716 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:42.211958 (+ 242us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:42.211966 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:42.212215 (+ 249us) client_negotiation.cc:769] Sending connection context
0812 00:05:42.212352 (+ 137us) client_negotiation.cc:240] Negotiation successful
0812 00:05:42.212537 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":84,"threads_started":1}
I20260812 00:05:42.213451 10349 heartbeater.cc:347] Connected to a master server at 127.11.206.126:42231
I20260812 00:05:42.213569 10349 heartbeater.cc:464] Registering TS with master...
I20260812 00:05:42.213785 10349 heartbeater.cc:511] Master 127.11.206.126:42231 requested a full tablet report, sending...
I20260812 00:05:42.214442 10006 ts_manager.cc:194] Registered new tserver with Master: 86b5342cbc594caf9b9c99374968ab65 (127.11.206.65:42473)
I20260812 00:05:42.215372 10006 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.206.65@KRBTEST.COM'} at 127.11.206.65:56965
WARNING: no policy specified for kudu/127.11.206.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.66.keytab.
Entry for principal kudu/127.11.206.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.66.keytab.
I20260812 00:05:42.233253 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.66:0
--local_ip_for_outbound_sockets=127.11.206.66
--webserver_interface=127.11.206.66
--webserver_port=0
--tserver_master_addrs=127.11.206.126:42231
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.66.keytab
--principal=kudu/127.11.206.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:33527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:05:42.315843 10360 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:42.316058 10360 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:42.316080 10360 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:42.317247 10360 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:42.317291 10360 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:42.317317 10360 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.66
I20260812 00:05:42.318862 10360 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:33527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.66.keytab
--principal=kudu/127.11.206.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.206.66
--webserver_port=0
--tserver_master_addrs=127.11.206.126:42231
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10360
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.66
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:05:42.319089 10360 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:42.319341 10360 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:42.324520 10370 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:42.324576 10360 server_base.cc:1034] running on GCE node
W20260812 00:05:42.324512 10368 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:42.324512 10367 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:42.324916 10360 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:42.325170 10360 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:42.326298 10360 hybrid_clock.cc:648] HybridClock initialized: now 1786493142326273 us; error 42 us; skew 500 ppm
Aug 12 00:05:42 dist-test-slave-f0tn krb5kdc[9937](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493142, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:42.328868 10360 init.cc:377] Logged in from keytab as kudu/127.11.206.66@KRBTEST.COM (short username kudu)
I20260812 00:05:42.329283 10360 webserver.cc:460] Webserver started at http://127.11.206.66:35765/ using document root <none> and password file <none>
I20260812 00:05:42.329515 10360 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:42.329567 10360 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:42.329713 10360 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:42.330787 10360 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/minicluster-data/ts-1/data/instance:
uuid: "4df34c09e9db4e1495f6aa98b9bceb60"
format_stamp: "Formatted at 2026-08-12 00:05:42 on dist-test-slave-f0tn"
server_key: "7df9e014f82e6e6a188db1e437ee9e32"
server_key_iv: "0e7fbb8184ea97c75c81c49b203991c0"
server_key_version: "encryptionkey@0"
I20260812 00:05:42.331139 10360 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/minicluster-data/ts-1/wal/instance:
uuid: "4df34c09e9db4e1495f6aa98b9bceb60"
format_stamp: "Formatted at 2026-08-12 00:05:42 on dist-test-slave-f0tn"
server_key: "7df9e014f82e6e6a188db1e437ee9e32"
server_key_iv: "0e7fbb8184ea97c75c81c49b203991c0"
server_key_version: "encryptionkey@0"
I20260812 00:05:42.332485 10360 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:05:42.333171 10384 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:42.333305 10360 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:05:42.333412 10360 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/minicluster-data/ts-1/wal
uuid: "4df34c09e9db4e1495f6aa98b9bceb60"
format_stamp: "Formatted at 2026-08-12 00:05:42 on dist-test-slave-f0tn"
server_key: "7df9e014f82e6e6a188db1e437ee9e32"
server_key_iv: "0e7fbb8184ea97c75c81c49b203991c0"
server_key_version: "encryptionkey@0"
I20260812 00:05:42.333482 10360 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:42.341003 10360 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:42.343027 10360 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:42.343168 10360 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:42.343385 10360 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:05:42.343688 10360 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:05:42.343724 10360 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:42.343751 10360 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:05:42.343768 10360 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:42.349450 10360 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.66:46465
I20260812 00:05:42.349493 10587 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.66:46465 every 8 connection(s)
I20260812 00:05:42.349817 10360 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
Aug 12 00:05:42 dist-test-slave-f0tn krb5kdc[9937](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493142, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.66@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:05:42.358563 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 10360
I20260812 00:05:42.358675 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/minicluster-data/ts-1/wal/instance
I20260812 00:05:42.358911 10077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:42.350636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.66:47429 (local address 127.11.206.126:42231)
0812 00:05:42.350699 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:42.350701 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:42.350905 (+ 204us) server_negotiation.cc:407] Connection header received
0812 00:05:42.351390 (+ 485us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:42.351391 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:42.351401 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:42.351460 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:42.352394 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:42.352894 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:42.353964 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:42.354164 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:42.354215 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:42.356318 (+ 2103us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:42.356319 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:42.356319 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:42.356325 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:42.357601 (+ 1276us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:42.357994 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:42.357995 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:42.357995 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:42.358041 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:42.358222 (+ 181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:42.358222 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:42.358223 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:42.358322 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:42.358369 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:42.358772 (+ 403us) server_negotiation.cc:299] Negotiation successful
0812 00:05:42.358844 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260812 00:05:42.358906 12089 external_mini_cluster.cc:1428] Setting key 57d3ca3ed204444032a79bce1dc4b418
I20260812 00:05:42.359133 10595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:42.350602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:42231 (local address 127.11.206.66:47429)
0812 00:05:42.350781 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:42.350825 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:42.351310 (+ 485us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:42.351518 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:42.351522 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:42.352117 (+ 595us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:42.352321 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:42.352326 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:42.352981 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:42.352983 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:42.353895 (+ 912us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:42.353898 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:42.354249 (+ 351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:42.354250 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:42.354361 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:42.354865 (+ 504us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:42.354873 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:42.356243 (+ 1370us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:42.357689 (+ 1446us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:42.357696 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:42.357698 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:42.357935 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:42.358086 (+ 151us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:42.358087 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:42.358087 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:42.358180 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:42.358402 (+ 222us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:42.358411 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:42.358600 (+ 189us) client_negotiation.cc:769] Sending connection context
0812 00:05:42.358728 (+ 128us) client_negotiation.cc:240] Negotiation successful
0812 00:05:42.358906 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":91,"threads_started":1}
I20260812 00:05:42.359583 10590 heartbeater.cc:347] Connected to a master server at 127.11.206.126:42231
I20260812 00:05:42.359675 10590 heartbeater.cc:464] Registering TS with master...
I20260812 00:05:42.359848 10590 heartbeater.cc:511] Master 127.11.206.126:42231 requested a full tablet report, sending...
I20260812 00:05:42.360239 10006 ts_manager.cc:194] Registered new tserver with Master: 4df34c09e9db4e1495f6aa98b9bceb60 (127.11.206.66:46465)
I20260812 00:05:42.360600 10006 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.206.66@KRBTEST.COM'} at 127.11.206.66:47429
WARNING: no policy specified for kudu/127.11.206.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.67.keytab.
Entry for principal kudu/127.11.206.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.67.keytab.
I20260812 00:05:42.383460 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.67:0
--local_ip_for_outbound_sockets=127.11.206.67
--webserver_interface=127.11.206.67
--webserver_port=0
--tserver_master_addrs=127.11.206.126:42231
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.67.keytab
--principal=kudu/127.11.206.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:33527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:05:42.465435 10600 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:42.465651 10600 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:42.465673 10600 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:42.466835 10600 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:42.466879 10600 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:42.466905 10600 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.67
I20260812 00:05:42.468384 10600 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:33527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.67.keytab
--principal=kudu/127.11.206.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.206.67
--webserver_port=0
--tserver_master_addrs=127.11.206.126:42231
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10600
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.67
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:05:42.468618 10600 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:42.468860 10600 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:42.473860 10608 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:42.473937 10611 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:42.473898 10609 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:42.474102 10600 server_base.cc:1034] running on GCE node
I20260812 00:05:42.474309 10600 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:42.474563 10600 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:42.475709 10600 hybrid_clock.cc:648] HybridClock initialized: now 1786493142475695 us; error 28 us; skew 500 ppm
Aug 12 00:05:42 dist-test-slave-f0tn krb5kdc[9937](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493142, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:42.478226 10600 init.cc:377] Logged in from keytab as kudu/127.11.206.67@KRBTEST.COM (short username kudu)
I20260812 00:05:42.478708 10600 webserver.cc:460] Webserver started at http://127.11.206.67:35145/ using document root <none> and password file <none>
I20260812 00:05:42.478931 10600 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:42.478979 10600 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:42.479108 10600 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:42.480160 10600 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/minicluster-data/ts-2/data/instance:
uuid: "ad2c0476d9f841eea5fef32975ad6492"
format_stamp: "Formatted at 2026-08-12 00:05:42 on dist-test-slave-f0tn"
server_key: "da111034ec6afa8adc73bf37ae9e0f38"
server_key_iv: "b169aa9a732bd6861c67f9215da5a406"
server_key_version: "encryptionkey@0"
I20260812 00:05:42.480505 10600 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/minicluster-data/ts-2/wal/instance:
uuid: "ad2c0476d9f841eea5fef32975ad6492"
format_stamp: "Formatted at 2026-08-12 00:05:42 on dist-test-slave-f0tn"
server_key: "da111034ec6afa8adc73bf37ae9e0f38"
server_key_iv: "b169aa9a732bd6861c67f9215da5a406"
server_key_version: "encryptionkey@0"
I20260812 00:05:42.481837 10600 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:05:42.482527 10623 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:42.482677 10600 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:05:42.482762 10600 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/minicluster-data/ts-2/wal
uuid: "ad2c0476d9f841eea5fef32975ad6492"
format_stamp: "Formatted at 2026-08-12 00:05:42 on dist-test-slave-f0tn"
server_key: "da111034ec6afa8adc73bf37ae9e0f38"
server_key_iv: "b169aa9a732bd6861c67f9215da5a406"
server_key_version: "encryptionkey@0"
I20260812 00:05:42.482824 10600 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:42.491043 10600 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:42.493000 10600 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:42.493146 10600 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:42.493369 10600 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:05:42.493789 10600 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:05:42.493824 10600 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:42.493856 10600 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:05:42.493873 10600 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:42.499650 10600 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.67:34251
I20260812 00:05:42.499679 10813 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.67:34251 every 8 connection(s)
I20260812 00:05:42.500037 10600 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
Aug 12 00:05:42 dist-test-slave-f0tn krb5kdc[9937](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493142, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.67@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:05:42.508988 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 10600
I20260812 00:05:42.509126 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/minicluster-data/ts-2/wal/instance
I20260812 00:05:42.509268 10077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:42.500768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.67:47911 (local address 127.11.206.126:42231)
0812 00:05:42.500831 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:42.500833 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:42.501020 (+ 187us) server_negotiation.cc:407] Connection header received
0812 00:05:42.501578 (+ 558us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:42.501579 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:42.501592 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:42.501660 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:42.502625 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:42.503122 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:42.504075 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:42.504257 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:42.504299 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:42.506342 (+ 2043us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:42.506343 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:42.506344 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:42.506352 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:42.507665 (+ 1313us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:42.508173 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:42.508174 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:42.508174 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:42.508241 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:42.508492 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:42.508493 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:42.508493 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:42.508627 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:42.508693 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:42.509052 (+ 359us) server_negotiation.cc:299] Negotiation successful
0812 00:05:42.509168 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260812 00:05:42.509356 12089 external_mini_cluster.cc:1428] Setting key f03b3a1ec640d0a0f659951d84b42512
I20260812 00:05:42.509601 10816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:42.500733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:42231 (local address 127.11.206.67:47911)
0812 00:05:42.500893 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:42.500937 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:42.501482 (+ 545us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:42.501729 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:42.501733 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:42.502341 (+ 608us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:42.502548 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:42.502553 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:42.503189 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:42.503190 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:42.504014 (+ 824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:42.504016 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:42.504310 (+ 294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:42.504311 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:42.504412 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:42.504855 (+ 443us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:42.504863 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:42.506225 (+ 1362us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:42.507775 (+ 1550us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:42.507786 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:42.507788 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:42.508052 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:42.508306 (+ 254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:42.508307 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:42.508308 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:42.508428 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:42.508694 (+ 266us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:42.508702 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:42.508881 (+ 179us) client_negotiation.cc:769] Sending connection context
0812 00:05:42.509008 (+ 127us) client_negotiation.cc:240] Negotiation successful
0812 00:05:42.509211 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":85,"threads_started":1}
I20260812 00:05:42.510142 10814 heartbeater.cc:347] Connected to a master server at 127.11.206.126:42231
I20260812 00:05:42.510255 10814 heartbeater.cc:464] Registering TS with master...
I20260812 00:05:42.510473 10814 heartbeater.cc:511] Master 127.11.206.126:42231 requested a full tablet report, sending...
I20260812 00:05:42.510861 10006 ts_manager.cc:194] Registered new tserver with Master: ad2c0476d9f841eea5fef32975ad6492 (127.11.206.67:34251)
I20260812 00:05:42.511240 10006 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.206.67@KRBTEST.COM'} at 127.11.206.67:47911
I20260812 00:05:42.521338 12089 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:05:42.528767 10077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:42.522746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40444 (local address 127.11.206.126:42231)
0812 00:05:42.522816 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:42.522818 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:42.522904 (+ 86us) server_negotiation.cc:407] Connection header received
0812 00:05:42.522976 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:42.522977 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:42.522988 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:42.523032 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:42.523606 (+ 574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:42.524114 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:42.524922 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:42.525127 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:42.525183 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:42.526362 (+ 1179us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:42.526364 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:42.526364 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:42.526372 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:42.527651 (+ 1279us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:42.527971 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:42.527972 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:42.527972 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:42.528031 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:42.528196 (+ 165us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:42.528197 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:42.528197 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:42.528358 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:42.528450 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:42.528572 (+ 122us) server_negotiation.cc:299] Negotiation successful
0812 00:05:42.528655 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260812 00:05:42.530396 10006 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40444:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:05:42.532020 10006 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:05:42.538552 10840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:42.534593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55186 (local address 127.11.206.65:42473)
0812 00:05:42.534884 (+ 291us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:42.534888 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:42.534928 (+ 40us) server_negotiation.cc:407] Connection header received
0812 00:05:42.535071 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:42.535073 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:42.535090 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:42.535153 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:05:42.535394 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:42.536102 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:42.537609 (+ 1507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:42.538123 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:42.538191 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:42.538259 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:42.538417 (+ 158us) server_negotiation.cc:299] Negotiation successful
0812 00:05:42.538459 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":262,"thread_start_us":99,"threads_started":1}
I20260812 00:05:42.538571 10835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:42.534408 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.65:42473 (local address 127.0.0.1:55186)
0812 00:05:42.534863 (+ 455us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:42.534872 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:42.534954 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:42.535260 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:42.535260 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:42.535263 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:05:42.535317 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:42.535318 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:42.536198 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:42.536199 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:42.537544 (+ 1345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:42.537547 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:42.538207 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:42.538216 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:42.538311 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:42.538327 (+ 16us) client_negotiation.cc:769] Sending connection context
0812 00:05:42.538392 (+ 65us) client_negotiation.cc:240] Negotiation successful
0812 00:05:42.538455 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":443,"mutex_wait_us":35,"thread_start_us":48,"threads_started":1}
I20260812 00:05:42.539112 10843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:42.534639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46284 (local address 127.11.206.67:34251)
0812 00:05:42.534962 (+ 323us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:42.534966 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:42.535148 (+ 182us) server_negotiation.cc:407] Connection header received
0812 00:05:42.535195 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:42.535198 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:42.535212 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:42.535278 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:05:42.535434 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:42.536167 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:42.537451 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:42.538197 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:42.538268 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:42.538320 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:42.538609 (+ 289us) server_negotiation.cc:299] Negotiation successful
0812 00:05:42.539021 (+ 412us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":294,"thread_start_us":85,"threads_started":1}
I20260812 00:05:42.539433 10839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:42.534408 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.67:34251 (local address 127.0.0.1:46284)
0812 00:05:42.535036 (+ 628us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:42.535045 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:42.535088 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:42.535345 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:42.535346 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:42.535348 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:05:42.535380 (+ 32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:42.535381 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:42.536259 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:42.536260 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:42.537362 (+ 1102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:42.537366 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:42.538355 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:42.538356 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:42.538416 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:42.538420 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:05:42.538460 (+ 40us) client_negotiation.cc:240] Negotiation successful
0812 00:05:42.538501 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":613,"mutex_wait_us":57,"thread_start_us":82,"threads_started":1}
I20260812 00:05:42.539420 10218 tablet_service.cc:1467] Processing CreateTablet for tablet 630a8f2f1f404ea3b8d5c8c2d8b77abb (DEFAULT_TABLE table=test-table [id=8dfacc35b5a44184afda5ed89611ed73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:05:42.539831 10836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:42.534406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.66:46465 (local address 127.0.0.1:45110)
0812 00:05:42.534798 (+ 392us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:42.534839 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:42.534924 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:42.535223 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:42.535227 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:42.535230 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:05:42.535317 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:42.535319 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:42.537569 (+ 2250us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:42.537569 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:42.538585 (+ 1016us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:42.538588 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:42.539587 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:42.539588 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:42.539673 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:42.539677 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:05:42.539727 (+ 50us) client_negotiation.cc:240] Negotiation successful
0812 00:05:42.539768 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":357,"thread_start_us":114,"threads_started":1}
I20260812 00:05:42.539845 10218 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 630a8f2f1f404ea3b8d5c8c2d8b77abb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:42.539881 10841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:42.534593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45110 (local address 127.11.206.66:46465)
0812 00:05:42.534802 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:42.534806 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:42.534918 (+ 112us) server_negotiation.cc:407] Connection header received
0812 00:05:42.535012 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:42.535015 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:42.535032 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:42.535114 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:05:42.536219 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:42.537468 (+ 1249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:42.538690 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:42.539423 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:42.539489 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:42.539551 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:42.539760 (+ 209us) server_negotiation.cc:299] Negotiation successful
0812 00:05:42.539806 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":99,"threads_started":1}
I20260812 00:05:42.540485 10459 tablet_service.cc:1467] Processing CreateTablet for tablet 630a8f2f1f404ea3b8d5c8c2d8b77abb (DEFAULT_TABLE table=test-table [id=8dfacc35b5a44184afda5ed89611ed73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:05:42.540802 10459 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 630a8f2f1f404ea3b8d5c8c2d8b77abb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:42.542197 10705 tablet_service.cc:1467] Processing CreateTablet for tablet 630a8f2f1f404ea3b8d5c8c2d8b77abb (DEFAULT_TABLE table=test-table [id=8dfacc35b5a44184afda5ed89611ed73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:05:42.542568 10705 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 630a8f2f1f404ea3b8d5c8c2d8b77abb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:42.543072 10844 tablet_bootstrap.cc:492] T 630a8f2f1f404ea3b8d5c8c2d8b77abb P 86b5342cbc594caf9b9c99374968ab65: Bootstrap starting.
I20260812 00:05:42.543800 10844 tablet_bootstrap.cc:654] T 630a8f2f1f404ea3b8d5c8c2d8b77abb P 86b5342cbc594caf9b9c99374968ab65: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:42.543838 10846 tablet_bootstrap.cc:492] T 630a8f2f1f404ea3b8d5c8c2d8b77abb P 4df34c09e9db4e1495f6aa98b9bceb60: Bootstrap starting.
I20260812 00:05:42.544325 10844 log.cc:824] T 630a8f2f1f404ea3b8d5c8c2d8b77abb P 86b5342cbc594caf9b9c99374968ab65: Log is configured to *not* fsync() on all Append() calls
I20260812 00:05:42.544502 10846 tablet_bootstrap.cc:654] T 630a8f2f1f404ea3b8d5c8c2d8b77abb P 4df34c09e9db4e1495f6aa98b9bceb60: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:42.544973 10844 tablet_bootstrap.cc:492] T 630a8f2f1f404ea3b8d5c8c2d8b77abb P 86b5342cbc594caf9b9c99374968ab65: No bootstrap required, opened a new log
I20260812 00:05:42.545020 10844 ts_tablet_manager.cc:1397] T 630a8f2f1f404ea3b8d5c8c2d8b77abb P 86b5342cbc594caf9b9c99374968ab65: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 00:05:42.545037 10846 log.cc:824] T 630a8f2f1f404ea3b8d5c8c2d8b77abb P 4df34c09e9db4e1495f6aa98b9bceb60: Log is configured to *not* fsync() on all Append() calls
I20260812 00:05:42.545871 10846 tablet_bootstrap.cc:492] T 630a8f2f1f404ea3b8d5c8c2d8b77abb P 4df34c09e9db4e1495f6aa98b9bceb60: No bootstrap required, opened a new log
I20260812 00:05:42.545945 10846 ts_tablet_manager.cc:1397] T 630a8f2f1f404ea3b8d5c8c2d8b77abb P 4df34c09e9db4e1495f6aa98b9bceb60: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 00:05:42.547322 10844 raft_consensus.cc:348] T 630a8f2f1f404ea3b8d5c8c2d8b77abb P 86b5342cbc594caf9b9c99374968ab65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4df34c09e9db4e1495f6aa98b9bceb60" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 46465 } } peers { permanent_uuid: "86b5342cbc594caf9b9c99374968ab65" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 42473 } } peers { permanent_uuid: "ad2c0476d9f841eea5fef32975ad6492" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 34251 } }
I20260812 00:05:42.547519 10844 raft_consensus.cc:374] T 630a8f2f1f404ea3b8d5c8c2d8b77abb P 86b5342cbc594caf9b9c99374968ab65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:42.547569 10844 raft_consensus.cc:729] T 630a8f2f1f404ea3b8d5c8c2d8b77abb P 86b5342cbc594caf9b9c99374968ab65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86b5342cbc594caf9b9c99374968ab65, State: Initialized, Role: FOLLOWER
I20260812 00:05:42.547698 10844 consensus_queue.cc:260] T 630a8f2f1f404ea3b8d5c8c2d8b77abb P 86b5342cbc594caf9b9c99374968ab65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4df34c09e9db4e1495f6aa98b9bceb60" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 46465 } } peers { permanent_uuid: "86b5342cbc594caf9b9c99374968ab65" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 42473 } } peers { permanent_uuid: "ad2c0476d9f841eea5fef32975ad6492" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 34251 } }
I20260812 00:05:42.547864 10846 raft_consensus.cc:348] T 630a8f2f1f404ea3b8d5c8c2d8b77abb P 4df34c09e9db4e1495f6aa98b9bceb60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4df34c09e9db4e1495f6aa98b9bceb60" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 46465 } } peers { permanent_uuid: "86b5342cbc594caf9b9c99374968ab65" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 42473 } } peers { permanent_uuid: "ad2c0476d9f841eea5fef32975ad6492" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 34251 } }
I20260812 00:05:42.548017 10844 ts_tablet_manager.cc:1428] T 630a8f2f1f404ea3b8d5c8c2d8b77abb P 86b5342cbc594caf9b9c99374968ab65: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 00:05:42.548038 10846 raft_consensus.cc:374] T 630a8f2f1f404ea3b8d5c8c2d8b77abb P 4df34c09e9db4e1495f6aa98b9bceb60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:42.548022 10349 heartbeater.cc:503] Master 127.11.206.126:42231 was elected leader, sending a full tablet report...
I20260812 00:05:42.548072 10846 raft_consensus.cc:729] T 630a8f2f1f404ea3b8d5c8c2d8b77abb P 4df34c09e9db4e1495f6aa98b9bceb60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4df34c09e9db4e1495f6aa98b9bceb60, State: Initialized, Role: FOLLOWER
I20260812 00:05:42.548190 10846 consensus_queue.cc:260] T 630a8f2f1f404ea3b8d5c8c2d8b77abb P 4df34c09e9db4e1495f6aa98b9bceb60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4df34c09e9db4e1495f6aa98b9bceb60" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 46465 } } peers { permanent_uuid: "86b5342cbc594caf9b9c99374968ab65" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 42473 } } peers { permanent_uuid: "ad2c0476d9f841eea5fef32975ad6492" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 34251 } }
I20260812 00:05:42.548259 10850 tablet_bootstrap.cc:492] T 630a8f2f1f404ea3b8d5c8c2d8b77abb P ad2c0476d9f841eea5fef32975ad6492: Bootstrap starting.
I20260812 00:05:42.548468 10846 ts_tablet_manager.cc:1428] T 630a8f2f1f404ea3b8d5c8c2d8b77abb P 4df34c09e9db4e1495f6aa98b9bceb60: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260812 00:05:42.548622 10590 heartbeater.cc:503] Master 127.11.206.126:42231 was elected leader, sending a full tablet report...
I20260812 00:05:42.548925 10850 tablet_bootstrap.cc:654] T 630a8f2f1f404ea3b8d5c8c2d8b77abb P ad2c0476d9f841eea5fef32975ad6492: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:42.549484 10850 log.cc:824] T 630a8f2f1f404ea3b8d5c8c2d8b77abb P ad2c0476d9f841eea5fef32975ad6492: Log is configured to *not* fsync() on all Append() calls
I20260812 00:05:42.550215 10850 tablet_bootstrap.cc:492] T 630a8f2f1f404ea3b8d5c8c2d8b77abb P ad2c0476d9f841eea5fef32975ad6492: No bootstrap required, opened a new log
I20260812 00:05:42.550278 10850 ts_tablet_manager.cc:1397] T 630a8f2f1f404ea3b8d5c8c2d8b77abb P ad2c0476d9f841eea5fef32975ad6492: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 00:05:42.551601 10850 raft_consensus.cc:348] T 630a8f2f1f404ea3b8d5c8c2d8b77abb P ad2c0476d9f841eea5fef32975ad6492 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4df34c09e9db4e1495f6aa98b9bceb60" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 46465 } } peers { permanent_uuid: "86b5342cbc594caf9b9c99374968ab65" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 42473 } } peers { permanent_uuid: "ad2c0476d9f841eea5fef32975ad6492" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 34251 } }
I20260812 00:05:42.551745 10850 raft_consensus.cc:374] T 630a8f2f1f404ea3b8d5c8c2d8b77abb P ad2c0476d9f841eea5fef32975ad6492 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:42.551769 10850 raft_consensus.cc:729] T 630a8f2f1f404ea3b8d5c8c2d8b77abb P ad2c0476d9f841eea5fef32975ad6492 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad2c0476d9f841eea5fef32975ad6492, State: Initialized, Role: FOLLOWER
I20260812 00:05:42.551872 10850 consensus_queue.cc:260] T 630a8f2f1f404ea3b8d5c8c2d8b77abb P ad2c0476d9f841eea5fef32975ad6492 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4df34c09e9db4e1495f6aa98b9bceb60" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 46465 } } peers { permanent_uuid: "86b5342cbc594caf9b9c99374968ab65" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 42473 } } peers { permanent_uuid: "ad2c0476d9f841eea5fef32975ad6492" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 34251 } }
I20260812 00:05:42.552114 10850 ts_tablet_manager.cc:1428] T 630a8f2f1f404ea3b8d5c8c2d8b77abb P ad2c0476d9f841eea5fef32975ad6492: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 00:05:42.552188 10814 heartbeater.cc:503] Master 127.11.206.126:42231 was elected leader, sending a full tablet report...
I20260812 00:05:42.553014 10851 raft_consensus.cc:482] T 630a8f2f1f404ea3b8d5c8c2d8b77abb P 86b5342cbc594caf9b9c99374968ab65 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:05:42.553123 10851 raft_consensus.cc:504] T 630a8f2f1f404ea3b8d5c8c2d8b77abb P 86b5342cbc594caf9b9c99374968ab65 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4df34c09e9db4e1495f6aa98b9bceb60" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 46465 } } peers { permanent_uuid: "86b5342cbc594caf9b9c99374968ab65" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 42473 } } peers { permanent_uuid: "ad2c0476d9f841eea5fef32975ad6492" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 34251 } }
I20260812 00:05:42.553511 10851 leader_election.cc:288] T 630a8f2f1f404ea3b8d5c8c2d8b77abb P 86b5342cbc594caf9b9c99374968ab65 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4df34c09e9db4e1495f6aa98b9bceb60 (127.11.206.66:46465), ad2c0476d9f841eea5fef32975ad6492 (127.11.206.67:34251)
I20260812 00:05:42.556183 10351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:42.553656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.66:46465 (local address 127.11.206.65:52835)
0812 00:05:42.553715 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:42.553726 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:42.553764 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:42.553897 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:42.553898 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:42.553900 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:05:42.553974 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:42.553976 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:42.554601 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:42.554602 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:42.555416 (+ 814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:42.555419 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:42.555941 (+ 522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:42.555942 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:42.556023 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:42.556027 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:05:42.556071 (+ 44us) client_negotiation.cc:240] Negotiation successful
0812 00:05:42.556111 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260812 00:05:42.556183 10841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:42.553699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.65:52835 (local address 127.11.206.66:46465)
0812 00:05:42.553790 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:42.553792 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:42.553799 (+ 7us) server_negotiation.cc:407] Connection header received
0812 00:05:42.553820 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:42.553821 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:42.553828 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:42.553873 (+ 45us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:05:42.554046 (+ 173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:42.554528 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:42.555489 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:42.555875 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:42.555938 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:42.555946 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:42.556084 (+ 138us) server_negotiation.cc:299] Negotiation successful
0812 00:05:42.556119 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260812 00:05:42.556399 10843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:42.553741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.65:57877 (local address 127.11.206.67:34251)
0812 00:05:42.553784 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:42.553786 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:42.554028 (+ 242us) server_negotiation.cc:407] Connection header received
0812 00:05:42.554072 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:42.554073 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:42.554082 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:42.554132 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:05:42.554257 (+ 125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:42.554704 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:42.555743 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:42.556107 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:42.556176 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:42.556183 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:42.556306 (+ 123us) server_negotiation.cc:299] Negotiation successful
0812 00:05:42.556340 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 00:05:42.556412 10856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:42.553663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.67:34251 (local address 127.11.206.65:57877)
0812 00:05:42.553965 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:42.553974 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:42.554022 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:42.554136 (+ 114us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:42.554136 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:42.554138 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:05:42.554205 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:42.554206 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:42.554770 (+ 564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:42.554771 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:42.555669 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:42.555672 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:42.556178 (+ 506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:42.556179 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:42.556249 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:42.556253 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:05:42.556298 (+ 45us) client_negotiation.cc:240] Negotiation successful
0812 00:05:42.556334 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":280,"mutex_wait_us":142,"thread_start_us":93,"threads_started":1}
I20260812 00:05:42.556646 10491 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "630a8f2f1f404ea3b8d5c8c2d8b77abb" candidate_uuid: "86b5342cbc594caf9b9c99374968ab65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4df34c09e9db4e1495f6aa98b9bceb60" is_pre_election: true
I20260812 00:05:42.556671 10739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "630a8f2f1f404ea3b8d5c8c2d8b77abb" candidate_uuid: "86b5342cbc594caf9b9c99374968ab65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2c0476d9f841eea5fef32975ad6492" is_pre_election: true
I20260812 00:05:42.556751 10491 raft_consensus.cc:2454] T 630a8f2f1f404ea3b8d5c8c2d8b77abb P 4df34c09e9db4e1495f6aa98b9bceb60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b5342cbc594caf9b9c99374968ab65 in term 0.
I20260812 00:05:42.556764 10739 raft_consensus.cc:2454] T 630a8f2f1f404ea3b8d5c8c2d8b77abb P ad2c0476d9f841eea5fef32975ad6492 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b5342cbc594caf9b9c99374968ab65 in term 0.
I20260812 00:05:42.556974 10140 leader_election.cc:302] T 630a8f2f1f404ea3b8d5c8c2d8b77abb P 86b5342cbc594caf9b9c99374968ab65 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4df34c09e9db4e1495f6aa98b9bceb60, 86b5342cbc594caf9b9c99374968ab65; no voters:
I20260812 00:05:42.557099 10851 raft_consensus.cc:2781] T 630a8f2f1f404ea3b8d5c8c2d8b77abb P 86b5342cbc594caf9b9c99374968ab65 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:05:42.557168 10851 raft_consensus.cc:482] T 630a8f2f1f404ea3b8d5c8c2d8b77abb P 86b5342cbc594caf9b9c99374968ab65 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:05:42.557184 10851 raft_consensus.cc:3037] T 630a8f2f1f404ea3b8d5c8c2d8b77abb P 86b5342cbc594caf9b9c99374968ab65 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:42.557891 10851 raft_consensus.cc:504] T 630a8f2f1f404ea3b8d5c8c2d8b77abb P 86b5342cbc594caf9b9c99374968ab65 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4df34c09e9db4e1495f6aa98b9bceb60" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 46465 } } peers { permanent_uuid: "86b5342cbc594caf9b9c99374968ab65" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 42473 } } peers { permanent_uuid: "ad2c0476d9f841eea5fef32975ad6492" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 34251 } }
I20260812 00:05:42.558008 10851 leader_election.cc:288] T 630a8f2f1f404ea3b8d5c8c2d8b77abb P 86b5342cbc594caf9b9c99374968ab65 [CANDIDATE]: Term 1 election: Requested vote from peers 4df34c09e9db4e1495f6aa98b9bceb60 (127.11.206.66:46465), ad2c0476d9f841eea5fef32975ad6492 (127.11.206.67:34251)
I20260812 00:05:42.558130 10739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "630a8f2f1f404ea3b8d5c8c2d8b77abb" candidate_uuid: "86b5342cbc594caf9b9c99374968ab65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2c0476d9f841eea5fef32975ad6492"
I20260812 00:05:42.558185 10491 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "630a8f2f1f404ea3b8d5c8c2d8b77abb" candidate_uuid: "86b5342cbc594caf9b9c99374968ab65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4df34c09e9db4e1495f6aa98b9bceb60"
I20260812 00:05:42.558212 10739 raft_consensus.cc:3037] T 630a8f2f1f404ea3b8d5c8c2d8b77abb P ad2c0476d9f841eea5fef32975ad6492 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:42.558259 10491 raft_consensus.cc:3037] T 630a8f2f1f404ea3b8d5c8c2d8b77abb P 4df34c09e9db4e1495f6aa98b9bceb60 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:42.558854 10739 raft_consensus.cc:2454] T 630a8f2f1f404ea3b8d5c8c2d8b77abb P ad2c0476d9f841eea5fef32975ad6492 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b5342cbc594caf9b9c99374968ab65 in term 1.
I20260812 00:05:42.558987 10491 raft_consensus.cc:2454] T 630a8f2f1f404ea3b8d5c8c2d8b77abb P 4df34c09e9db4e1495f6aa98b9bceb60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b5342cbc594caf9b9c99374968ab65 in term 1.
I20260812 00:05:42.559008 10139 leader_election.cc:302] T 630a8f2f1f404ea3b8d5c8c2d8b77abb P 86b5342cbc594caf9b9c99374968ab65 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b5342cbc594caf9b9c99374968ab65, ad2c0476d9f841eea5fef32975ad6492; no voters:
I20260812 00:05:42.559118 10851 raft_consensus.cc:2781] T 630a8f2f1f404ea3b8d5c8c2d8b77abb P 86b5342cbc594caf9b9c99374968ab65 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:05:42.559249 10851 raft_consensus.cc:686] T 630a8f2f1f404ea3b8d5c8c2d8b77abb P 86b5342cbc594caf9b9c99374968ab65 [term 1 LEADER]: Becoming Leader. State: Replica: 86b5342cbc594caf9b9c99374968ab65, State: Running, Role: LEADER
I20260812 00:05:42.559322 10851 consensus_queue.cc:237] T 630a8f2f1f404ea3b8d5c8c2d8b77abb P 86b5342cbc594caf9b9c99374968ab65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4df34c09e9db4e1495f6aa98b9bceb60" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 46465 } } peers { permanent_uuid: "86b5342cbc594caf9b9c99374968ab65" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 42473 } } peers { permanent_uuid: "ad2c0476d9f841eea5fef32975ad6492" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 34251 } }
I20260812 00:05:42.560048 10006 catalog_manager.cc:5495] T 630a8f2f1f404ea3b8d5c8c2d8b77abb P 86b5342cbc594caf9b9c99374968ab65 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86b5342cbc594caf9b9c99374968ab65 (127.11.206.65). New cstate: current_term: 1 leader_uuid: "86b5342cbc594caf9b9c99374968ab65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4df34c09e9db4e1495f6aa98b9bceb60" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 46465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86b5342cbc594caf9b9c99374968ab65" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 42473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad2c0476d9f841eea5fef32975ad6492" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 34251 } health_report { overall_health: UNKNOWN } } }
I20260812 00:05:42.565253 10840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:42.563089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55198 (local address 127.11.206.65:42473)
0812 00:05:42.563130 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:42.563131 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:42.563162 (+ 31us) server_negotiation.cc:407] Connection header received
0812 00:05:42.563224 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:42.563225 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:42.563242 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:42.563300 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:05:42.563422 (+ 122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:42.563862 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:42.564567 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:42.564754 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:42.564806 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:42.564949 (+ 143us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:05:42.565045 (+ 96us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:05:42.565114 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:42.565154 (+ 40us) server_negotiation.cc:299] Negotiation successful
0812 00:05:42.565171 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 00:05:42.566782 10739 raft_consensus.cc:1261] T 630a8f2f1f404ea3b8d5c8c2d8b77abb P ad2c0476d9f841eea5fef32975ad6492 [term 1 FOLLOWER]: Refusing update from remote peer 86b5342cbc594caf9b9c99374968ab65: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:05:42.566829 10491 raft_consensus.cc:1261] T 630a8f2f1f404ea3b8d5c8c2d8b77abb P 4df34c09e9db4e1495f6aa98b9bceb60 [term 1 FOLLOWER]: Refusing update from remote peer 86b5342cbc594caf9b9c99374968ab65: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:05:42.567075 10858 consensus_queue.cc:1035] T 630a8f2f1f404ea3b8d5c8c2d8b77abb P 86b5342cbc594caf9b9c99374968ab65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2c0476d9f841eea5fef32975ad6492" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 34251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:05:42.567183 10851 consensus_queue.cc:1035] T 630a8f2f1f404ea3b8d5c8c2d8b77abb P 86b5342cbc594caf9b9c99374968ab65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4df34c09e9db4e1495f6aa98b9bceb60" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 46465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:05:42.570386 10870 mvcc.cc:205] Tried to move back new op lower bound from 7317475911951331328 to 7317475911923507200. Current Snapshot: MvccSnapshot[applied={T|T < 7317475911951331328 or (T in {7317475911951331328})}]
I20260812 00:05:42.570525 10868 mvcc.cc:205] Tried to move back new op lower bound from 7317475911951331328 to 7317475911923507200. Current Snapshot: MvccSnapshot[applied={T|T < 7317475911951331328}]
I20260812 00:05:42.571557 10005 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40444:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:05:42.571645 10005 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40444:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:05:42.572364 10005 catalog_manager.cc:5782] T 00000000000000000000000000000000 P cf621146d4f64131b38de9cff9e1ae8e: Sending DeleteTablet for 3 replicas of tablet 630a8f2f1f404ea3b8d5c8c2d8b77abb
I20260812 00:05:42.572670 10218 tablet_service.cc:1514] Processing DeleteTablet for tablet 630a8f2f1f404ea3b8d5c8c2d8b77abb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:05:42 UTC) from {username='kudu', principal='kudu/127.11.206.126@KRBTEST.COM'} at 127.0.0.1:55186
I20260812 00:05:42.572695 10459 tablet_service.cc:1514] Processing DeleteTablet for tablet 630a8f2f1f404ea3b8d5c8c2d8b77abb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:05:42 UTC) from {username='kudu', principal='kudu/127.11.206.126@KRBTEST.COM'} at 127.0.0.1:45110
I20260812 00:05:42.573029 10705 tablet_service.cc:1514] Processing DeleteTablet for tablet 630a8f2f1f404ea3b8d5c8c2d8b77abb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:05:42 UTC) from {username='kudu', principal='kudu/127.11.206.126@KRBTEST.COM'} at 127.0.0.1:46284
I20260812 00:05:42.573120 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 10110
I20260812 00:05:42.576175 10880 tablet_replica.cc:330] T 630a8f2f1f404ea3b8d5c8c2d8b77abb P 4df34c09e9db4e1495f6aa98b9bceb60: stopping tablet replica
I20260812 00:05:42.576297 10880 raft_consensus.cc:2229] T 630a8f2f1f404ea3b8d5c8c2d8b77abb P 4df34c09e9db4e1495f6aa98b9bceb60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:05:42.576408 10880 raft_consensus.cc:2258] T 630a8f2f1f404ea3b8d5c8c2d8b77abb P 4df34c09e9db4e1495f6aa98b9bceb60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:05:42.578919 10880 ts_tablet_manager.cc:1905] T 630a8f2f1f404ea3b8d5c8c2d8b77abb P 4df34c09e9db4e1495f6aa98b9bceb60: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:05:42.580811 10880 ts_tablet_manager.cc:1918] T 630a8f2f1f404ea3b8d5c8c2d8b77abb P 4df34c09e9db4e1495f6aa98b9bceb60: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:05:42.580909 10880 log.cc:1196] T 630a8f2f1f404ea3b8d5c8c2d8b77abb P 4df34c09e9db4e1495f6aa98b9bceb60: Deleting WAL directory at /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/minicluster-data/ts-1/wal/wals/630a8f2f1f404ea3b8d5c8c2d8b77abb
I20260812 00:05:42.581221 10880 ts_tablet_manager.cc:1939] T 630a8f2f1f404ea3b8d5c8c2d8b77abb P 4df34c09e9db4e1495f6aa98b9bceb60: Deleting consensus metadata
I20260812 00:05:42.581447 10881 tablet_replica.cc:330] T 630a8f2f1f404ea3b8d5c8c2d8b77abb P ad2c0476d9f841eea5fef32975ad6492: stopping tablet replica
I20260812 00:05:42.581571 10881 raft_consensus.cc:2229] T 630a8f2f1f404ea3b8d5c8c2d8b77abb P ad2c0476d9f841eea5fef32975ad6492 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:05:42.581692 10881 raft_consensus.cc:2258] T 630a8f2f1f404ea3b8d5c8c2d8b77abb P ad2c0476d9f841eea5fef32975ad6492 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:05:42.582195 9989 catalog_manager.cc:4841] TS 4df34c09e9db4e1495f6aa98b9bceb60 (127.11.206.66:46465): tablet 630a8f2f1f404ea3b8d5c8c2d8b77abb (table test-table [id=8dfacc35b5a44184afda5ed89611ed73]) successfully deleted
W20260812 00:05:42.585579 9987 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.206.65:42473 (error 108)
I20260812 00:05:42.585728 10881 ts_tablet_manager.cc:1905] T 630a8f2f1f404ea3b8d5c8c2d8b77abb P ad2c0476d9f841eea5fef32975ad6492: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:05:42.586234 10836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:42.586088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.65:42473 (local address 127.0.0.1:55208)
0812 00:05:42.586139 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:42.586187 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.65:42473: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260812 00:05:42.586282 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 10360
I20260812 00:05:42.596680 10881 ts_tablet_manager.cc:1918] T 630a8f2f1f404ea3b8d5c8c2d8b77abb P ad2c0476d9f841eea5fef32975ad6492: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:05:42.596802 10881 log.cc:1196] T 630a8f2f1f404ea3b8d5c8c2d8b77abb P ad2c0476d9f841eea5fef32975ad6492: Deleting WAL directory at /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786492899949492-12089-0/minicluster-data/ts-2/wal/wals/630a8f2f1f404ea3b8d5c8c2d8b77abb
I20260812 00:05:42.597060 10881 ts_tablet_manager.cc:1939] T 630a8f2f1f404ea3b8d5c8c2d8b77abb P ad2c0476d9f841eea5fef32975ad6492: Deleting consensus metadata
W20260812 00:05:42.599808 9987 catalog_manager.cc:4584] TS 86b5342cbc594caf9b9c99374968ab65 (127.11.206.65:42473): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 630a8f2f1f404ea3b8d5c8c2d8b77abb: Network error: Client connection negotiation failed: client connection to 127.11.206.65:42473: connect: Connection refused (error 111)
I20260812 00:05:42.601020 9988 catalog_manager.cc:4841] TS ad2c0476d9f841eea5fef32975ad6492 (127.11.206.67:34251): tablet 630a8f2f1f404ea3b8d5c8c2d8b77abb (table test-table [id=8dfacc35b5a44184afda5ed89611ed73]) successfully deleted
I20260812 00:05:42.607683 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 10600
I20260812 00:05:42.624542 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 9957
2026-08-12T00:05:42Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2061 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-12T00:05:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:05:42Z Disabled control of system clock
I20260812 00:05:42.659410 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492899949492-12089-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492899949492-12089-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492899949492-12089-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:34843
--webserver_interface=127.11.206.126
--webserver_port=0
--builtin_ntp_servers=127.11.206.84:33151
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.206.126:34843
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 00:05:42.739928 10893 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:42.740142 10893 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:42.740161 10893 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:42.741258 10893 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:05:42.741293 10893 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:42.741304 10893 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:42.741315 10893 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:05:42.741331 10893 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:05:42.742686 10893 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:33151
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492899949492-12089-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492899949492-12089-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.206.126:34843
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:34843
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.206.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10893
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492899949492-12089-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:05:42.742897 10893 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:42.743191 10893 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:42.747910 10904 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:42.747931 10901 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:42.747916 10907 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:42.748155 10893 server_base.cc:1034] running on GCE node
I20260812 00:05:42.748385 10893 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:42.748656 10893 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:42.749810 10893 hybrid_clock.cc:648] HybridClock initialized: now 1786493142749786 us; error 35 us; skew 500 ppm
I20260812 00:05:42.750978 10893 webserver.cc:460] Webserver started at http://127.11.206.126:38931/ using document root <none> and password file <none>
I20260812 00:05:42.751221 10893 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:42.751274 10893 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:42.751399 10893 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:42.752431 10893 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492899949492-12089-0/minicluster-data/master-0/data/instance:
uuid: "40fdf3d48ee248438b878877f208ab22"
format_stamp: "Formatted at 2026-08-12 00:05:42 on dist-test-slave-f0tn"
server_key: "2c79568afd41a44cea104108fd8d7ebf"
server_key_iv: "414f7ac141e78af2f978bc0007d5598a"
server_key_version: "encryptionkey@0"
I20260812 00:05:42.752833 10893 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492899949492-12089-0/minicluster-data/master-0/wal/instance:
uuid: "40fdf3d48ee248438b878877f208ab22"
format_stamp: "Formatted at 2026-08-12 00:05:42 on dist-test-slave-f0tn"
server_key: "2c79568afd41a44cea104108fd8d7ebf"
server_key_iv: "414f7ac141e78af2f978bc0007d5598a"
server_key_version: "encryptionkey@0"
I20260812 00:05:42.754184 10893 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:05:42.754856 10919 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:42.755007 10893 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:05:42.755092 10893 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492899949492-12089-0/minicluster-data/master-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492899949492-12089-0/minicluster-data/master-0/wal
uuid: "40fdf3d48ee248438b878877f208ab22"
format_stamp: "Formatted at 2026-08-12 00:05:42 on dist-test-slave-f0tn"
server_key: "2c79568afd41a44cea104108fd8d7ebf"
server_key_iv: "414f7ac141e78af2f978bc0007d5598a"
server_key_version: "encryptionkey@0"
I20260812 00:05:42.755168 10893 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492899949492-12089-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492899949492-12089-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492899949492-12089-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:42.777981 10893 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:42.778331 10893 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:42.778467 10893 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:42.782460 10893 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.126:34843
I20260812 00:05:42.782496 11021 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.126:34843 every 8 connection(s)
I20260812 00:05:42.782838 10893 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
I20260812 00:05:42.783532 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 10893
I20260812 00:05:42.783622 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492899949492-12089-0/minicluster-data/master-0/wal/instance
I20260812 00:05:42.783828 12089 external_mini_cluster.cc:1428] Setting key 06537ca0d76b8e66c03a6b22d7a75495
I20260812 00:05:42.783854 11024 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:42.786803 11024 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 40fdf3d48ee248438b878877f208ab22: Bootstrap starting.
I20260812 00:05:42.787396 11024 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 40fdf3d48ee248438b878877f208ab22: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:42.787652 11024 log.cc:824] T 00000000000000000000000000000000 P 40fdf3d48ee248438b878877f208ab22: Log is configured to *not* fsync() on all Append() calls
I20260812 00:05:42.788362 11024 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 40fdf3d48ee248438b878877f208ab22: No bootstrap required, opened a new log
I20260812 00:05:42.789129 11028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:42.784325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34768 (local address 127.11.206.126:34843)
0812 00:05:42.784519 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:42.784528 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:42.784552 (+ 24us) server_negotiation.cc:407] Connection header received
0812 00:05:42.785088 (+ 536us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:42.785095 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:42.785163 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:42.785288 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:42.785529 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:42.786403 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:42.787239 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:42.787692 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:42.787810 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:42.788481 (+ 671us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:42.788485 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:42.788486 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:05:42.788643 (+ 157us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:42.788677 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:05:42.788687 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:42.788759 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:42.788856 (+ 97us) server_negotiation.cc:299] Negotiation successful
0812 00:05:42.788921 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":76,"threads_started":1}
I20260812 00:05:42.790380 11024 raft_consensus.cc:348] T 00000000000000000000000000000000 P 40fdf3d48ee248438b878877f208ab22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40fdf3d48ee248438b878877f208ab22" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 34843 } }
I20260812 00:05:42.790514 11024 raft_consensus.cc:374] T 00000000000000000000000000000000 P 40fdf3d48ee248438b878877f208ab22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:42.790535 11024 raft_consensus.cc:729] T 00000000000000000000000000000000 P 40fdf3d48ee248438b878877f208ab22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40fdf3d48ee248438b878877f208ab22, State: Initialized, Role: FOLLOWER
I20260812 00:05:42.790619 11024 consensus_queue.cc:260] T 00000000000000000000000000000000 P 40fdf3d48ee248438b878877f208ab22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40fdf3d48ee248438b878877f208ab22" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 34843 } }
I20260812 00:05:42.790669 11024 raft_consensus.cc:388] T 00000000000000000000000000000000 P 40fdf3d48ee248438b878877f208ab22 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:05:42.790693 11024 raft_consensus.cc:482] T 00000000000000000000000000000000 P 40fdf3d48ee248438b878877f208ab22 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:05:42.790723 11024 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 40fdf3d48ee248438b878877f208ab22 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:42.791271 11024 raft_consensus.cc:504] T 00000000000000000000000000000000 P 40fdf3d48ee248438b878877f208ab22 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40fdf3d48ee248438b878877f208ab22" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 34843 } }
I20260812 00:05:42.791361 11024 leader_election.cc:302] T 00000000000000000000000000000000 P 40fdf3d48ee248438b878877f208ab22 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 40fdf3d48ee248438b878877f208ab22; no voters:
I20260812 00:05:42.791502 11024 leader_election.cc:288] T 00000000000000000000000000000000 P 40fdf3d48ee248438b878877f208ab22 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:05:42.791555 11031 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 40fdf3d48ee248438b878877f208ab22 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:05:42.791704 11031 raft_consensus.cc:686] T 00000000000000000000000000000000 P 40fdf3d48ee248438b878877f208ab22 [term 1 LEADER]: Becoming Leader. State: Replica: 40fdf3d48ee248438b878877f208ab22, State: Running, Role: LEADER
I20260812 00:05:42.791723 11024 sys_catalog.cc:564] T 00000000000000000000000000000000 P 40fdf3d48ee248438b878877f208ab22 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:05:42.791822 11031 consensus_queue.cc:237] T 00000000000000000000000000000000 P 40fdf3d48ee248438b878877f208ab22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40fdf3d48ee248438b878877f208ab22" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 34843 } }
I20260812 00:05:42.792171 11033 sys_catalog.cc:455] T 00000000000000000000000000000000 P 40fdf3d48ee248438b878877f208ab22 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "40fdf3d48ee248438b878877f208ab22" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40fdf3d48ee248438b878877f208ab22" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 34843 } } }
I20260812 00:05:42.792264 11033 sys_catalog.cc:458] T 00000000000000000000000000000000 P 40fdf3d48ee248438b878877f208ab22 [sys.catalog]: This master's current role is: LEADER
I20260812 00:05:42.792471 11037 sys_catalog.cc:455] T 00000000000000000000000000000000 P 40fdf3d48ee248438b878877f208ab22 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 40fdf3d48ee248438b878877f208ab22. Latest consensus state: current_term: 1 leader_uuid: "40fdf3d48ee248438b878877f208ab22" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40fdf3d48ee248438b878877f208ab22" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 34843 } } }
I20260812 00:05:42.792582 11037 sys_catalog.cc:458] T 00000000000000000000000000000000 P 40fdf3d48ee248438b878877f208ab22 [sys.catalog]: This master's current role is: LEADER
I20260812 00:05:42.792755 11048 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:05:42.793212 11048 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:05:42.794667 11048 catalog_manager.cc:1347] Generated new cluster ID: 7558cab84f5e437d97b236292546c6d7
I20260812 00:05:42.794727 11048 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:05:42.807488 11048 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:05:42.808220 11048 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:05:42.812027 11048 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 40fdf3d48ee248438b878877f208ab22: Generated new TSK 0
I20260812 00:05:42.812220 11048 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:05:42.822479 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492899949492-12089-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492899949492-12089-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492899949492-12089-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.65:0
--local_ip_for_outbound_sockets=127.11.206.65
--webserver_interface=127.11.206.65
--webserver_port=0
--tserver_master_addrs=127.11.206.126:34843
--builtin_ntp_servers=127.11.206.84:33151
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 00:05:42.906190 11067 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:42.906414 11067 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:42.906436 11067 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:42.907672 11067 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:42.907713 11067 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:42.907739 11067 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.65
I20260812 00:05:42.909133 11067 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:33151
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492899949492-12089-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492899949492-12089-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.206.65
--webserver_port=0
--tserver_master_addrs=127.11.206.126:34843
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11067
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.65
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492899949492-12089-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:05:42.909403 11067 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:42.909714 11067 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:42.914855 11078 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:42.914863 11076 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:42.914889 11074 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:42.915578 11067 server_base.cc:1034] running on GCE node
I20260812 00:05:42.915823 11067 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:42.916075 11067 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:42.917237 11067 hybrid_clock.cc:648] HybridClock initialized: now 1786493142917220 us; error 31 us; skew 500 ppm
I20260812 00:05:42.918565 11067 webserver.cc:460] Webserver started at http://127.11.206.65:45101/ using document root <none> and password file <none>
I20260812 00:05:42.918824 11067 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:42.918876 11067 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:42.919003 11067 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:42.920073 11067 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492899949492-12089-0/minicluster-data/ts-0/data/instance:
uuid: "c2c9977e625b4714b20c0e66a4d4b347"
format_stamp: "Formatted at 2026-08-12 00:05:42 on dist-test-slave-f0tn"
server_key: "b1ff6f7587facd3c20dbb68a16b48ebe"
server_key_iv: "a06b0e4b9810b42c72d71f6713ab83fe"
server_key_version: "encryptionkey@0"
I20260812 00:05:42.920459 11067 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492899949492-12089-0/minicluster-data/ts-0/wal/instance:
uuid: "c2c9977e625b4714b20c0e66a4d4b347"
format_stamp: "Formatted at 2026-08-12 00:05:42 on dist-test-slave-f0tn"
server_key: "b1ff6f7587facd3c20dbb68a16b48ebe"
server_key_iv: "a06b0e4b9810b42c72d71f6713ab83fe"
server_key_version: "encryptionkey@0"
I20260812 00:05:42.921819 11067 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260812 00:05:42.922489 11090 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:42.922665 11067 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:05:42.922751 11067 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492899949492-12089-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492899949492-12089-0/minicluster-data/ts-0/wal
uuid: "c2c9977e625b4714b20c0e66a4d4b347"
format_stamp: "Formatted at 2026-08-12 00:05:42 on dist-test-slave-f0tn"
server_key: "b1ff6f7587facd3c20dbb68a16b48ebe"
server_key_iv: "a06b0e4b9810b42c72d71f6713ab83fe"
server_key_version: "encryptionkey@0"
I20260812 00:05:42.922812 11067 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492899949492-12089-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492899949492-12089-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492899949492-12089-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:42.945627 11067 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:42.945955 11067 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:42.946094 11067 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:42.946333 11067 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:05:42.946666 11067 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:05:42.946703 11067 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:42.946733 11067 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:05:42.946765 11067 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:42.952464 11067 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.65:37665
I20260812 00:05:42.952531 11296 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.65:37665 every 8 connection(s)
I20260812 00:05:42.952885 11067 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
I20260812 00:05:42.958067 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 11067
I20260812 00:05:42.958228 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492899949492-12089-0/minicluster-data/ts-0/wal/instance
I20260812 00:05:42.958482 12089 external_mini_cluster.cc:1428] Setting key 9bd5455fadd0e7160af19ca03c9ea494
I20260812 00:05:42.958665 11028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:42.953702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.65:40951 (local address 127.11.206.126:34843)
0812 00:05:42.953763 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:42.953764 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:42.954008 (+ 244us) server_negotiation.cc:407] Connection header received
0812 00:05:42.954748 (+ 740us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:42.954749 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:42.954765 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:42.954829 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:42.955680 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:42.956214 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:42.957190 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:42.957416 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:42.957486 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:42.958352 (+ 866us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:42.958353 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:42.958354 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:05:42.958359 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:42.958379 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:05:42.958384 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:42.958456 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:42.958528 (+ 72us) server_negotiation.cc:299] Negotiation successful
0812 00:05:42.958587 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260812 00:05:42.958859 11300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:42.953694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:34843 (local address 127.11.206.65:40951)
0812 00:05:42.953892 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:42.953926 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:42.954616 (+ 690us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:42.954934 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:42.954939 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:42.954952 (+ 13us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:42.955565 (+ 613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:42.955571 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:42.956291 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:42.956292 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:42.957104 (+ 812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:42.957106 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:42.957495 (+ 389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:42.957496 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:42.957621 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:42.958183 (+ 562us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:05:42.958184 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:42.958235 (+ 51us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:05:42.958268 (+ 33us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:42.958456 (+ 188us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:42.958459 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:42.958462 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:05:42.958507 (+ 45us) client_negotiation.cc:240] Negotiation successful
0812 00:05:42.958624 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":86,"threads_started":1}
I20260812 00:05:42.959415 11297 heartbeater.cc:347] Connected to a master server at 127.11.206.126:34843
I20260812 00:05:42.959508 11297 heartbeater.cc:464] Registering TS with master...
I20260812 00:05:42.959514 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492899949492-12089-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492899949492-12089-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492899949492-12089-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.66:0
--local_ip_for_outbound_sockets=127.11.206.66
--webserver_interface=127.11.206.66
--webserver_port=0
--tserver_master_addrs=127.11.206.126:34843
--builtin_ntp_servers=127.11.206.84:33151
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 00:05:42.959733 11297 heartbeater.cc:511] Master 127.11.206.126:34843 requested a full tablet report, sending...
I20260812 00:05:42.960260 10960 ts_manager.cc:194] Registered new tserver with Master: c2c9977e625b4714b20c0e66a4d4b347 (127.11.206.65:37665)
I20260812 00:05:42.960863 10960 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.206.65:40951
W20260812 00:05:43.042368 11301 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:43.042593 11301 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:43.042613 11301 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:43.043790 11301 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:43.043834 11301 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:43.043859 11301 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.66
I20260812 00:05:43.045262 11301 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:33151
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492899949492-12089-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492899949492-12089-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.206.66
--webserver_port=0
--tserver_master_addrs=127.11.206.126:34843
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11301
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.66
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492899949492-12089-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:05:43.045538 11301 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:43.045848 11301 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 00:05:43.051151 11301 server_base.cc:1034] running on GCE node
W20260812 00:05:43.051129 11308 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:43.051100 11307 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:43.051100 11311 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:43.051486 11301 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:43.051782 11301 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:43.052937 11301 hybrid_clock.cc:648] HybridClock initialized: now 1786493143052920 us; error 29 us; skew 500 ppm
I20260812 00:05:43.054286 11301 webserver.cc:460] Webserver started at http://127.11.206.66:36687/ using document root <none> and password file <none>
I20260812 00:05:43.054577 11301 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:43.054627 11301 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:43.054744 11301 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:43.055835 11301 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492899949492-12089-0/minicluster-data/ts-1/data/instance:
uuid: "796091840c5e43c392d7dd36cd9a9049"
format_stamp: "Formatted at 2026-08-12 00:05:43 on dist-test-slave-f0tn"
server_key: "67d4d5335404df6c624b098bf82493d8"
server_key_iv: "047a5c4a0a94696fce004f785c7bb11b"
server_key_version: "encryptionkey@0"
I20260812 00:05:43.056190 11301 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492899949492-12089-0/minicluster-data/ts-1/wal/instance:
uuid: "796091840c5e43c392d7dd36cd9a9049"
format_stamp: "Formatted at 2026-08-12 00:05:43 on dist-test-slave-f0tn"
server_key: "67d4d5335404df6c624b098bf82493d8"
server_key_iv: "047a5c4a0a94696fce004f785c7bb11b"
server_key_version: "encryptionkey@0"
I20260812 00:05:43.057500 11301 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:05:43.058204 11321 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:43.058364 11301 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:05:43.058449 11301 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492899949492-12089-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492899949492-12089-0/minicluster-data/ts-1/wal
uuid: "796091840c5e43c392d7dd36cd9a9049"
format_stamp: "Formatted at 2026-08-12 00:05:43 on dist-test-slave-f0tn"
server_key: "67d4d5335404df6c624b098bf82493d8"
server_key_iv: "047a5c4a0a94696fce004f785c7bb11b"
server_key_version: "encryptionkey@0"
I20260812 00:05:43.058524 11301 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492899949492-12089-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492899949492-12089-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492899949492-12089-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:43.069882 11301 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:43.070175 11301 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:43.070297 11301 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:43.070497 11301 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:05:43.070811 11301 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:05:43.070845 11301 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:43.070875 11301 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:05:43.070899 11301 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:43.076391 11301 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.66:42693
I20260812 00:05:43.076444 11536 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.66:42693 every 8 connection(s)
I20260812 00:05:43.076766 11301 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
I20260812 00:05:43.081923 11028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:43.077485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.66:43777 (local address 127.11.206.126:34843)
0812 00:05:43.077570 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:43.077572 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:43.077799 (+ 227us) server_negotiation.cc:407] Connection header received
0812 00:05:43.078369 (+ 570us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:43.078370 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:43.078381 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:43.078442 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:43.079100 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:43.079593 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:43.080601 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:43.080800 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:43.080854 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:43.081690 (+ 836us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:43.081691 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:43.081692 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:05:43.081696 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:43.081718 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:05:43.081722 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:43.081765 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:43.081835 (+ 70us) server_negotiation.cc:299] Negotiation successful
0812 00:05:43.081858 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260812 00:05:43.082124 11544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:43.077486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:34843 (local address 127.11.206.66:43777)
0812 00:05:43.077686 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:43.077728 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:43.078277 (+ 549us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:43.078501 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:43.078504 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:43.078513 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:43.079027 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:43.079031 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:43.079676 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:43.079677 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:43.080512 (+ 835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:43.080516 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:43.080867 (+ 351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:43.080867 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:43.080983 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:43.081559 (+ 576us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:05:43.081559 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:43.081590 (+ 31us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:05:43.081614 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:43.081767 (+ 153us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:43.081770 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:43.081785 (+ 15us) client_negotiation.cc:769] Sending connection context
0812 00:05:43.081832 (+ 47us) client_negotiation.cc:240] Negotiation successful
0812 00:05:43.081913 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":85,"threads_started":1}
I20260812 00:05:43.082604 11538 heartbeater.cc:347] Connected to a master server at 127.11.206.126:34843
I20260812 00:05:43.082696 11538 heartbeater.cc:464] Registering TS with master...
I20260812 00:05:43.082871 11538 heartbeater.cc:511] Master 127.11.206.126:34843 requested a full tablet report, sending...
I20260812 00:05:43.083267 10960 ts_manager.cc:194] Registered new tserver with Master: 796091840c5e43c392d7dd36cd9a9049 (127.11.206.66:42693)
I20260812 00:05:43.083616 10960 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.206.66:43777
I20260812 00:05:43.085013 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 11301
I20260812 00:05:43.085114 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492899949492-12089-0/minicluster-data/ts-1/wal/instance
I20260812 00:05:43.085300 12089 external_mini_cluster.cc:1428] Setting key 4dfeff197e2ef546486123a1d20eb9f2
I20260812 00:05:43.086174 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492899949492-12089-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492899949492-12089-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492899949492-12089-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.67:0
--local_ip_for_outbound_sockets=127.11.206.67
--webserver_interface=127.11.206.67
--webserver_port=0
--tserver_master_addrs=127.11.206.126:34843
--builtin_ntp_servers=127.11.206.84:33151
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 00:05:43.168969 11547 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:43.169214 11547 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:43.169234 11547 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:43.170392 11547 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:43.170430 11547 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:43.170454 11547 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.67
I20260812 00:05:43.172227 11547 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:33151
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492899949492-12089-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492899949492-12089-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.206.67
--webserver_port=0
--tserver_master_addrs=127.11.206.126:34843
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11547
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.67
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492899949492-12089-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:05:43.172503 11547 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:43.172880 11547 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:43.178067 11573 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:43.178150 11558 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:43.178117 11561 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:43.178493 11547 server_base.cc:1034] running on GCE node
I20260812 00:05:43.178727 11547 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:43.178965 11547 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:43.180096 11547 hybrid_clock.cc:648] HybridClock initialized: now 1786493143180079 us; error 30 us; skew 500 ppm
I20260812 00:05:43.181391 11547 webserver.cc:460] Webserver started at http://127.11.206.67:37421/ using document root <none> and password file <none>
I20260812 00:05:43.181619 11547 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:43.181681 11547 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:43.181825 11547 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:43.182894 11547 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492899949492-12089-0/minicluster-data/ts-2/data/instance:
uuid: "e794d9a31b244154ae9006c35750a18a"
format_stamp: "Formatted at 2026-08-12 00:05:43 on dist-test-slave-f0tn"
server_key: "e5b196261ff08cf76a290c2a5c8568bc"
server_key_iv: "fdcee373e6143a42477742a431b9b11b"
server_key_version: "encryptionkey@0"
I20260812 00:05:43.183238 11547 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492899949492-12089-0/minicluster-data/ts-2/wal/instance:
uuid: "e794d9a31b244154ae9006c35750a18a"
format_stamp: "Formatted at 2026-08-12 00:05:43 on dist-test-slave-f0tn"
server_key: "e5b196261ff08cf76a290c2a5c8568bc"
server_key_iv: "fdcee373e6143a42477742a431b9b11b"
server_key_version: "encryptionkey@0"
I20260812 00:05:43.184448 11547 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:05:43.185076 11579 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:43.185233 11547 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:05:43.185317 11547 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492899949492-12089-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492899949492-12089-0/minicluster-data/ts-2/wal
uuid: "e794d9a31b244154ae9006c35750a18a"
format_stamp: "Formatted at 2026-08-12 00:05:43 on dist-test-slave-f0tn"
server_key: "e5b196261ff08cf76a290c2a5c8568bc"
server_key_iv: "fdcee373e6143a42477742a431b9b11b"
server_key_version: "encryptionkey@0"
I20260812 00:05:43.185401 11547 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492899949492-12089-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492899949492-12089-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492899949492-12089-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:43.204880 11547 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:43.205202 11547 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:43.205339 11547 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:43.205595 11547 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:05:43.205940 11547 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:05:43.205976 11547 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:43.206005 11547 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:05:43.206028 11547 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:43.211789 11547 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.67:45439
I20260812 00:05:43.211833 11795 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.67:45439 every 8 connection(s)
I20260812 00:05:43.212188 11547 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
I20260812 00:05:43.217461 11028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:43.212947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.67:42159 (local address 127.11.206.126:34843)
0812 00:05:43.213015 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:43.213017 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:43.213294 (+ 277us) server_negotiation.cc:407] Connection header received
0812 00:05:43.213884 (+ 590us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:43.213885 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:43.213896 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:43.213950 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:43.214625 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:43.215130 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:43.216127 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:43.216334 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:43.216397 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:43.217205 (+ 808us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:43.217205 (+ 0us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:43.217206 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:05:43.217209 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:43.217223 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:05:43.217226 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:43.217261 (+ 35us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:43.217326 (+ 65us) server_negotiation.cc:299] Negotiation successful
0812 00:05:43.217347 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260812 00:05:43.217650 11800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:43.212943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:34843 (local address 127.11.206.67:42159)
0812 00:05:43.213172 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:43.213209 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:43.213793 (+ 584us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:43.214011 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:43.214015 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:43.214024 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:43.214538 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:43.214541 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:43.215207 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:43.215208 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:43.216022 (+ 814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:43.216024 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:43.216404 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:43.216405 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:43.216514 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:43.217069 (+ 555us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:05:43.217069 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:43.217100 (+ 31us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:05:43.217126 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:43.217270 (+ 144us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:43.217272 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:43.217275 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:05:43.217319 (+ 44us) client_negotiation.cc:240] Negotiation successful
0812 00:05:43.217434 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":111,"threads_started":1}
I20260812 00:05:43.218104 11796 heartbeater.cc:347] Connected to a master server at 127.11.206.126:34843
I20260812 00:05:43.218202 11796 heartbeater.cc:464] Registering TS with master...
I20260812 00:05:43.218366 11796 heartbeater.cc:511] Master 127.11.206.126:34843 requested a full tablet report, sending...
I20260812 00:05:43.218686 10960 ts_manager.cc:194] Registered new tserver with Master: e794d9a31b244154ae9006c35750a18a (127.11.206.67:45439)
I20260812 00:05:43.219024 10960 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.206.67:42159
I20260812 00:05:43.221585 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 11547
I20260812 00:05:43.221686 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492899949492-12089-0/minicluster-data/ts-2/wal/instance
I20260812 00:05:43.221877 12089 external_mini_cluster.cc:1428] Setting key cf9bbc0c35daa6dd4003260076af4296
I20260812 00:05:43.222832 12089 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:05:43.226948 11028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:43.224172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34772 (local address 127.11.206.126:34843)
0812 00:05:43.224229 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:43.224231 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:43.224304 (+ 73us) server_negotiation.cc:407] Connection header received
0812 00:05:43.224362 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:43.224363 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:43.224373 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:43.224419 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:43.224569 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:43.225059 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:43.225895 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:43.226087 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:43.226143 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:43.226729 (+ 586us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:43.226731 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:43.226731 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:05:43.226735 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:43.226750 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:05:43.226754 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:43.226796 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:43.226848 (+ 52us) server_negotiation.cc:299] Negotiation successful
0812 00:05:43.226870 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260812 00:05:43.228426 10960 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34772:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:05:43.230041 10960 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:05:43.236338 11814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:43.232079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.67:45439 (local address 127.0.0.1:58878)
0812 00:05:43.232456 (+ 377us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:43.232466 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:43.232523 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:43.232989 (+ 466us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:43.232990 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:43.232992 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:05:43.233032 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:43.233033 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:43.234246 (+ 1213us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:43.234247 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:43.235212 (+ 965us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:43.235215 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:43.236035 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:43.236036 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:43.236112 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:43.236128 (+ 16us) client_negotiation.cc:769] Sending connection context
0812 00:05:43.236205 (+ 77us) client_negotiation.cc:240] Negotiation successful
0812 00:05:43.236256 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":355,"mutex_wait_us":2,"thread_start_us":153,"threads_started":1}
I20260812 00:05:43.236361 11811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:43.232187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58878 (local address 127.11.206.67:45439)
0812 00:05:43.232786 (+ 599us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:43.232791 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:43.232801 (+ 10us) server_negotiation.cc:407] Connection header received
0812 00:05:43.232837 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:43.232839 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:43.232852 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:43.232920 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:05:43.233097 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:43.234171 (+ 1074us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:43.235285 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:43.235949 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:43.236025 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:43.236119 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:43.236236 (+ 117us) server_negotiation.cc:299] Negotiation successful
0812 00:05:43.236274 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":554,"thread_start_us":78,"threads_started":1}
I20260812 00:05:43.236599 11809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:43.232063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.66:42693 (local address 127.0.0.1:48512)
0812 00:05:43.232306 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:43.232351 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:43.232416 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:43.232657 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:43.232660 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:43.232662 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:05:43.232740 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:43.232741 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:43.234134 (+ 1393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:43.234135 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:43.235412 (+ 1277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:43.235415 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:43.236373 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:43.236374 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:43.236435 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:43.236440 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 00:05:43.236489 (+ 49us) client_negotiation.cc:240] Negotiation successful
0812 00:05:43.236529 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":205,"mutex_wait_us":23,"thread_start_us":81,"threads_started":1}
I20260812 00:05:43.236843 11815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:43.232314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48512 (local address 127.11.206.66:42693)
0812 00:05:43.232496 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:43.232501 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:43.232512 (+ 11us) server_negotiation.cc:407] Connection header received
0812 00:05:43.232553 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:43.232555 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:43.232571 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:43.232646 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:05:43.232858 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:43.234052 (+ 1194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:43.235500 (+ 1448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:43.236185 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:43.236247 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:43.236334 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:43.236744 (+ 410us) server_negotiation.cc:299] Negotiation successful
0812 00:05:43.236779 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":75,"threads_started":1}
I20260812 00:05:43.236935 11808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:43.232305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.65:37665 (local address 127.0.0.1:50792)
0812 00:05:43.232692 (+ 387us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:43.232702 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:43.232755 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:43.233566 (+ 811us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:43.233567 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:43.233568 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:05:43.233604 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:43.233606 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:43.234598 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:43.234599 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:43.235605 (+ 1006us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:43.235607 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:43.236711 (+ 1104us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:43.236712 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:43.236773 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:43.236778 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 00:05:43.236822 (+ 44us) client_negotiation.cc:240] Negotiation successful
0812 00:05:43.236862 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":376,"thread_start_us":84,"threads_started":1}
I20260812 00:05:43.237213 11819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:43.232528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50792 (local address 127.11.206.65:37665)
0812 00:05:43.232690 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:43.232694 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:43.232745 (+ 51us) server_negotiation.cc:407] Connection header received
0812 00:05:43.233479 (+ 734us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:43.233481 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:43.233494 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:43.233562 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:05:43.233674 (+ 112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:43.234502 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:43.235678 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:43.236292 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:43.236350 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:43.237047 (+ 697us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:43.237075 (+ 28us) server_negotiation.cc:299] Negotiation successful
0812 00:05:43.237122 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":79,"threads_started":1}
I20260812 00:05:43.237366 11416 tablet_service.cc:1467] Processing CreateTablet for tablet f81d6dce3d1e41bcab13e6d2cd4afbf1 (DEFAULT_TABLE table=test-table [id=2b552e3716d5404db50ac70b1e599d9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:05:43.237367 11669 tablet_service.cc:1467] Processing CreateTablet for tablet f81d6dce3d1e41bcab13e6d2cd4afbf1 (DEFAULT_TABLE table=test-table [id=2b552e3716d5404db50ac70b1e599d9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:05:43.237771 11669 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f81d6dce3d1e41bcab13e6d2cd4afbf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:43.237771 11416 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f81d6dce3d1e41bcab13e6d2cd4afbf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:43.241185 11821 tablet_bootstrap.cc:492] T f81d6dce3d1e41bcab13e6d2cd4afbf1 P 796091840c5e43c392d7dd36cd9a9049: Bootstrap starting.
I20260812 00:05:43.241449 11823 tablet_bootstrap.cc:492] T f81d6dce3d1e41bcab13e6d2cd4afbf1 P e794d9a31b244154ae9006c35750a18a: Bootstrap starting.
I20260812 00:05:43.241888 11177 tablet_service.cc:1467] Processing CreateTablet for tablet f81d6dce3d1e41bcab13e6d2cd4afbf1 (DEFAULT_TABLE table=test-table [id=2b552e3716d5404db50ac70b1e599d9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:05:43.242008 11821 tablet_bootstrap.cc:654] T f81d6dce3d1e41bcab13e6d2cd4afbf1 P 796091840c5e43c392d7dd36cd9a9049: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:43.242061 11823 tablet_bootstrap.cc:654] T f81d6dce3d1e41bcab13e6d2cd4afbf1 P e794d9a31b244154ae9006c35750a18a: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:43.242230 11177 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f81d6dce3d1e41bcab13e6d2cd4afbf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:43.242336 11821 log.cc:824] T f81d6dce3d1e41bcab13e6d2cd4afbf1 P 796091840c5e43c392d7dd36cd9a9049: Log is configured to *not* fsync() on all Append() calls
I20260812 00:05:43.242353 11823 log.cc:824] T f81d6dce3d1e41bcab13e6d2cd4afbf1 P e794d9a31b244154ae9006c35750a18a: Log is configured to *not* fsync() on all Append() calls
I20260812 00:05:43.243085 11823 tablet_bootstrap.cc:492] T f81d6dce3d1e41bcab13e6d2cd4afbf1 P e794d9a31b244154ae9006c35750a18a: No bootstrap required, opened a new log
I20260812 00:05:43.243085 11821 tablet_bootstrap.cc:492] T f81d6dce3d1e41bcab13e6d2cd4afbf1 P 796091840c5e43c392d7dd36cd9a9049: No bootstrap required, opened a new log
I20260812 00:05:43.243161 11823 ts_tablet_manager.cc:1397] T f81d6dce3d1e41bcab13e6d2cd4afbf1 P e794d9a31b244154ae9006c35750a18a: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 00:05:43.243160 11821 ts_tablet_manager.cc:1397] T f81d6dce3d1e41bcab13e6d2cd4afbf1 P 796091840c5e43c392d7dd36cd9a9049: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 00:05:43.244828 11828 tablet_bootstrap.cc:492] T f81d6dce3d1e41bcab13e6d2cd4afbf1 P c2c9977e625b4714b20c0e66a4d4b347: Bootstrap starting.
I20260812 00:05:43.245487 11828 tablet_bootstrap.cc:654] T f81d6dce3d1e41bcab13e6d2cd4afbf1 P c2c9977e625b4714b20c0e66a4d4b347: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:43.245685 11823 raft_consensus.cc:348] T f81d6dce3d1e41bcab13e6d2cd4afbf1 P e794d9a31b244154ae9006c35750a18a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "796091840c5e43c392d7dd36cd9a9049" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 42693 } } peers { permanent_uuid: "e794d9a31b244154ae9006c35750a18a" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 45439 } } peers { permanent_uuid: "c2c9977e625b4714b20c0e66a4d4b347" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 37665 } }
I20260812 00:05:43.245685 11821 raft_consensus.cc:348] T f81d6dce3d1e41bcab13e6d2cd4afbf1 P 796091840c5e43c392d7dd36cd9a9049 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "796091840c5e43c392d7dd36cd9a9049" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 42693 } } peers { permanent_uuid: "e794d9a31b244154ae9006c35750a18a" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 45439 } } peers { permanent_uuid: "c2c9977e625b4714b20c0e66a4d4b347" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 37665 } }
I20260812 00:05:43.245823 11828 log.cc:824] T f81d6dce3d1e41bcab13e6d2cd4afbf1 P c2c9977e625b4714b20c0e66a4d4b347: Log is configured to *not* fsync() on all Append() calls
I20260812 00:05:43.245858 11823 raft_consensus.cc:374] T f81d6dce3d1e41bcab13e6d2cd4afbf1 P e794d9a31b244154ae9006c35750a18a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:43.245858 11821 raft_consensus.cc:374] T f81d6dce3d1e41bcab13e6d2cd4afbf1 P 796091840c5e43c392d7dd36cd9a9049 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:43.245894 11823 raft_consensus.cc:729] T f81d6dce3d1e41bcab13e6d2cd4afbf1 P e794d9a31b244154ae9006c35750a18a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e794d9a31b244154ae9006c35750a18a, State: Initialized, Role: FOLLOWER
I20260812 00:05:43.245894 11821 raft_consensus.cc:729] T f81d6dce3d1e41bcab13e6d2cd4afbf1 P 796091840c5e43c392d7dd36cd9a9049 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 796091840c5e43c392d7dd36cd9a9049, State: Initialized, Role: FOLLOWER
I20260812 00:05:43.246034 11823 consensus_queue.cc:260] T f81d6dce3d1e41bcab13e6d2cd4afbf1 P e794d9a31b244154ae9006c35750a18a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "796091840c5e43c392d7dd36cd9a9049" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 42693 } } peers { permanent_uuid: "e794d9a31b244154ae9006c35750a18a" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 45439 } } peers { permanent_uuid: "c2c9977e625b4714b20c0e66a4d4b347" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 37665 } }
I20260812 00:05:43.246053 11821 consensus_queue.cc:260] T f81d6dce3d1e41bcab13e6d2cd4afbf1 P 796091840c5e43c392d7dd36cd9a9049 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "796091840c5e43c392d7dd36cd9a9049" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 42693 } } peers { permanent_uuid: "e794d9a31b244154ae9006c35750a18a" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 45439 } } peers { permanent_uuid: "c2c9977e625b4714b20c0e66a4d4b347" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 37665 } }
I20260812 00:05:43.246317 11821 ts_tablet_manager.cc:1428] T f81d6dce3d1e41bcab13e6d2cd4afbf1 P 796091840c5e43c392d7dd36cd9a9049: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 00:05:43.246317 11823 ts_tablet_manager.cc:1428] T f81d6dce3d1e41bcab13e6d2cd4afbf1 P e794d9a31b244154ae9006c35750a18a: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 00:05:43.246438 11796 heartbeater.cc:503] Master 127.11.206.126:34843 was elected leader, sending a full tablet report...
I20260812 00:05:43.246490 11538 heartbeater.cc:503] Master 127.11.206.126:34843 was elected leader, sending a full tablet report...
I20260812 00:05:43.246541 11828 tablet_bootstrap.cc:492] T f81d6dce3d1e41bcab13e6d2cd4afbf1 P c2c9977e625b4714b20c0e66a4d4b347: No bootstrap required, opened a new log
I20260812 00:05:43.246609 11828 ts_tablet_manager.cc:1397] T f81d6dce3d1e41bcab13e6d2cd4afbf1 P c2c9977e625b4714b20c0e66a4d4b347: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260812 00:05:43.248622 11828 raft_consensus.cc:348] T f81d6dce3d1e41bcab13e6d2cd4afbf1 P c2c9977e625b4714b20c0e66a4d4b347 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "796091840c5e43c392d7dd36cd9a9049" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 42693 } } peers { permanent_uuid: "e794d9a31b244154ae9006c35750a18a" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 45439 } } peers { permanent_uuid: "c2c9977e625b4714b20c0e66a4d4b347" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 37665 } }
I20260812 00:05:43.248751 11828 raft_consensus.cc:374] T f81d6dce3d1e41bcab13e6d2cd4afbf1 P c2c9977e625b4714b20c0e66a4d4b347 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:43.248785 11828 raft_consensus.cc:729] T f81d6dce3d1e41bcab13e6d2cd4afbf1 P c2c9977e625b4714b20c0e66a4d4b347 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2c9977e625b4714b20c0e66a4d4b347, State: Initialized, Role: FOLLOWER
I20260812 00:05:43.248895 11828 consensus_queue.cc:260] T f81d6dce3d1e41bcab13e6d2cd4afbf1 P c2c9977e625b4714b20c0e66a4d4b347 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "796091840c5e43c392d7dd36cd9a9049" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 42693 } } peers { permanent_uuid: "e794d9a31b244154ae9006c35750a18a" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 45439 } } peers { permanent_uuid: "c2c9977e625b4714b20c0e66a4d4b347" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 37665 } }
I20260812 00:05:43.249164 11828 ts_tablet_manager.cc:1428] T f81d6dce3d1e41bcab13e6d2cd4afbf1 P c2c9977e625b4714b20c0e66a4d4b347: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260812 00:05:43.249212 11297 heartbeater.cc:503] Master 127.11.206.126:34843 was elected leader, sending a full tablet report...
I20260812 00:05:43.254853 11833 raft_consensus.cc:482] T f81d6dce3d1e41bcab13e6d2cd4afbf1 P e794d9a31b244154ae9006c35750a18a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:05:43.254940 11833 raft_consensus.cc:504] T f81d6dce3d1e41bcab13e6d2cd4afbf1 P e794d9a31b244154ae9006c35750a18a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "796091840c5e43c392d7dd36cd9a9049" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 42693 } } peers { permanent_uuid: "e794d9a31b244154ae9006c35750a18a" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 45439 } } peers { permanent_uuid: "c2c9977e625b4714b20c0e66a4d4b347" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 37665 } }
I20260812 00:05:43.255255 11833 leader_election.cc:288] T f81d6dce3d1e41bcab13e6d2cd4afbf1 P e794d9a31b244154ae9006c35750a18a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 796091840c5e43c392d7dd36cd9a9049 (127.11.206.66:42693), c2c9977e625b4714b20c0e66a4d4b347 (127.11.206.65:37665)
I20260812 00:05:43.258088 11815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:43.255492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.67:40987 (local address 127.11.206.66:42693)
0812 00:05:43.255557 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:43.255559 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:43.255569 (+ 10us) server_negotiation.cc:407] Connection header received
0812 00:05:43.255597 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:43.255598 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:43.255608 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:43.255694 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:05:43.255843 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:43.256373 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:43.257298 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:43.257733 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:43.257792 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:43.257799 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:43.257968 (+ 169us) server_negotiation.cc:299] Negotiation successful
0812 00:05:43.258012 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260812 00:05:43.258072 11800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:43.255405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.66:42693 (local address 127.11.206.67:40987)
0812 00:05:43.255454 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:43.255465 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:43.255506 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:43.255698 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:43.255698 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:43.255700 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:05:43.255774 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:43.255776 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:43.256447 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:43.256448 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:43.257213 (+ 765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:43.257216 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:43.257831 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:43.257832 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:43.257898 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:43.257901 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:05:43.257952 (+ 51us) client_negotiation.cc:240] Negotiation successful
0812 00:05:43.257992 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30,"mutex_wait_us":1}
I20260812 00:05:43.258140 11819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:43.255597 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.67:40321 (local address 127.11.206.65:37665)
0812 00:05:43.255639 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:43.255640 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:43.255741 (+ 101us) server_negotiation.cc:407] Connection header received
0812 00:05:43.255806 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:43.255807 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:43.255818 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:43.255863 (+ 45us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:05:43.256002 (+ 139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:43.256475 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:43.257451 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:43.257832 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:43.257897 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:43.257905 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:43.258052 (+ 147us) server_negotiation.cc:299] Negotiation successful
0812 00:05:43.258087 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 00:05:43.258215 11838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:43.255521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.65:37665 (local address 127.11.206.67:40321)
0812 00:05:43.255675 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:43.255685 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:43.255744 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:43.255876 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:43.255877 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:43.255878 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:05:43.255943 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:43.255945 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:43.256551 (+ 606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:43.256551 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:43.257304 (+ 753us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:43.257306 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:43.257901 (+ 595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:43.257902 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:43.257980 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:43.257983 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:05:43.258047 (+ 64us) client_negotiation.cc:240] Negotiation successful
0812 00:05:43.258084 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":84,"threads_started":1}
I20260812 00:05:43.258488 11213 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f81d6dce3d1e41bcab13e6d2cd4afbf1" candidate_uuid: "e794d9a31b244154ae9006c35750a18a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2c9977e625b4714b20c0e66a4d4b347" is_pre_election: true
I20260812 00:05:43.258563 11456 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f81d6dce3d1e41bcab13e6d2cd4afbf1" candidate_uuid: "e794d9a31b244154ae9006c35750a18a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "796091840c5e43c392d7dd36cd9a9049" is_pre_election: true
I20260812 00:05:43.258625 11213 raft_consensus.cc:2454] T f81d6dce3d1e41bcab13e6d2cd4afbf1 P c2c9977e625b4714b20c0e66a4d4b347 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e794d9a31b244154ae9006c35750a18a in term 0.
I20260812 00:05:43.258708 11456 raft_consensus.cc:2454] T f81d6dce3d1e41bcab13e6d2cd4afbf1 P 796091840c5e43c392d7dd36cd9a9049 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e794d9a31b244154ae9006c35750a18a in term 0.
I20260812 00:05:43.258827 11583 leader_election.cc:302] T f81d6dce3d1e41bcab13e6d2cd4afbf1 P e794d9a31b244154ae9006c35750a18a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c2c9977e625b4714b20c0e66a4d4b347, e794d9a31b244154ae9006c35750a18a; no voters:
I20260812 00:05:43.258936 11833 raft_consensus.cc:2781] T f81d6dce3d1e41bcab13e6d2cd4afbf1 P e794d9a31b244154ae9006c35750a18a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:05:43.258989 11833 raft_consensus.cc:482] T f81d6dce3d1e41bcab13e6d2cd4afbf1 P e794d9a31b244154ae9006c35750a18a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:05:43.259012 11833 raft_consensus.cc:3037] T f81d6dce3d1e41bcab13e6d2cd4afbf1 P e794d9a31b244154ae9006c35750a18a [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:43.259651 11833 raft_consensus.cc:504] T f81d6dce3d1e41bcab13e6d2cd4afbf1 P e794d9a31b244154ae9006c35750a18a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "796091840c5e43c392d7dd36cd9a9049" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 42693 } } peers { permanent_uuid: "e794d9a31b244154ae9006c35750a18a" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 45439 } } peers { permanent_uuid: "c2c9977e625b4714b20c0e66a4d4b347" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 37665 } }
I20260812 00:05:43.259757 11833 leader_election.cc:288] T f81d6dce3d1e41bcab13e6d2cd4afbf1 P e794d9a31b244154ae9006c35750a18a [CANDIDATE]: Term 1 election: Requested vote from peers 796091840c5e43c392d7dd36cd9a9049 (127.11.206.66:42693), c2c9977e625b4714b20c0e66a4d4b347 (127.11.206.65:37665)
I20260812 00:05:43.259943 11456 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f81d6dce3d1e41bcab13e6d2cd4afbf1" candidate_uuid: "e794d9a31b244154ae9006c35750a18a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "796091840c5e43c392d7dd36cd9a9049"
I20260812 00:05:43.260007 11456 raft_consensus.cc:3037] T f81d6dce3d1e41bcab13e6d2cd4afbf1 P 796091840c5e43c392d7dd36cd9a9049 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:43.259994 11213 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f81d6dce3d1e41bcab13e6d2cd4afbf1" candidate_uuid: "e794d9a31b244154ae9006c35750a18a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2c9977e625b4714b20c0e66a4d4b347"
I20260812 00:05:43.260120 11213 raft_consensus.cc:3037] T f81d6dce3d1e41bcab13e6d2cd4afbf1 P c2c9977e625b4714b20c0e66a4d4b347 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:43.260699 11456 raft_consensus.cc:2454] T f81d6dce3d1e41bcab13e6d2cd4afbf1 P 796091840c5e43c392d7dd36cd9a9049 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e794d9a31b244154ae9006c35750a18a in term 1.
I20260812 00:05:43.260885 11583 leader_election.cc:302] T f81d6dce3d1e41bcab13e6d2cd4afbf1 P e794d9a31b244154ae9006c35750a18a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 796091840c5e43c392d7dd36cd9a9049, e794d9a31b244154ae9006c35750a18a; no voters:
I20260812 00:05:43.260910 11213 raft_consensus.cc:2454] T f81d6dce3d1e41bcab13e6d2cd4afbf1 P c2c9977e625b4714b20c0e66a4d4b347 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e794d9a31b244154ae9006c35750a18a in term 1.
I20260812 00:05:43.260960 11833 raft_consensus.cc:2781] T f81d6dce3d1e41bcab13e6d2cd4afbf1 P e794d9a31b244154ae9006c35750a18a [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:05:43.261101 11833 raft_consensus.cc:686] T f81d6dce3d1e41bcab13e6d2cd4afbf1 P e794d9a31b244154ae9006c35750a18a [term 1 LEADER]: Becoming Leader. State: Replica: e794d9a31b244154ae9006c35750a18a, State: Running, Role: LEADER
I20260812 00:05:43.261180 11833 consensus_queue.cc:237] T f81d6dce3d1e41bcab13e6d2cd4afbf1 P e794d9a31b244154ae9006c35750a18a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "796091840c5e43c392d7dd36cd9a9049" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 42693 } } peers { permanent_uuid: "e794d9a31b244154ae9006c35750a18a" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 45439 } } peers { permanent_uuid: "c2c9977e625b4714b20c0e66a4d4b347" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 37665 } }
I20260812 00:05:43.262055 10959 catalog_manager.cc:5495] T f81d6dce3d1e41bcab13e6d2cd4afbf1 P e794d9a31b244154ae9006c35750a18a reported cstate change: term changed from 0 to 1, leader changed from <none> to e794d9a31b244154ae9006c35750a18a (127.11.206.67). New cstate: current_term: 1 leader_uuid: "e794d9a31b244154ae9006c35750a18a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "796091840c5e43c392d7dd36cd9a9049" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 42693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e794d9a31b244154ae9006c35750a18a" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 45439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c2c9977e625b4714b20c0e66a4d4b347" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 37665 } health_report { overall_health: UNKNOWN } } }
I20260812 00:05:43.268426 11811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:43.266491 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58888 (local address 127.11.206.67:45439)
0812 00:05:43.266529 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:43.266531 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:43.266539 (+ 8us) server_negotiation.cc:407] Connection header received
0812 00:05:43.266572 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:43.266573 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:43.266588 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:43.266644 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:05:43.266735 (+ 91us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:43.267200 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:43.267863 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:43.268034 (+ 171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:43.268074 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:43.268189 (+ 115us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:05:43.268281 (+ 92us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:05:43.268335 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:43.268345 (+ 10us) server_negotiation.cc:299] Negotiation successful
0812 00:05:43.268359 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 00:05:43.270062 11456 raft_consensus.cc:1261] T f81d6dce3d1e41bcab13e6d2cd4afbf1 P 796091840c5e43c392d7dd36cd9a9049 [term 1 FOLLOWER]: Refusing update from remote peer e794d9a31b244154ae9006c35750a18a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:05:43.270062 11213 raft_consensus.cc:1261] T f81d6dce3d1e41bcab13e6d2cd4afbf1 P c2c9977e625b4714b20c0e66a4d4b347 [term 1 FOLLOWER]: Refusing update from remote peer e794d9a31b244154ae9006c35750a18a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:05:43.270416 11833 consensus_queue.cc:1035] T f81d6dce3d1e41bcab13e6d2cd4afbf1 P e794d9a31b244154ae9006c35750a18a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2c9977e625b4714b20c0e66a4d4b347" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 37665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:05:43.270556 11839 consensus_queue.cc:1035] T f81d6dce3d1e41bcab13e6d2cd4afbf1 P e794d9a31b244154ae9006c35750a18a [LEADER]: Connected to new peer: Peer: permanent_uuid: "796091840c5e43c392d7dd36cd9a9049" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 42693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:05:43.275136 10960 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34772:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:05:43.275236 10960 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34772:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:05:43.275938 10960 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 40fdf3d48ee248438b878877f208ab22: Sending DeleteTablet for 3 replicas of tablet f81d6dce3d1e41bcab13e6d2cd4afbf1
I20260812 00:05:43.276224 11416 tablet_service.cc:1514] Processing DeleteTablet for tablet f81d6dce3d1e41bcab13e6d2cd4afbf1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:05:43 UTC) from {username='slave'} at 127.0.0.1:48512
I20260812 00:05:43.276259 11177 tablet_service.cc:1514] Processing DeleteTablet for tablet f81d6dce3d1e41bcab13e6d2cd4afbf1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:05:43 UTC) from {username='slave'} at 127.0.0.1:50792
I20260812 00:05:43.276275 11669 tablet_service.cc:1514] Processing DeleteTablet for tablet f81d6dce3d1e41bcab13e6d2cd4afbf1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:05:43 UTC) from {username='slave'} at 127.0.0.1:58878
I20260812 00:05:43.276436 11864 tablet_replica.cc:330] T f81d6dce3d1e41bcab13e6d2cd4afbf1 P 796091840c5e43c392d7dd36cd9a9049: stopping tablet replica
I20260812 00:05:43.276531 11864 raft_consensus.cc:2229] T f81d6dce3d1e41bcab13e6d2cd4afbf1 P 796091840c5e43c392d7dd36cd9a9049 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:05:43.276538 11871 tablet_replica.cc:330] T f81d6dce3d1e41bcab13e6d2cd4afbf1 P c2c9977e625b4714b20c0e66a4d4b347: stopping tablet replica
I20260812 00:05:43.276625 11864 raft_consensus.cc:2258] T f81d6dce3d1e41bcab13e6d2cd4afbf1 P 796091840c5e43c392d7dd36cd9a9049 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:05:43.276633 11871 raft_consensus.cc:2229] T f81d6dce3d1e41bcab13e6d2cd4afbf1 P c2c9977e625b4714b20c0e66a4d4b347 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:05:43.276722 11871 raft_consensus.cc:2258] T f81d6dce3d1e41bcab13e6d2cd4afbf1 P c2c9977e625b4714b20c0e66a4d4b347 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:05:43.276741 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 11067
I20260812 00:05:43.276855 11873 tablet_replica.cc:330] T f81d6dce3d1e41bcab13e6d2cd4afbf1 P e794d9a31b244154ae9006c35750a18a: stopping tablet replica
I20260812 00:05:43.276932 11873 raft_consensus.cc:2229] T f81d6dce3d1e41bcab13e6d2cd4afbf1 P e794d9a31b244154ae9006c35750a18a [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:05:43.277026 11873 raft_consensus.cc:2258] T f81d6dce3d1e41bcab13e6d2cd4afbf1 P e794d9a31b244154ae9006c35750a18a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:05:43.289712 11873 ts_tablet_manager.cc:1905] T f81d6dce3d1e41bcab13e6d2cd4afbf1 P e794d9a31b244154ae9006c35750a18a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:05:43.290772 11864 ts_tablet_manager.cc:1905] T f81d6dce3d1e41bcab13e6d2cd4afbf1 P 796091840c5e43c392d7dd36cd9a9049: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:05:43.291371 11873 ts_tablet_manager.cc:1918] T f81d6dce3d1e41bcab13e6d2cd4afbf1 P e794d9a31b244154ae9006c35750a18a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:05:43.291442 11873 log.cc:1196] T f81d6dce3d1e41bcab13e6d2cd4afbf1 P e794d9a31b244154ae9006c35750a18a: Deleting WAL directory at /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492899949492-12089-0/minicluster-data/ts-2/wal/wals/f81d6dce3d1e41bcab13e6d2cd4afbf1
I20260812 00:05:43.291687 11873 ts_tablet_manager.cc:1939] T f81d6dce3d1e41bcab13e6d2cd4afbf1 P e794d9a31b244154ae9006c35750a18a: Deleting consensus metadata
I20260812 00:05:43.292469 10924 catalog_manager.cc:4841] TS e794d9a31b244154ae9006c35750a18a (127.11.206.67:45439): tablet f81d6dce3d1e41bcab13e6d2cd4afbf1 (table test-table [id=2b552e3716d5404db50ac70b1e599d9f]) successfully deleted
I20260812 00:05:43.293366 11864 ts_tablet_manager.cc:1918] T f81d6dce3d1e41bcab13e6d2cd4afbf1 P 796091840c5e43c392d7dd36cd9a9049: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:05:43.293453 11864 log.cc:1196] T f81d6dce3d1e41bcab13e6d2cd4afbf1 P 796091840c5e43c392d7dd36cd9a9049: Deleting WAL directory at /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786492899949492-12089-0/minicluster-data/ts-1/wal/wals/f81d6dce3d1e41bcab13e6d2cd4afbf1
I20260812 00:05:43.293892 11864 ts_tablet_manager.cc:1939] T f81d6dce3d1e41bcab13e6d2cd4afbf1 P 796091840c5e43c392d7dd36cd9a9049: Deleting consensus metadata
I20260812 00:05:43.294286 10920 catalog_manager.cc:4841] TS 796091840c5e43c392d7dd36cd9a9049 (127.11.206.66:42693): tablet f81d6dce3d1e41bcab13e6d2cd4afbf1 (table test-table [id=2b552e3716d5404db50ac70b1e599d9f]) successfully deleted
W20260812 00:05:43.296563 10920 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.206.65:37665 (error 108)
I20260812 00:05:43.297058 11809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:43.296927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.65:37665 (local address 127.0.0.1:50800)
0812 00:05:43.296979 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:43.297021 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.65:37665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260812 00:05:43.297118 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 11301
W20260812 00:05:43.307262 10920 catalog_manager.cc:4584] TS c2c9977e625b4714b20c0e66a4d4b347 (127.11.206.65:37665): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet f81d6dce3d1e41bcab13e6d2cd4afbf1: Network error: Client connection negotiation failed: client connection to 127.11.206.65:37665: connect: Connection refused (error 111)
I20260812 00:05:43.311200 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 11547
I20260812 00:05:43.320995 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 10893
2026-08-12T00:05:43Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (699 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:05:43 dist-test-slave-f0tn krb5kdc[11880](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:05:43 dist-test-slave-f0tn krb5kdc[11880](info): set up 2 sockets
Aug 12 00:05:43 dist-test-slave-f0tn krb5kdc[11880](info): commencing operation
krb5kdc: starting...
W20260812 00:05:44.523501 12089 mini_kdc.cc:121] Time spent starting KDC: real 1.172s user 0.001s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/krb5kdc/test-user.keytab.
Aug 12 00:05:44 dist-test-slave-f0tn krb5kdc[11880](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493144, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:05:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:05:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.206.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab.
Entry for principal kudu/127.11.206.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab.
I20260812 00:05:44.646513 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:39349
--webserver_interface=127.11.206.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab
--principal=kudu/127.11.206.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:38601
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.206.126:39349
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:05:44.730342 11905 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:44.730559 11905 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:44.730592 11905 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:44.731732 11905 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:05:44.731776 11905 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:44.731794 11905 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:44.731812 11905 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:05:44.731827 11905 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:05:44.733350 11905 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:38601
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.206.126:39349
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab
--principal=kudu/127.11.206.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:39349
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.206.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11905
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:05:44.733649 11905 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:44.733865 11905 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:44.738879 11913 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:44.739005 11905 server_base.cc:1034] running on GCE node
W20260812 00:05:44.739107 11916 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:44.738893 11911 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:44.739382 11905 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:44.739675 11905 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:44.740818 11905 hybrid_clock.cc:648] HybridClock initialized: now 1786493144740804 us; error 31 us; skew 500 ppm
Aug 12 00:05:44 dist-test-slave-f0tn krb5kdc[11880](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493144, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:44.743470 11905 init.cc:377] Logged in from keytab as kudu/127.11.206.126@KRBTEST.COM (short username kudu)
I20260812 00:05:44.743942 11905 webserver.cc:460] Webserver started at http://127.11.206.126:44745/ using document root <none> and password file <none>
I20260812 00:05:44.744181 11905 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:44.744227 11905 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:44.744349 11905 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:44.745414 11905 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/minicluster-data/master-0/data/instance:
uuid: "477537f5c857460e8dcaec3beee82d81"
format_stamp: "Formatted at 2026-08-12 00:05:44 on dist-test-slave-f0tn"
server_key: "839b25298f952ac9375dc4bfc22404b0"
server_key_iv: "8c7f32e2d3fbea2fec35cf7b03ee4614"
server_key_version: "encryptionkey@0"
I20260812 00:05:44.745767 11905 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/minicluster-data/master-0/wal/instance:
uuid: "477537f5c857460e8dcaec3beee82d81"
format_stamp: "Formatted at 2026-08-12 00:05:44 on dist-test-slave-f0tn"
server_key: "839b25298f952ac9375dc4bfc22404b0"
server_key_iv: "8c7f32e2d3fbea2fec35cf7b03ee4614"
server_key_version: "encryptionkey@0"
I20260812 00:05:44.747036 11905 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:05:44.747721 11927 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:44.747879 11905 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:05:44.747956 11905 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/minicluster-data/master-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/minicluster-data/master-0/wal
uuid: "477537f5c857460e8dcaec3beee82d81"
format_stamp: "Formatted at 2026-08-12 00:05:44 on dist-test-slave-f0tn"
server_key: "839b25298f952ac9375dc4bfc22404b0"
server_key_iv: "8c7f32e2d3fbea2fec35cf7b03ee4614"
server_key_version: "encryptionkey@0"
I20260812 00:05:44.748021 11905 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:44.766016 11905 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:44.768304 11905 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:44.768435 11905 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:44.772591 11905 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.126:39349
I20260812 00:05:44.772646 12012 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.126:39349 every 8 connection(s)
I20260812 00:05:44.772984 11905 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
I20260812 00:05:44.773886 12017 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:44.776230 12017 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 477537f5c857460e8dcaec3beee82d81: Bootstrap starting.
I20260812 00:05:44.776829 12017 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 477537f5c857460e8dcaec3beee82d81: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:44.777098 12017 log.cc:824] T 00000000000000000000000000000000 P 477537f5c857460e8dcaec3beee82d81: Log is configured to *not* fsync() on all Append() calls
I20260812 00:05:44.777850 12017 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 477537f5c857460e8dcaec3beee82d81: No bootstrap required, opened a new log
I20260812 00:05:44.779448 12017 raft_consensus.cc:348] T 00000000000000000000000000000000 P 477537f5c857460e8dcaec3beee82d81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "477537f5c857460e8dcaec3beee82d81" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 39349 } }
I20260812 00:05:44.779601 12017 raft_consensus.cc:374] T 00000000000000000000000000000000 P 477537f5c857460e8dcaec3beee82d81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:44.779625 12017 raft_consensus.cc:729] T 00000000000000000000000000000000 P 477537f5c857460e8dcaec3beee82d81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 477537f5c857460e8dcaec3beee82d81, State: Initialized, Role: FOLLOWER
I20260812 00:05:44.779762 12017 consensus_queue.cc:260] T 00000000000000000000000000000000 P 477537f5c857460e8dcaec3beee82d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "477537f5c857460e8dcaec3beee82d81" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 39349 } }
I20260812 00:05:44.779832 12017 raft_consensus.cc:388] T 00000000000000000000000000000000 P 477537f5c857460e8dcaec3beee82d81 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:05:44.779853 12017 raft_consensus.cc:482] T 00000000000000000000000000000000 P 477537f5c857460e8dcaec3beee82d81 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:05:44.779884 12017 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 477537f5c857460e8dcaec3beee82d81 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:44.780396 12017 raft_consensus.cc:504] T 00000000000000000000000000000000 P 477537f5c857460e8dcaec3beee82d81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "477537f5c857460e8dcaec3beee82d81" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 39349 } }
I20260812 00:05:44.780488 12017 leader_election.cc:302] T 00000000000000000000000000000000 P 477537f5c857460e8dcaec3beee82d81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 477537f5c857460e8dcaec3beee82d81; no voters:
I20260812 00:05:44.780663 12017 leader_election.cc:288] T 00000000000000000000000000000000 P 477537f5c857460e8dcaec3beee82d81 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:05:44.780742 12022 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 477537f5c857460e8dcaec3beee82d81 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:05:44.780892 12022 raft_consensus.cc:686] T 00000000000000000000000000000000 P 477537f5c857460e8dcaec3beee82d81 [term 1 LEADER]: Becoming Leader. State: Replica: 477537f5c857460e8dcaec3beee82d81, State: Running, Role: LEADER
I20260812 00:05:44.780943 12017 sys_catalog.cc:564] T 00000000000000000000000000000000 P 477537f5c857460e8dcaec3beee82d81 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:05:44.780987 12022 consensus_queue.cc:237] T 00000000000000000000000000000000 P 477537f5c857460e8dcaec3beee82d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "477537f5c857460e8dcaec3beee82d81" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 39349 } }
I20260812 00:05:44.781431 12025 sys_catalog.cc:455] T 00000000000000000000000000000000 P 477537f5c857460e8dcaec3beee82d81 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 477537f5c857460e8dcaec3beee82d81. Latest consensus state: current_term: 1 leader_uuid: "477537f5c857460e8dcaec3beee82d81" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "477537f5c857460e8dcaec3beee82d81" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 39349 } } }
I20260812 00:05:44.781522 12025 sys_catalog.cc:458] T 00000000000000000000000000000000 P 477537f5c857460e8dcaec3beee82d81 [sys.catalog]: This master's current role is: LEADER
I20260812 00:05:44.781684 12024 sys_catalog.cc:455] T 00000000000000000000000000000000 P 477537f5c857460e8dcaec3beee82d81 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "477537f5c857460e8dcaec3beee82d81" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "477537f5c857460e8dcaec3beee82d81" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 39349 } } }
I20260812 00:05:44.781924 12024 sys_catalog.cc:458] T 00000000000000000000000000000000 P 477537f5c857460e8dcaec3beee82d81 [sys.catalog]: This master's current role is: LEADER
I20260812 00:05:44.781765 12040 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:05:44.782200 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 11905
I20260812 00:05:44.782292 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/minicluster-data/master-0/wal/instance
I20260812 00:05:44.782487 12089 external_mini_cluster.cc:1428] Setting key a9b10f03a5bf00e31d77ee95e80e2e9a
I20260812 00:05:44.782541 12040 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:05:44.784241 12040 catalog_manager.cc:1347] Generated new cluster ID: bd7b713c6b344baeab58351b278a8cef
I20260812 00:05:44.784297 12040 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 00:05:44 dist-test-slave-f0tn krb5kdc[11880](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493144, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:05:44.789304 12040 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:05:44.789830 12040 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:05:44.793659 12060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:44.783157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35056 (local address 127.11.206.126:39349)
0812 00:05:44.783310 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:44.783320 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:44.783444 (+ 124us) server_negotiation.cc:407] Connection header received
0812 00:05:44.783568 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:44.783575 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:44.783634 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:44.783782 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:44.784568 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:44.785606 (+ 1038us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:44.786432 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:44.786866 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:44.786965 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:44.789259 (+ 2294us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:44.789263 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:44.789264 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:44.789276 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:44.791736 (+ 2460us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:44.792188 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:44.792192 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:44.792193 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:44.792304 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:44.792514 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:44.792515 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:44.792515 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:44.792791 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:44.792934 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:44.793238 (+ 304us) server_negotiation.cc:299] Negotiation successful
0812 00:05:44.793430 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101,"thread_start_us":74,"threads_started":1}
I20260812 00:05:44.795845 12040 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 477537f5c857460e8dcaec3beee82d81: Generated new TSK 0
I20260812 00:05:44.795997 12040 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.206.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.65.keytab.
Entry for principal kudu/127.11.206.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.65.keytab.
I20260812 00:05:44.823809 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.65:0
--local_ip_for_outbound_sockets=127.11.206.65
--webserver_interface=127.11.206.65
--webserver_port=0
--tserver_master_addrs=127.11.206.126:39349
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.65.keytab
--principal=kudu/127.11.206.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:38601
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:05:44.904958 12064 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:44.905153 12064 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:44.905175 12064 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:44.906325 12064 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:44.906368 12064 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:44.906394 12064 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.65
I20260812 00:05:44.907825 12064 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:38601
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.65.keytab
--principal=kudu/127.11.206.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.206.65
--webserver_port=0
--tserver_master_addrs=127.11.206.126:39349
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12064
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.65
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:05:44.908074 12064 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:44.908299 12064 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:44.913072 12075 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:44.913089 12081 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:44.913120 12077 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:44.913477 12064 server_base.cc:1034] running on GCE node
I20260812 00:05:44.913654 12064 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:44.913836 12064 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:44.914969 12064 hybrid_clock.cc:648] HybridClock initialized: now 1786493144914956 us; error 29 us; skew 500 ppm
Aug 12 00:05:44 dist-test-slave-f0tn krb5kdc[11880](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493144, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:44.921120 12064 init.cc:377] Logged in from keytab as kudu/127.11.206.65@KRBTEST.COM (short username kudu)
I20260812 00:05:44.921581 12064 webserver.cc:460] Webserver started at http://127.11.206.65:33509/ using document root <none> and password file <none>
I20260812 00:05:44.921826 12064 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:44.921870 12064 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:44.921968 12064 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:44.922987 12064 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/minicluster-data/ts-0/data/instance:
uuid: "3c874821ab42450ca617730635e80490"
format_stamp: "Formatted at 2026-08-12 00:05:44 on dist-test-slave-f0tn"
server_key: "19c8722d3fc57448829a3e3624061c2d"
server_key_iv: "59a8d7b34c9986271ae178c32361fb70"
server_key_version: "encryptionkey@0"
I20260812 00:05:44.923295 12064 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/minicluster-data/ts-0/wal/instance:
uuid: "3c874821ab42450ca617730635e80490"
format_stamp: "Formatted at 2026-08-12 00:05:44 on dist-test-slave-f0tn"
server_key: "19c8722d3fc57448829a3e3624061c2d"
server_key_iv: "59a8d7b34c9986271ae178c32361fb70"
server_key_version: "encryptionkey@0"
I20260812 00:05:44.924569 12064 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:05:44.925314 12102 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:44.925506 12064 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:05:44.925597 12064 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/minicluster-data/ts-0/wal
uuid: "3c874821ab42450ca617730635e80490"
format_stamp: "Formatted at 2026-08-12 00:05:44 on dist-test-slave-f0tn"
server_key: "19c8722d3fc57448829a3e3624061c2d"
server_key_iv: "59a8d7b34c9986271ae178c32361fb70"
server_key_version: "encryptionkey@0"
I20260812 00:05:44.925652 12064 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:44.936796 12064 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:44.938781 12064 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:44.938889 12064 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:44.939067 12064 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:05:44.939321 12064 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:05:44.939350 12064 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:44.939376 12064 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:05:44.939392 12064 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:44.944633 12064 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.65:35149
I20260812 00:05:44.944697 12327 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.65:35149 every 8 connection(s)
I20260812 00:05:44.944970 12064 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
I20260812 00:05:44.948951 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 12064
I20260812 00:05:44.949065 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/minicluster-data/ts-0/wal/instance
I20260812 00:05:44.949267 12089 external_mini_cluster.cc:1428] Setting key 33e2580715ef5e62a8b0141c0e2c3607
Aug 12 00:05:44 dist-test-slave-f0tn krb5kdc[11880](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493144, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.65@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:05:44.955022 12060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:44.945657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.65:46347 (local address 127.11.206.126:39349)
0812 00:05:44.945715 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:44.945718 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:44.945931 (+ 213us) server_negotiation.cc:407] Connection header received
0812 00:05:44.946450 (+ 519us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:44.946451 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:44.946464 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:44.946511 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:44.947587 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:44.948096 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:44.949139 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:44.949362 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:44.949438 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:44.951868 (+ 2430us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:44.951869 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:44.951870 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:44.951878 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:44.953451 (+ 1573us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:44.953911 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:44.953912 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:44.953913 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:44.953970 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:44.954252 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:44.954252 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:44.954253 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:44.954367 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:44.954424 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:44.954869 (+ 445us) server_negotiation.cc:299] Negotiation successful
0812 00:05:44.954954 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260812 00:05:44.955277 12332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:44.945632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:39349 (local address 127.11.206.65:46347)
0812 00:05:44.945819 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:44.945855 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:44.946350 (+ 495us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:44.946597 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:44.946602 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:44.947265 (+ 663us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:44.947458 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:44.947463 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:44.948184 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:44.948185 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:44.949014 (+ 829us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:44.949018 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:44.949478 (+ 460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:44.949479 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:44.949618 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:44.950102 (+ 484us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:44.950110 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:44.951778 (+ 1668us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:44.953527 (+ 1749us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:44.953535 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:44.953537 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:44.953833 (+ 296us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:44.954028 (+ 195us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:44.954029 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:44.954040 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:44.954187 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:44.954465 (+ 278us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:44.954473 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:44.954689 (+ 216us) client_negotiation.cc:769] Sending connection context
0812 00:05:44.954820 (+ 131us) client_negotiation.cc:240] Negotiation successful
0812 00:05:44.954992 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":104,"threads_started":1}
I20260812 00:05:44.955818 12328 heartbeater.cc:347] Connected to a master server at 127.11.206.126:39349
I20260812 00:05:44.955917 12328 heartbeater.cc:464] Registering TS with master...
I20260812 00:05:44.956135 12328 heartbeater.cc:511] Master 127.11.206.126:39349 requested a full tablet report, sending...
I20260812 00:05:44.956691 11953 ts_manager.cc:194] Registered new tserver with Master: 3c874821ab42450ca617730635e80490 (127.11.206.65:35149)
I20260812 00:05:44.957324 11953 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.206.65@KRBTEST.COM'} at 127.11.206.65:46347
WARNING: no policy specified for kudu/127.11.206.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.66.keytab.
Entry for principal kudu/127.11.206.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.66.keytab.
I20260812 00:05:44.973759 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.66:0
--local_ip_for_outbound_sockets=127.11.206.66
--webserver_interface=127.11.206.66
--webserver_port=0
--tserver_master_addrs=127.11.206.126:39349
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.66.keytab
--principal=kudu/127.11.206.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:38601
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:05:45.056792 12341 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:45.057015 12341 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:45.057050 12341 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:45.058279 12341 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:45.058326 12341 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:45.058363 12341 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.66
I20260812 00:05:45.059870 12341 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:38601
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.66.keytab
--principal=kudu/127.11.206.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.206.66
--webserver_port=0
--tserver_master_addrs=127.11.206.126:39349
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12341
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.66
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:05:45.060119 12341 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:45.060348 12341 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:45.065472 12348 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:45.065546 12341 server_base.cc:1034] running on GCE node
W20260812 00:05:45.065467 12356 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:45.065467 12351 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:45.065874 12341 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:45.066128 12341 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:45.067265 12341 hybrid_clock.cc:648] HybridClock initialized: now 1786493145067256 us; error 27 us; skew 500 ppm
Aug 12 00:05:45 dist-test-slave-f0tn krb5kdc[11880](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493145, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:45.069784 12341 init.cc:377] Logged in from keytab as kudu/127.11.206.66@KRBTEST.COM (short username kudu)
I20260812 00:05:45.070189 12341 webserver.cc:460] Webserver started at http://127.11.206.66:39793/ using document root <none> and password file <none>
I20260812 00:05:45.070428 12341 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:45.070478 12341 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:45.070600 12341 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:45.071641 12341 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/minicluster-data/ts-1/data/instance:
uuid: "3cbb6716c9374546aa05d6551e49edf4"
format_stamp: "Formatted at 2026-08-12 00:05:45 on dist-test-slave-f0tn"
server_key: "d8bd1cb3d69a62a7bec556f4c090263d"
server_key_iv: "5100431f574d2931d2753366d14e2bd3"
server_key_version: "encryptionkey@0"
I20260812 00:05:45.071983 12341 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/minicluster-data/ts-1/wal/instance:
uuid: "3cbb6716c9374546aa05d6551e49edf4"
format_stamp: "Formatted at 2026-08-12 00:05:45 on dist-test-slave-f0tn"
server_key: "d8bd1cb3d69a62a7bec556f4c090263d"
server_key_iv: "5100431f574d2931d2753366d14e2bd3"
server_key_version: "encryptionkey@0"
I20260812 00:05:45.073263 12341 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 00:05:45.073977 12369 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:45.074131 12341 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:45.074231 12341 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/minicluster-data/ts-1/wal
uuid: "3cbb6716c9374546aa05d6551e49edf4"
format_stamp: "Formatted at 2026-08-12 00:05:45 on dist-test-slave-f0tn"
server_key: "d8bd1cb3d69a62a7bec556f4c090263d"
server_key_iv: "5100431f574d2931d2753366d14e2bd3"
server_key_version: "encryptionkey@0"
I20260812 00:05:45.074290 12341 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:45.089094 12341 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:45.091312 12341 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:45.091451 12341 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:45.091656 12341 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:05:45.091948 12341 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:05:45.091981 12341 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:45.092010 12341 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:05:45.092033 12341 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:45.097622 12341 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.66:45765
I20260812 00:05:45.097702 12575 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.66:45765 every 8 connection(s)
I20260812 00:05:45.097993 12341 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
I20260812 00:05:45.098697 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 12341
I20260812 00:05:45.098810 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/minicluster-data/ts-1/wal/instance
I20260812 00:05:45.099057 12089 external_mini_cluster.cc:1428] Setting key f2973699fcb0488d94ef7cdeeaba0c17
Aug 12 00:05:45 dist-test-slave-f0tn krb5kdc[11880](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493145, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.66@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:05:45.108332 12060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:45.098720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.66:40901 (local address 127.11.206.126:39349)
0812 00:05:45.098793 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:45.098796 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:45.098997 (+ 201us) server_negotiation.cc:407] Connection header received
0812 00:05:45.099714 (+ 717us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:45.099715 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:45.099728 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:45.099795 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:45.101074 (+ 1279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:45.101634 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:45.103053 (+ 1419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:45.103355 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:45.103425 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:45.105565 (+ 2140us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:45.105567 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:45.105568 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:45.105576 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:45.107091 (+ 1515us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:45.107451 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:45.107452 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:45.107453 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:45.107516 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:45.107718 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:45.107719 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:45.107719 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:45.107858 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:45.107929 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:45.108153 (+ 224us) server_negotiation.cc:299] Negotiation successful
0812 00:05:45.108241 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
WARNING: no policy specified for kudu/127.11.206.67@KRBTEST.COM; defaulting to no policy
I20260812 00:05:45.108388 12580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:45.098676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:39349 (local address 127.11.206.66:40901)
0812 00:05:45.098852 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:45.098903 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:45.099597 (+ 694us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:45.099886 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:45.099890 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:45.100678 (+ 788us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:45.100964 (+ 286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:45.100971 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:45.101718 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:45.101719 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:45.102972 (+ 1253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:45.102975 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:45.103431 (+ 456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:45.103432 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:45.103551 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:45.104086 (+ 535us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:45.104095 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:45.105480 (+ 1385us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:45.107169 (+ 1689us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:45.107175 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:45.107177 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:45.107382 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:45.107577 (+ 195us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:45.107578 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:45.107578 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:45.107664 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:45.107921 (+ 257us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:45.107924 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:45.108031 (+ 107us) client_negotiation.cc:769] Sending connection context
0812 00:05:45.108112 (+ 81us) client_negotiation.cc:240] Negotiation successful
0812 00:05:45.108227 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":81,"threads_started":1}
I20260812 00:05:45.108857 12577 heartbeater.cc:347] Connected to a master server at 127.11.206.126:39349
I20260812 00:05:45.108950 12577 heartbeater.cc:464] Registering TS with master...
I20260812 00:05:45.109125 12577 heartbeater.cc:511] Master 127.11.206.126:39349 requested a full tablet report, sending...
I20260812 00:05:45.109567 11953 ts_manager.cc:194] Registered new tserver with Master: 3cbb6716c9374546aa05d6551e49edf4 (127.11.206.66:45765)
I20260812 00:05:45.109990 11953 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.206.66@KRBTEST.COM'} at 127.11.206.66:40901
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.67.keytab.
Entry for principal kudu/127.11.206.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.67.keytab.
I20260812 00:05:45.123641 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.67:0
--local_ip_for_outbound_sockets=127.11.206.67
--webserver_interface=127.11.206.67
--webserver_port=0
--tserver_master_addrs=127.11.206.126:39349
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.67.keytab
--principal=kudu/127.11.206.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:38601
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:05:45.205870 12587 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:45.206079 12587 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:45.206118 12587 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:45.207258 12587 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:45.207297 12587 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:45.207332 12587 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.67
I20260812 00:05:45.208750 12587 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:38601
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.67.keytab
--principal=kudu/127.11.206.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.206.67
--webserver_port=0
--tserver_master_addrs=127.11.206.126:39349
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12587
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.67
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:05:45.208982 12587 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:45.209194 12587 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:45.214143 12603 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:45.214094 12595 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:45.214138 12596 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:45.214473 12587 server_base.cc:1034] running on GCE node
I20260812 00:05:45.214672 12587 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:45.214890 12587 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:45.216024 12587 hybrid_clock.cc:648] HybridClock initialized: now 1786493145216005 us; error 32 us; skew 500 ppm
Aug 12 00:05:45 dist-test-slave-f0tn krb5kdc[11880](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493145, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:45.218748 12587 init.cc:377] Logged in from keytab as kudu/127.11.206.67@KRBTEST.COM (short username kudu)
I20260812 00:05:45.219189 12587 webserver.cc:460] Webserver started at http://127.11.206.67:45373/ using document root <none> and password file <none>
I20260812 00:05:45.219410 12587 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:45.219455 12587 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:45.219544 12587 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:45.220554 12587 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/minicluster-data/ts-2/data/instance:
uuid: "ef2312822e694faab453ac2eb7ca08f1"
format_stamp: "Formatted at 2026-08-12 00:05:45 on dist-test-slave-f0tn"
server_key: "065060542f3aae1266e3cfa2a50d638d"
server_key_iv: "bfcf0c9d4f269c9ac952651eda6b2b63"
server_key_version: "encryptionkey@0"
I20260812 00:05:45.220883 12587 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/minicluster-data/ts-2/wal/instance:
uuid: "ef2312822e694faab453ac2eb7ca08f1"
format_stamp: "Formatted at 2026-08-12 00:05:45 on dist-test-slave-f0tn"
server_key: "065060542f3aae1266e3cfa2a50d638d"
server_key_iv: "bfcf0c9d4f269c9ac952651eda6b2b63"
server_key_version: "encryptionkey@0"
I20260812 00:05:45.222195 12587 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:05:45.222872 12624 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:45.223019 12587 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:05:45.223107 12587 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/minicluster-data/ts-2/wal
uuid: "ef2312822e694faab453ac2eb7ca08f1"
format_stamp: "Formatted at 2026-08-12 00:05:45 on dist-test-slave-f0tn"
server_key: "065060542f3aae1266e3cfa2a50d638d"
server_key_iv: "bfcf0c9d4f269c9ac952651eda6b2b63"
server_key_version: "encryptionkey@0"
I20260812 00:05:45.223170 12587 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:45.237938 12587 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:45.239987 12587 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:45.240128 12587 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:45.240345 12587 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:05:45.240653 12587 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:05:45.240687 12587 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:45.240716 12587 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:05:45.240739 12587 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:45.246297 12587 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.67:37821
I20260812 00:05:45.246351 12828 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.67:37821 every 8 connection(s)
I20260812 00:05:45.246693 12587 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
I20260812 00:05:45.248420 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 12587
I20260812 00:05:45.248524 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/minicluster-data/ts-2/wal/instance
I20260812 00:05:45.248696 12089 external_mini_cluster.cc:1428] Setting key 2c7a4a7e051084384cc9e5888f2749a7
Aug 12 00:05:45 dist-test-slave-f0tn krb5kdc[11880](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493145, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.67@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:05:45.255451 12060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:45.247372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.67:56601 (local address 127.11.206.126:39349)
0812 00:05:45.247437 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:45.247439 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:45.247621 (+ 182us) server_negotiation.cc:407] Connection header received
0812 00:05:45.248139 (+ 518us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:45.248140 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:45.248152 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:45.248261 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:45.249312 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:45.249881 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:45.250940 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:45.251126 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:45.251178 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:45.253162 (+ 1984us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:45.253164 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:45.253164 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:45.253170 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:45.254439 (+ 1269us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:45.254771 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:45.254772 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:45.254772 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:45.254817 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:45.254986 (+ 169us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:45.254986 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:45.254987 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:45.255077 (+ 90us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:45.255120 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:45.255331 (+ 211us) server_negotiation.cc:299] Negotiation successful
0812 00:05:45.255387 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260812 00:05:45.255621 12837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:45.247332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:39349 (local address 127.11.206.67:56601)
0812 00:05:45.247503 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:45.247543 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:45.248038 (+ 495us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:45.248353 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:45.248358 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:45.248986 (+ 628us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:45.249241 (+ 255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:45.249247 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:45.249960 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:45.249961 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:45.250879 (+ 918us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:45.250882 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:45.251209 (+ 327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:45.251210 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:45.251313 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:45.251787 (+ 474us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:45.251795 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:45.253084 (+ 1289us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:45.254506 (+ 1422us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:45.254512 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:45.254514 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:45.254716 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:45.254860 (+ 144us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:45.254860 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:45.254860 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:45.254947 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:45.255118 (+ 171us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:45.255121 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:45.255235 (+ 114us) client_negotiation.cc:769] Sending connection context
0812 00:05:45.255312 (+ 77us) client_negotiation.cc:240] Negotiation successful
0812 00:05:45.255423 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":85,"threads_started":1}
I20260812 00:05:45.256068 12829 heartbeater.cc:347] Connected to a master server at 127.11.206.126:39349
I20260812 00:05:45.256157 12829 heartbeater.cc:464] Registering TS with master...
I20260812 00:05:45.256340 12829 heartbeater.cc:511] Master 127.11.206.126:39349 requested a full tablet report, sending...
I20260812 00:05:45.256713 11953 ts_manager.cc:194] Registered new tserver with Master: ef2312822e694faab453ac2eb7ca08f1 (127.11.206.67:37821)
I20260812 00:05:45.257057 11953 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.206.67@KRBTEST.COM'} at 127.11.206.67:56601
I20260812 00:05:45.260277 12089 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:05:45.266983 12060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:45.261541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35064 (local address 127.11.206.126:39349)
0812 00:05:45.261575 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:45.261577 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:45.261687 (+ 110us) server_negotiation.cc:407] Connection header received
0812 00:05:45.261728 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:45.261728 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:45.261735 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:45.261788 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:45.262301 (+ 513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:45.262750 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:45.263460 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:45.263648 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:45.263710 (+ 62us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:45.264802 (+ 1092us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:45.264803 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:45.264803 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:45.264808 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:45.266123 (+ 1315us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:45.266437 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:45.266437 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:45.266438 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:45.266484 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:45.266615 (+ 131us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:45.266615 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:45.266615 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:45.266723 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:45.266801 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:45.266878 (+ 77us) server_negotiation.cc:299] Negotiation successful
0812 00:05:45.266923 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14}
I20260812 00:05:45.268329 11953 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35064:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:05:45.269932 11953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:05:45.275869 12844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:45.271988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.66:45765 (local address 127.0.0.1:43720)
0812 00:05:45.272162 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:45.272173 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:45.272225 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:45.272608 (+ 383us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:45.272609 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:45.272610 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:05:45.272659 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:45.272661 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:45.273899 (+ 1238us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:45.273901 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:45.274742 (+ 841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:45.274756 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:45.275571 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:45.275572 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:45.275649 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:45.275667 (+ 18us) client_negotiation.cc:769] Sending connection context
0812 00:05:45.275730 (+ 63us) client_negotiation.cc:240] Negotiation successful
0812 00:05:45.275785 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":69,"threads_started":1}
I20260812 00:05:45.275975 12853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:45.271784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.65:35149 (local address 127.0.0.1:34656)
0812 00:05:45.272099 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:45.272109 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:45.272200 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:45.272438 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:45.272441 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:45.272444 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:05:45.272514 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:45.272515 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:45.273837 (+ 1322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:45.273838 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:45.274985 (+ 1147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:45.274988 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:45.275709 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:45.275710 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:45.275779 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:45.275785 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 00:05:45.275836 (+ 51us) client_negotiation.cc:240] Negotiation successful
0812 00:05:45.275880 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":293,"mutex_wait_us":5,"thread_start_us":84,"threads_started":1}
I20260812 00:05:45.276082 12849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:45.271783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.67:37821 (local address 127.0.0.1:36904)
0812 00:05:45.271918 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:45.271959 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:45.272024 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:45.272518 (+ 494us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:45.272519 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:45.272751 (+ 232us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:05:45.272783 (+ 32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:45.272785 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:45.273712 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:45.273714 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:45.274986 (+ 1272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:45.274988 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:45.275883 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:45.275884 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:45.275946 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:45.275950 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:05:45.275993 (+ 43us) client_negotiation.cc:240] Negotiation successful
0812 00:05:45.276027 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"mutex_wait_us":6,"thread_start_us":58,"threads_started":1}
I20260812 00:05:45.276109 12858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:45.272230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43720 (local address 127.11.206.66:45765)
0812 00:05:45.272400 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:45.272404 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:45.272413 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:05:45.272450 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:45.272452 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:45.272465 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:45.272532 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:05:45.272735 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:45.273823 (+ 1088us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:45.274839 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:45.275484 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:45.275556 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:45.275616 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:45.275988 (+ 372us) server_negotiation.cc:299] Negotiation successful
0812 00:05:45.276034 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":81,"threads_started":1}
I20260812 00:05:45.276103 12857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:45.271976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34656 (local address 127.11.206.65:35149)
0812 00:05:45.272259 (+ 283us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:45.272263 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:45.272273 (+ 10us) server_negotiation.cc:407] Connection header received
0812 00:05:45.272316 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:45.272318 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:45.272335 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:45.272409 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:05:45.272596 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:45.273731 (+ 1135us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:45.275087 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:45.275589 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:45.275699 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:45.275764 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:45.275847 (+ 83us) server_negotiation.cc:299] Negotiation successful
0812 00:05:45.275886 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":239,"thread_start_us":95,"threads_started":1}
I20260812 00:05:45.276356 12851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:45.271885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36904 (local address 127.11.206.67:37821)
0812 00:05:45.272369 (+ 484us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:45.272374 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:45.272384 (+ 10us) server_negotiation.cc:407] Connection header received
0812 00:05:45.272425 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:45.272428 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:45.272443 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:45.272520 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:05:45.272862 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:45.273603 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:45.275078 (+ 1475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:45.275741 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:45.275800 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:45.275852 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:45.276226 (+ 374us) server_negotiation.cc:299] Negotiation successful
0812 00:05:45.276285 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":449,"thread_start_us":81,"threads_started":1}
I20260812 00:05:45.276806 12453 tablet_service.cc:1467] Processing CreateTablet for tablet 8b23725a13e74c9f858c82611b7809bd (DEFAULT_TABLE table=test-table [id=4f95b195c8d54c44904deb8e96ea2b3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:05:45.277021 12720 tablet_service.cc:1467] Processing CreateTablet for tablet 8b23725a13e74c9f858c82611b7809bd (DEFAULT_TABLE table=test-table [id=4f95b195c8d54c44904deb8e96ea2b3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:05:45.277220 12453 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b23725a13e74c9f858c82611b7809bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:45.277362 12720 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b23725a13e74c9f858c82611b7809bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:45.277868 12210 tablet_service.cc:1467] Processing CreateTablet for tablet 8b23725a13e74c9f858c82611b7809bd (DEFAULT_TABLE table=test-table [id=4f95b195c8d54c44904deb8e96ea2b3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:05:45.278187 12210 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b23725a13e74c9f858c82611b7809bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:45.280220 12859 tablet_bootstrap.cc:492] T 8b23725a13e74c9f858c82611b7809bd P 3cbb6716c9374546aa05d6551e49edf4: Bootstrap starting.
I20260812 00:05:45.280679 12861 tablet_bootstrap.cc:492] T 8b23725a13e74c9f858c82611b7809bd P ef2312822e694faab453ac2eb7ca08f1: Bootstrap starting.
I20260812 00:05:45.280875 12859 tablet_bootstrap.cc:654] T 8b23725a13e74c9f858c82611b7809bd P 3cbb6716c9374546aa05d6551e49edf4: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:45.281299 12862 tablet_bootstrap.cc:492] T 8b23725a13e74c9f858c82611b7809bd P 3c874821ab42450ca617730635e80490: Bootstrap starting.
I20260812 00:05:45.281450 12861 tablet_bootstrap.cc:654] T 8b23725a13e74c9f858c82611b7809bd P ef2312822e694faab453ac2eb7ca08f1: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:45.281788 12859 log.cc:824] T 8b23725a13e74c9f858c82611b7809bd P 3cbb6716c9374546aa05d6551e49edf4: Log is configured to *not* fsync() on all Append() calls
I20260812 00:05:45.281940 12862 tablet_bootstrap.cc:654] T 8b23725a13e74c9f858c82611b7809bd P 3c874821ab42450ca617730635e80490: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:45.281992 12861 log.cc:824] T 8b23725a13e74c9f858c82611b7809bd P ef2312822e694faab453ac2eb7ca08f1: Log is configured to *not* fsync() on all Append() calls
I20260812 00:05:45.282554 12862 log.cc:824] T 8b23725a13e74c9f858c82611b7809bd P 3c874821ab42450ca617730635e80490: Log is configured to *not* fsync() on all Append() calls
I20260812 00:05:45.282660 12859 tablet_bootstrap.cc:492] T 8b23725a13e74c9f858c82611b7809bd P 3cbb6716c9374546aa05d6551e49edf4: No bootstrap required, opened a new log
I20260812 00:05:45.282732 12859 ts_tablet_manager.cc:1397] T 8b23725a13e74c9f858c82611b7809bd P 3cbb6716c9374546aa05d6551e49edf4: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 00:05:45.282785 12861 tablet_bootstrap.cc:492] T 8b23725a13e74c9f858c82611b7809bd P ef2312822e694faab453ac2eb7ca08f1: No bootstrap required, opened a new log
I20260812 00:05:45.282845 12861 ts_tablet_manager.cc:1397] T 8b23725a13e74c9f858c82611b7809bd P ef2312822e694faab453ac2eb7ca08f1: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 00:05:45.283236 12862 tablet_bootstrap.cc:492] T 8b23725a13e74c9f858c82611b7809bd P 3c874821ab42450ca617730635e80490: No bootstrap required, opened a new log
I20260812 00:05:45.283362 12862 ts_tablet_manager.cc:1397] T 8b23725a13e74c9f858c82611b7809bd P 3c874821ab42450ca617730635e80490: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 00:05:45.284688 12862 raft_consensus.cc:348] T 8b23725a13e74c9f858c82611b7809bd P 3c874821ab42450ca617730635e80490 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef2312822e694faab453ac2eb7ca08f1" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 37821 } } peers { permanent_uuid: "3c874821ab42450ca617730635e80490" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 35149 } } peers { permanent_uuid: "3cbb6716c9374546aa05d6551e49edf4" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 45765 } }
I20260812 00:05:45.284628 12861 raft_consensus.cc:348] T 8b23725a13e74c9f858c82611b7809bd P ef2312822e694faab453ac2eb7ca08f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef2312822e694faab453ac2eb7ca08f1" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 37821 } } peers { permanent_uuid: "3c874821ab42450ca617730635e80490" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 35149 } } peers { permanent_uuid: "3cbb6716c9374546aa05d6551e49edf4" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 45765 } }
I20260812 00:05:45.284628 12859 raft_consensus.cc:348] T 8b23725a13e74c9f858c82611b7809bd P 3cbb6716c9374546aa05d6551e49edf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef2312822e694faab453ac2eb7ca08f1" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 37821 } } peers { permanent_uuid: "3c874821ab42450ca617730635e80490" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 35149 } } peers { permanent_uuid: "3cbb6716c9374546aa05d6551e49edf4" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 45765 } }
I20260812 00:05:45.284824 12862 raft_consensus.cc:374] T 8b23725a13e74c9f858c82611b7809bd P 3c874821ab42450ca617730635e80490 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:45.284825 12859 raft_consensus.cc:374] T 8b23725a13e74c9f858c82611b7809bd P 3cbb6716c9374546aa05d6551e49edf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:45.284825 12861 raft_consensus.cc:374] T 8b23725a13e74c9f858c82611b7809bd P ef2312822e694faab453ac2eb7ca08f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:45.284859 12862 raft_consensus.cc:729] T 8b23725a13e74c9f858c82611b7809bd P 3c874821ab42450ca617730635e80490 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c874821ab42450ca617730635e80490, State: Initialized, Role: FOLLOWER
I20260812 00:05:45.284861 12861 raft_consensus.cc:729] T 8b23725a13e74c9f858c82611b7809bd P ef2312822e694faab453ac2eb7ca08f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef2312822e694faab453ac2eb7ca08f1, State: Initialized, Role: FOLLOWER
I20260812 00:05:45.284861 12859 raft_consensus.cc:729] T 8b23725a13e74c9f858c82611b7809bd P 3cbb6716c9374546aa05d6551e49edf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cbb6716c9374546aa05d6551e49edf4, State: Initialized, Role: FOLLOWER
I20260812 00:05:45.284981 12859 consensus_queue.cc:260] T 8b23725a13e74c9f858c82611b7809bd P 3cbb6716c9374546aa05d6551e49edf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef2312822e694faab453ac2eb7ca08f1" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 37821 } } peers { permanent_uuid: "3c874821ab42450ca617730635e80490" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 35149 } } peers { permanent_uuid: "3cbb6716c9374546aa05d6551e49edf4" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 45765 } }
I20260812 00:05:45.284981 12861 consensus_queue.cc:260] T 8b23725a13e74c9f858c82611b7809bd P ef2312822e694faab453ac2eb7ca08f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef2312822e694faab453ac2eb7ca08f1" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 37821 } } peers { permanent_uuid: "3c874821ab42450ca617730635e80490" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 35149 } } peers { permanent_uuid: "3cbb6716c9374546aa05d6551e49edf4" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 45765 } }
I20260812 00:05:45.285043 12862 consensus_queue.cc:260] T 8b23725a13e74c9f858c82611b7809bd P 3c874821ab42450ca617730635e80490 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef2312822e694faab453ac2eb7ca08f1" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 37821 } } peers { permanent_uuid: "3c874821ab42450ca617730635e80490" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 35149 } } peers { permanent_uuid: "3cbb6716c9374546aa05d6551e49edf4" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 45765 } }
I20260812 00:05:45.285241 12859 ts_tablet_manager.cc:1428] T 8b23725a13e74c9f858c82611b7809bd P 3cbb6716c9374546aa05d6551e49edf4: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260812 00:05:45.285241 12861 ts_tablet_manager.cc:1428] T 8b23725a13e74c9f858c82611b7809bd P ef2312822e694faab453ac2eb7ca08f1: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260812 00:05:45.285408 12829 heartbeater.cc:503] Master 127.11.206.126:39349 was elected leader, sending a full tablet report...
I20260812 00:05:45.285429 12328 heartbeater.cc:503] Master 127.11.206.126:39349 was elected leader, sending a full tablet report...
I20260812 00:05:45.285621 12862 ts_tablet_manager.cc:1428] T 8b23725a13e74c9f858c82611b7809bd P 3c874821ab42450ca617730635e80490: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 00:05:45.285686 12577 heartbeater.cc:503] Master 127.11.206.126:39349 was elected leader, sending a full tablet report...
I20260812 00:05:45.290273 12870 raft_consensus.cc:482] T 8b23725a13e74c9f858c82611b7809bd P 3c874821ab42450ca617730635e80490 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:05:45.290347 12870 raft_consensus.cc:504] T 8b23725a13e74c9f858c82611b7809bd P 3c874821ab42450ca617730635e80490 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef2312822e694faab453ac2eb7ca08f1" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 37821 } } peers { permanent_uuid: "3c874821ab42450ca617730635e80490" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 35149 } } peers { permanent_uuid: "3cbb6716c9374546aa05d6551e49edf4" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 45765 } }
I20260812 00:05:45.290594 12870 leader_election.cc:288] T 8b23725a13e74c9f858c82611b7809bd P 3c874821ab42450ca617730635e80490 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef2312822e694faab453ac2eb7ca08f1 (127.11.206.67:37821), 3cbb6716c9374546aa05d6551e49edf4 (127.11.206.66:45765)
I20260812 00:05:45.293215 12332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:45.290735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.67:37821 (local address 127.11.206.65:33953)
0812 00:05:45.290776 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:45.290787 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:45.290837 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:45.290963 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:45.290964 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:45.290965 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:05:45.291027 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:45.291029 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:45.291649 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:45.291650 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:45.292347 (+ 697us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:45.292349 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:45.292990 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:45.292991 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:45.293060 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:45.293064 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:05:45.293109 (+ 45us) client_negotiation.cc:240] Negotiation successful
0812 00:05:45.293149 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":21}
I20260812 00:05:45.293231 12851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:45.290835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.65:33953 (local address 127.11.206.67:37821)
0812 00:05:45.290874 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:45.290875 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:45.290881 (+ 6us) server_negotiation.cc:407] Connection header received
0812 00:05:45.290902 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:45.290903 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:45.290911 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:45.290956 (+ 45us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:05:45.291085 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:45.291566 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:45.292433 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:45.292923 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:45.292985 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:45.292992 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:45.293146 (+ 154us) server_negotiation.cc:299] Negotiation successful
0812 00:05:45.293179 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 00:05:45.293458 12858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:45.290801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.65:33523 (local address 127.11.206.66:45765)
0812 00:05:45.290841 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:45.290842 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:45.291016 (+ 174us) server_negotiation.cc:407] Connection header received
0812 00:05:45.291112 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:45.291113 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:45.291122 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:45.291198 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:05:45.291322 (+ 124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:45.291779 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:45.292631 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:45.293102 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:45.293168 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:45.293175 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:45.293334 (+ 159us) server_negotiation.cc:299] Negotiation successful
0812 00:05:45.293372 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 00:05:45.293571 12753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b23725a13e74c9f858c82611b7809bd" candidate_uuid: "3c874821ab42450ca617730635e80490" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2312822e694faab453ac2eb7ca08f1" is_pre_election: true
I20260812 00:05:45.293639 12871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:45.290735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.66:45765 (local address 127.11.206.65:33523)
0812 00:05:45.290955 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:45.290964 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:45.291041 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:45.291204 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:45.291204 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:45.291206 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:05:45.291267 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:45.291269 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:45.291848 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:45.291848 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:45.292559 (+ 711us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:45.292561 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:45.293178 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:45.293179 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:45.293252 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:45.293255 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:05:45.293536 (+ 281us) client_negotiation.cc:240] Negotiation successful
0812 00:05:45.293579 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":203,"mutex_wait_us":91,"thread_start_us":83,"threads_started":1}
I20260812 00:05:45.293696 12753 raft_consensus.cc:2454] T 8b23725a13e74c9f858c82611b7809bd P ef2312822e694faab453ac2eb7ca08f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c874821ab42450ca617730635e80490 in term 0.
I20260812 00:05:45.293884 12493 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b23725a13e74c9f858c82611b7809bd" candidate_uuid: "3c874821ab42450ca617730635e80490" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cbb6716c9374546aa05d6551e49edf4" is_pre_election: true
I20260812 00:05:45.293915 12108 leader_election.cc:302] T 8b23725a13e74c9f858c82611b7809bd P 3c874821ab42450ca617730635e80490 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c874821ab42450ca617730635e80490, ef2312822e694faab453ac2eb7ca08f1; no voters:
I20260812 00:05:45.294003 12493 raft_consensus.cc:2454] T 8b23725a13e74c9f858c82611b7809bd P 3cbb6716c9374546aa05d6551e49edf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c874821ab42450ca617730635e80490 in term 0.
I20260812 00:05:45.294014 12870 raft_consensus.cc:2781] T 8b23725a13e74c9f858c82611b7809bd P 3c874821ab42450ca617730635e80490 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:05:45.294059 12870 raft_consensus.cc:482] T 8b23725a13e74c9f858c82611b7809bd P 3c874821ab42450ca617730635e80490 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:05:45.294087 12870 raft_consensus.cc:3037] T 8b23725a13e74c9f858c82611b7809bd P 3c874821ab42450ca617730635e80490 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:45.294734 12870 raft_consensus.cc:504] T 8b23725a13e74c9f858c82611b7809bd P 3c874821ab42450ca617730635e80490 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef2312822e694faab453ac2eb7ca08f1" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 37821 } } peers { permanent_uuid: "3c874821ab42450ca617730635e80490" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 35149 } } peers { permanent_uuid: "3cbb6716c9374546aa05d6551e49edf4" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 45765 } }
I20260812 00:05:45.294847 12870 leader_election.cc:288] T 8b23725a13e74c9f858c82611b7809bd P 3c874821ab42450ca617730635e80490 [CANDIDATE]: Term 1 election: Requested vote from peers ef2312822e694faab453ac2eb7ca08f1 (127.11.206.67:37821), 3cbb6716c9374546aa05d6551e49edf4 (127.11.206.66:45765)
I20260812 00:05:45.294987 12753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b23725a13e74c9f858c82611b7809bd" candidate_uuid: "3c874821ab42450ca617730635e80490" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2312822e694faab453ac2eb7ca08f1"
I20260812 00:05:45.295032 12493 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b23725a13e74c9f858c82611b7809bd" candidate_uuid: "3c874821ab42450ca617730635e80490" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cbb6716c9374546aa05d6551e49edf4"
I20260812 00:05:45.295047 12753 raft_consensus.cc:3037] T 8b23725a13e74c9f858c82611b7809bd P ef2312822e694faab453ac2eb7ca08f1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:45.295104 12493 raft_consensus.cc:3037] T 8b23725a13e74c9f858c82611b7809bd P 3cbb6716c9374546aa05d6551e49edf4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:45.295712 12753 raft_consensus.cc:2454] T 8b23725a13e74c9f858c82611b7809bd P ef2312822e694faab453ac2eb7ca08f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c874821ab42450ca617730635e80490 in term 1.
I20260812 00:05:45.295746 12493 raft_consensus.cc:2454] T 8b23725a13e74c9f858c82611b7809bd P 3cbb6716c9374546aa05d6551e49edf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c874821ab42450ca617730635e80490 in term 1.
I20260812 00:05:45.295866 12108 leader_election.cc:302] T 8b23725a13e74c9f858c82611b7809bd P 3c874821ab42450ca617730635e80490 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c874821ab42450ca617730635e80490, ef2312822e694faab453ac2eb7ca08f1; no voters:
I20260812 00:05:45.295969 12870 raft_consensus.cc:2781] T 8b23725a13e74c9f858c82611b7809bd P 3c874821ab42450ca617730635e80490 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:05:45.296090 12870 raft_consensus.cc:686] T 8b23725a13e74c9f858c82611b7809bd P 3c874821ab42450ca617730635e80490 [term 1 LEADER]: Becoming Leader. State: Replica: 3c874821ab42450ca617730635e80490, State: Running, Role: LEADER
I20260812 00:05:45.296175 12870 consensus_queue.cc:237] T 8b23725a13e74c9f858c82611b7809bd P 3c874821ab42450ca617730635e80490 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef2312822e694faab453ac2eb7ca08f1" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 37821 } } peers { permanent_uuid: "3c874821ab42450ca617730635e80490" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 35149 } } peers { permanent_uuid: "3cbb6716c9374546aa05d6551e49edf4" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 45765 } }
I20260812 00:05:45.296917 11951 catalog_manager.cc:5495] T 8b23725a13e74c9f858c82611b7809bd P 3c874821ab42450ca617730635e80490 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3c874821ab42450ca617730635e80490 (127.11.206.65). New cstate: current_term: 1 leader_uuid: "3c874821ab42450ca617730635e80490" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef2312822e694faab453ac2eb7ca08f1" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 37821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c874821ab42450ca617730635e80490" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 35149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cbb6716c9374546aa05d6551e49edf4" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 45765 } health_report { overall_health: UNKNOWN } } }
I20260812 00:05:45.303323 12857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:45.301436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34660 (local address 127.11.206.65:35149)
0812 00:05:45.301471 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:45.301473 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:45.301482 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:05:45.301529 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:45.301529 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:45.301542 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:45.301594 (+ 52us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:05:45.301699 (+ 105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:45.302132 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:45.302798 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:45.302968 (+ 170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:45.303007 (+ 39us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:45.303111 (+ 104us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:05:45.303186 (+ 75us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:05:45.303248 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:45.303270 (+ 22us) server_negotiation.cc:299] Negotiation successful
0812 00:05:45.303278 (+ 8us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260812 00:05:45.304759 12493 raft_consensus.cc:1261] T 8b23725a13e74c9f858c82611b7809bd P 3cbb6716c9374546aa05d6551e49edf4 [term 1 FOLLOWER]: Refusing update from remote peer 3c874821ab42450ca617730635e80490: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:05:45.304767 12753 raft_consensus.cc:1261] T 8b23725a13e74c9f858c82611b7809bd P ef2312822e694faab453ac2eb7ca08f1 [term 1 FOLLOWER]: Refusing update from remote peer 3c874821ab42450ca617730635e80490: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:05:45.305070 12873 consensus_queue.cc:1035] T 8b23725a13e74c9f858c82611b7809bd P 3c874821ab42450ca617730635e80490 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2312822e694faab453ac2eb7ca08f1" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 37821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:05:45.305194 12870 consensus_queue.cc:1035] T 8b23725a13e74c9f858c82611b7809bd P 3c874821ab42450ca617730635e80490 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cbb6716c9374546aa05d6551e49edf4" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 45765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:05:45.307236 12881 mvcc.cc:205] Tried to move back new op lower bound from 7317475923166199808 to 7317475923133673472. Current Snapshot: MvccSnapshot[applied={T|T < 7317475923166199808}]
I20260812 00:05:45.307551 12884 mvcc.cc:205] Tried to move back new op lower bound from 7317475923166199808 to 7317475923133673472. Current Snapshot: MvccSnapshot[applied={T|T < 7317475923166199808}]
I20260812 00:05:45.308363 12885 mvcc.cc:205] Tried to move back new op lower bound from 7317475923166199808 to 7317475923133673472. Current Snapshot: MvccSnapshot[applied={T|T < 7317475923166199808 or (T in {7317475923166199808})}]
I20260812 00:05:45.309697 11946 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35064:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:05:45.309790 11946 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35064:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:05:45.310436 11946 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 477537f5c857460e8dcaec3beee82d81: Sending DeleteTablet for 3 replicas of tablet 8b23725a13e74c9f858c82611b7809bd
I20260812 00:05:45.310748 12210 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b23725a13e74c9f858c82611b7809bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:05:45 UTC) from {username='kudu', principal='kudu/127.11.206.126@KRBTEST.COM'} at 127.0.0.1:34656
I20260812 00:05:45.310803 12453 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b23725a13e74c9f858c82611b7809bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:05:45 UTC) from {username='kudu', principal='kudu/127.11.206.126@KRBTEST.COM'} at 127.0.0.1:43720
I20260812 00:05:45.310964 12899 tablet_replica.cc:330] T 8b23725a13e74c9f858c82611b7809bd P 3c874821ab42450ca617730635e80490: stopping tablet replica
I20260812 00:05:45.311003 12720 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b23725a13e74c9f858c82611b7809bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:05:45 UTC) from {username='kudu', principal='kudu/127.11.206.126@KRBTEST.COM'} at 127.0.0.1:36904
I20260812 00:05:45.311053 12899 raft_consensus.cc:2229] T 8b23725a13e74c9f858c82611b7809bd P 3c874821ab42450ca617730635e80490 [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:05:45.311051 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 12064
I20260812 00:05:45.311137 12899 raft_consensus.cc:2258] T 8b23725a13e74c9f858c82611b7809bd P 3c874821ab42450ca617730635e80490 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:05:45.317368 12901 tablet_replica.cc:330] T 8b23725a13e74c9f858c82611b7809bd P ef2312822e694faab453ac2eb7ca08f1: stopping tablet replica
I20260812 00:05:45.317497 12901 raft_consensus.cc:2229] T 8b23725a13e74c9f858c82611b7809bd P ef2312822e694faab453ac2eb7ca08f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:05:45.317600 12901 raft_consensus.cc:2258] T 8b23725a13e74c9f858c82611b7809bd P ef2312822e694faab453ac2eb7ca08f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:05:45.317860 12900 tablet_replica.cc:330] T 8b23725a13e74c9f858c82611b7809bd P 3cbb6716c9374546aa05d6551e49edf4: stopping tablet replica
I20260812 00:05:45.317960 12900 raft_consensus.cc:2229] T 8b23725a13e74c9f858c82611b7809bd P 3cbb6716c9374546aa05d6551e49edf4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:05:45.318008 12901 ts_tablet_manager.cc:1905] T 8b23725a13e74c9f858c82611b7809bd P ef2312822e694faab453ac2eb7ca08f1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:05:45.318059 12900 raft_consensus.cc:2258] T 8b23725a13e74c9f858c82611b7809bd P 3cbb6716c9374546aa05d6551e49edf4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:05:45.318424 12900 ts_tablet_manager.cc:1905] T 8b23725a13e74c9f858c82611b7809bd P 3cbb6716c9374546aa05d6551e49edf4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:05:45.319523 12901 ts_tablet_manager.cc:1918] T 8b23725a13e74c9f858c82611b7809bd P ef2312822e694faab453ac2eb7ca08f1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:05:45.319607 12901 log.cc:1196] T 8b23725a13e74c9f858c82611b7809bd P ef2312822e694faab453ac2eb7ca08f1: Deleting WAL directory at /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/minicluster-data/ts-2/wal/wals/8b23725a13e74c9f858c82611b7809bd
I20260812 00:05:45.319644 12900 ts_tablet_manager.cc:1918] T 8b23725a13e74c9f858c82611b7809bd P 3cbb6716c9374546aa05d6551e49edf4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:05:45.319710 12900 log.cc:1196] T 8b23725a13e74c9f858c82611b7809bd P 3cbb6716c9374546aa05d6551e49edf4: Deleting WAL directory at /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786492899949492-12089-0/minicluster-data/ts-1/wal/wals/8b23725a13e74c9f858c82611b7809bd
I20260812 00:05:45.319888 12901 ts_tablet_manager.cc:1939] T 8b23725a13e74c9f858c82611b7809bd P ef2312822e694faab453ac2eb7ca08f1: Deleting consensus metadata
I20260812 00:05:45.319976 12900 ts_tablet_manager.cc:1939] T 8b23725a13e74c9f858c82611b7809bd P 3cbb6716c9374546aa05d6551e49edf4: Deleting consensus metadata
I20260812 00:05:45.320312 11931 catalog_manager.cc:4841] TS ef2312822e694faab453ac2eb7ca08f1 (127.11.206.67:37821): tablet 8b23725a13e74c9f858c82611b7809bd (table test-table [id=4f95b195c8d54c44904deb8e96ea2b3b]) successfully deleted
I20260812 00:05:45.320336 11930 catalog_manager.cc:4841] TS 3cbb6716c9374546aa05d6551e49edf4 (127.11.206.66:45765): tablet 8b23725a13e74c9f858c82611b7809bd (table test-table [id=4f95b195c8d54c44904deb8e96ea2b3b]) successfully deleted
W20260812 00:05:45.321754 11930 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.206.65:35149 (error 108)
I20260812 00:05:45.322052 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 12341
I20260812 00:05:45.322192 12849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:45.322069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.65:35149 (local address 127.0.0.1:34672)
0812 00:05:45.322120 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:45.322160 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.65:35149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260812 00:05:45.333344 11930 catalog_manager.cc:4584] TS 3c874821ab42450ca617730635e80490 (127.11.206.65:35149): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8b23725a13e74c9f858c82611b7809bd: Network error: Client connection negotiation failed: client connection to 127.11.206.65:35149: connect: Connection refused (error 111)
I20260812 00:05:45.333504 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 12587
I20260812 00:05:45.344724 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 11905
2026-08-12T00:05:45Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2019 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-12T00:05:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:05:45Z Disabled control of system clock
I20260812 00:05:45.378870 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492899949492-12089-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492899949492-12089-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492899949492-12089-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:38935
--webserver_interface=127.11.206.126
--webserver_port=0
--builtin_ntp_servers=127.11.206.84:33423
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.206.126:38935
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 00:05:45.458343 12907 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:45.458557 12907 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:45.458576 12907 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:45.459649 12907 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:05:45.459681 12907 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:45.459692 12907 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:45.459704 12907 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:05:45.459723 12907 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:05:45.461002 12907 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:33423
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492899949492-12089-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492899949492-12089-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.206.126:38935
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:38935
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.206.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12907
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492899949492-12089-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:05:45.461192 12907 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:45.461450 12907 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:45.466012 12919 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:45.466079 12923 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:45.466019 12917 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:45.466338 12907 server_base.cc:1034] running on GCE node
I20260812 00:05:45.466559 12907 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:45.466820 12907 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:45.467970 12907 hybrid_clock.cc:648] HybridClock initialized: now 1786493145467954 us; error 26 us; skew 500 ppm
I20260812 00:05:45.469161 12907 webserver.cc:460] Webserver started at http://127.11.206.126:42349/ using document root <none> and password file <none>
I20260812 00:05:45.469372 12907 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:45.469455 12907 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:45.469585 12907 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:45.470613 12907 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492899949492-12089-0/minicluster-data/master-0/data/instance:
uuid: "05ce2580909f49b09f2af178ab6b869d"
format_stamp: "Formatted at 2026-08-12 00:05:45 on dist-test-slave-f0tn"
server_key: "ab25168e23e8d7c265618f5a98769d04"
server_key_iv: "15864f847e96cca06708bf1ac6645539"
server_key_version: "encryptionkey@0"
I20260812 00:05:45.470976 12907 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492899949492-12089-0/minicluster-data/master-0/wal/instance:
uuid: "05ce2580909f49b09f2af178ab6b869d"
format_stamp: "Formatted at 2026-08-12 00:05:45 on dist-test-slave-f0tn"
server_key: "ab25168e23e8d7c265618f5a98769d04"
server_key_iv: "15864f847e96cca06708bf1ac6645539"
server_key_version: "encryptionkey@0"
I20260812 00:05:45.472239 12907 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:05:45.472962 12934 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:45.473135 12907 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:05:45.473220 12907 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492899949492-12089-0/minicluster-data/master-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492899949492-12089-0/minicluster-data/master-0/wal
uuid: "05ce2580909f49b09f2af178ab6b869d"
format_stamp: "Formatted at 2026-08-12 00:05:45 on dist-test-slave-f0tn"
server_key: "ab25168e23e8d7c265618f5a98769d04"
server_key_iv: "15864f847e96cca06708bf1ac6645539"
server_key_version: "encryptionkey@0"
I20260812 00:05:45.473289 12907 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492899949492-12089-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492899949492-12089-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492899949492-12089-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:45.501713 12907 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:45.502055 12907 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:45.502197 12907 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:45.505991 12907 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.126:38935
I20260812 00:05:45.506031 13027 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.126:38935 every 8 connection(s)
I20260812 00:05:45.506361 12907 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
I20260812 00:05:45.507340 13028 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:45.509690 13028 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 05ce2580909f49b09f2af178ab6b869d: Bootstrap starting.
I20260812 00:05:45.510329 13028 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 05ce2580909f49b09f2af178ab6b869d: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:45.510599 13028 log.cc:824] T 00000000000000000000000000000000 P 05ce2580909f49b09f2af178ab6b869d: Log is configured to *not* fsync() on all Append() calls
I20260812 00:05:45.511286 13028 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 05ce2580909f49b09f2af178ab6b869d: No bootstrap required, opened a new log
I20260812 00:05:45.512910 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 12907
I20260812 00:05:45.513005 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492899949492-12089-0/minicluster-data/master-0/wal/instance
I20260812 00:05:45.512893 13028 raft_consensus.cc:348] T 00000000000000000000000000000000 P 05ce2580909f49b09f2af178ab6b869d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05ce2580909f49b09f2af178ab6b869d" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 38935 } }
I20260812 00:05:45.513034 13028 raft_consensus.cc:374] T 00000000000000000000000000000000 P 05ce2580909f49b09f2af178ab6b869d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:45.513078 13028 raft_consensus.cc:729] T 00000000000000000000000000000000 P 05ce2580909f49b09f2af178ab6b869d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05ce2580909f49b09f2af178ab6b869d, State: Initialized, Role: FOLLOWER
I20260812 00:05:45.513226 12089 external_mini_cluster.cc:1428] Setting key 810f3ca409c2fde84f4ba570b25cb72e
I20260812 00:05:45.513224 13028 consensus_queue.cc:260] T 00000000000000000000000000000000 P 05ce2580909f49b09f2af178ab6b869d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05ce2580909f49b09f2af178ab6b869d" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 38935 } }
I20260812 00:05:45.513295 13028 raft_consensus.cc:388] T 00000000000000000000000000000000 P 05ce2580909f49b09f2af178ab6b869d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:05:45.513327 13028 raft_consensus.cc:482] T 00000000000000000000000000000000 P 05ce2580909f49b09f2af178ab6b869d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:05:45.513409 13028 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 05ce2580909f49b09f2af178ab6b869d [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:45.514050 13028 raft_consensus.cc:504] T 00000000000000000000000000000000 P 05ce2580909f49b09f2af178ab6b869d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05ce2580909f49b09f2af178ab6b869d" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 38935 } }
I20260812 00:05:45.514153 13028 leader_election.cc:302] T 00000000000000000000000000000000 P 05ce2580909f49b09f2af178ab6b869d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 05ce2580909f49b09f2af178ab6b869d; no voters:
I20260812 00:05:45.514312 13028 leader_election.cc:288] T 00000000000000000000000000000000 P 05ce2580909f49b09f2af178ab6b869d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:05:45.514384 13034 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 05ce2580909f49b09f2af178ab6b869d [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:05:45.514503 13034 raft_consensus.cc:686] T 00000000000000000000000000000000 P 05ce2580909f49b09f2af178ab6b869d [term 1 LEADER]: Becoming Leader. State: Replica: 05ce2580909f49b09f2af178ab6b869d, State: Running, Role: LEADER
I20260812 00:05:45.514586 13034 consensus_queue.cc:237] T 00000000000000000000000000000000 P 05ce2580909f49b09f2af178ab6b869d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05ce2580909f49b09f2af178ab6b869d" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 38935 } }
I20260812 00:05:45.514590 13028 sys_catalog.cc:564] T 00000000000000000000000000000000 P 05ce2580909f49b09f2af178ab6b869d [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:05:45.515717 13035 sys_catalog.cc:455] T 00000000000000000000000000000000 P 05ce2580909f49b09f2af178ab6b869d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "05ce2580909f49b09f2af178ab6b869d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05ce2580909f49b09f2af178ab6b869d" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 38935 } } }
I20260812 00:05:45.515796 13035 sys_catalog.cc:458] T 00000000000000000000000000000000 P 05ce2580909f49b09f2af178ab6b869d [sys.catalog]: This master's current role is: LEADER
I20260812 00:05:45.515980 13057 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:05:45.516084 13037 sys_catalog.cc:455] T 00000000000000000000000000000000 P 05ce2580909f49b09f2af178ab6b869d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 05ce2580909f49b09f2af178ab6b869d. Latest consensus state: current_term: 1 leader_uuid: "05ce2580909f49b09f2af178ab6b869d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05ce2580909f49b09f2af178ab6b869d" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 38935 } } }
I20260812 00:05:45.516392 13037 sys_catalog.cc:458] T 00000000000000000000000000000000 P 05ce2580909f49b09f2af178ab6b869d [sys.catalog]: This master's current role is: LEADER
I20260812 00:05:45.516752 13057 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:05:45.518083 13057 catalog_manager.cc:1347] Generated new cluster ID: 8f24a7e204fb4f7586f740706d299926
I20260812 00:05:45.518142 13057 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:05:45.519809 13033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:45.513721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46074 (local address 127.11.206.126:38935)
0812 00:05:45.513946 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:45.513955 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:45.513980 (+ 25us) server_negotiation.cc:407] Connection header received
0812 00:05:45.514072 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:45.514078 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:45.514137 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:45.514267 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:45.514521 (+ 254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:45.516243 (+ 1722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:45.517304 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:45.517934 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:45.518056 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:45.518972 (+ 916us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:45.518975 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:45.518976 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:05:45.519178 (+ 202us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:45.519231 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:05:45.519247 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:45.519307 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:45.519512 (+ 205us) server_negotiation.cc:299] Negotiation successful
0812 00:05:45.519594 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":106,"threads_started":1}
I20260812 00:05:45.528146 13057 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:05:45.528823 13057 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:05:45.531580 13057 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 05ce2580909f49b09f2af178ab6b869d: Generated new TSK 0
I20260812 00:05:45.531735 13057 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:05:45.533520 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492899949492-12089-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492899949492-12089-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492899949492-12089-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.65:0
--local_ip_for_outbound_sockets=127.11.206.65
--webserver_interface=127.11.206.65
--webserver_port=0
--tserver_master_addrs=127.11.206.126:38935
--builtin_ntp_servers=127.11.206.84:33423
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 00:05:45.614459 13065 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:45.614691 13065 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:45.614722 13065 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:45.615999 13065 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:45.616050 13065 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:45.616081 13065 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.65
I20260812 00:05:45.617543 13065 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:33423
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492899949492-12089-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492899949492-12089-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.206.65
--webserver_port=0
--tserver_master_addrs=127.11.206.126:38935
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13065
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.65
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492899949492-12089-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:05:45.617775 13065 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:45.618079 13065 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:45.622944 13071 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:45.623040 13076 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:45.623119 13073 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:45.623131 13065 server_base.cc:1034] running on GCE node
I20260812 00:05:45.623425 13065 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:45.623654 13065 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:45.624799 13065 hybrid_clock.cc:648] HybridClock initialized: now 1786493145624787 us; error 29 us; skew 500 ppm
I20260812 00:05:45.626031 13065 webserver.cc:460] Webserver started at http://127.11.206.65:36385/ using document root <none> and password file <none>
I20260812 00:05:45.626286 13065 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:45.626338 13065 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:45.626459 13065 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:45.627475 13065 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492899949492-12089-0/minicluster-data/ts-0/data/instance:
uuid: "65badaeff50f4da69a07cffb9cf32942"
format_stamp: "Formatted at 2026-08-12 00:05:45 on dist-test-slave-f0tn"
server_key: "fcc66c85b569897e46c264265e040d84"
server_key_iv: "96a7937fde6a4380415556901baa25db"
server_key_version: "encryptionkey@0"
I20260812 00:05:45.627797 13065 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492899949492-12089-0/minicluster-data/ts-0/wal/instance:
uuid: "65badaeff50f4da69a07cffb9cf32942"
format_stamp: "Formatted at 2026-08-12 00:05:45 on dist-test-slave-f0tn"
server_key: "fcc66c85b569897e46c264265e040d84"
server_key_iv: "96a7937fde6a4380415556901baa25db"
server_key_version: "encryptionkey@0"
I20260812 00:05:45.629315 13065 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:05:45.630087 13085 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:45.630242 13065 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:05:45.630327 13065 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492899949492-12089-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492899949492-12089-0/minicluster-data/ts-0/wal
uuid: "65badaeff50f4da69a07cffb9cf32942"
format_stamp: "Formatted at 2026-08-12 00:05:45 on dist-test-slave-f0tn"
server_key: "fcc66c85b569897e46c264265e040d84"
server_key_iv: "96a7937fde6a4380415556901baa25db"
server_key_version: "encryptionkey@0"
I20260812 00:05:45.630395 13065 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492899949492-12089-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492899949492-12089-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492899949492-12089-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:45.646900 13065 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:45.647174 13065 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:45.647293 13065 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:45.647500 13065 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:05:45.647802 13065 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:05:45.647835 13065 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:45.647866 13065 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:05:45.647888 13065 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:45.653363 13065 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.65:44517
I20260812 00:05:45.653447 13300 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.65:44517 every 8 connection(s)
I20260812 00:05:45.653733 13065 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
I20260812 00:05:45.658603 13033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:45.654413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.65:54809 (local address 127.11.206.126:38935)
0812 00:05:45.654500 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:45.654502 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:45.654731 (+ 229us) server_negotiation.cc:407] Connection header received
0812 00:05:45.655199 (+ 468us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:45.655199 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:45.655224 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:45.655278 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:45.655921 (+ 643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:45.656421 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:45.657342 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:45.657534 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:45.657577 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:45.658285 (+ 708us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:45.658286 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:45.658287 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:05:45.658292 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:45.658306 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:05:45.658310 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:45.658348 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:45.658514 (+ 166us) server_negotiation.cc:299] Negotiation successful
0812 00:05:45.658542 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260812 00:05:45.658605 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 13065
I20260812 00:05:45.658708 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492899949492-12089-0/minicluster-data/ts-0/wal/instance
I20260812 00:05:45.658869 13305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:45.654399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:38935 (local address 127.11.206.65:54809)
0812 00:05:45.654594 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:45.654644 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:45.655116 (+ 472us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:45.655347 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:45.655351 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:45.655360 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:45.655855 (+ 495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:45.655859 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:45.656483 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:45.656484 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:45.657278 (+ 794us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:45.657280 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:45.657590 (+ 310us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:45.657590 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:45.657710 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:45.658166 (+ 456us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:05:45.658167 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:45.658193 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:05:45.658217 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:45.658415 (+ 198us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:45.658425 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:45.658429 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:05:45.658513 (+ 84us) client_negotiation.cc:240] Negotiation successful
0812 00:05:45.658642 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":101,"threads_started":1}
I20260812 00:05:45.658932 12089 external_mini_cluster.cc:1428] Setting key d6ec46af9f43a3546ce84e0c742e27ae
I20260812 00:05:45.659325 13303 heartbeater.cc:347] Connected to a master server at 127.11.206.126:38935
I20260812 00:05:45.659430 13303 heartbeater.cc:464] Registering TS with master...
I20260812 00:05:45.659621 13303 heartbeater.cc:511] Master 127.11.206.126:38935 requested a full tablet report, sending...
I20260812 00:05:45.659952 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492899949492-12089-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492899949492-12089-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492899949492-12089-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.66:0
--local_ip_for_outbound_sockets=127.11.206.66
--webserver_interface=127.11.206.66
--webserver_port=0
--tserver_master_addrs=127.11.206.126:38935
--builtin_ntp_servers=127.11.206.84:33423
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 00:05:45.660207 12958 ts_manager.cc:194] Registered new tserver with Master: 65badaeff50f4da69a07cffb9cf32942 (127.11.206.65:44517)
I20260812 00:05:45.660800 12958 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.206.65:54809
W20260812 00:05:45.741168 13306 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:45.741400 13306 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:45.741432 13306 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:45.742549 13306 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:45.742583 13306 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:45.742606 13306 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.66
I20260812 00:05:45.743875 13306 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:33423
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492899949492-12089-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492899949492-12089-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.206.66
--webserver_port=0
--tserver_master_addrs=127.11.206.126:38935
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13306
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.66
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492899949492-12089-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:05:45.744053 13306 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:45.744293 13306 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:45.749051 13323 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:45.749055 13319 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:45.749066 13317 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:45.749100 13306 server_base.cc:1034] running on GCE node
I20260812 00:05:45.749526 13306 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:45.749755 13306 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:45.750903 13306 hybrid_clock.cc:648] HybridClock initialized: now 1786493145750886 us; error 28 us; skew 500 ppm
I20260812 00:05:45.752130 13306 webserver.cc:460] Webserver started at http://127.11.206.66:34827/ using document root <none> and password file <none>
I20260812 00:05:45.752338 13306 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:45.752388 13306 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:45.752514 13306 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:45.753715 13306 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492899949492-12089-0/minicluster-data/ts-1/data/instance:
uuid: "267c76389f954e3399d781c8eab14ca0"
format_stamp: "Formatted at 2026-08-12 00:05:45 on dist-test-slave-f0tn"
server_key: "0cd84a25fc90fa8ce8a675bcac47e28e"
server_key_iv: "ec4366a1cd7b8832508434d10ae62f94"
server_key_version: "encryptionkey@0"
I20260812 00:05:45.754047 13306 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492899949492-12089-0/minicluster-data/ts-1/wal/instance:
uuid: "267c76389f954e3399d781c8eab14ca0"
format_stamp: "Formatted at 2026-08-12 00:05:45 on dist-test-slave-f0tn"
server_key: "0cd84a25fc90fa8ce8a675bcac47e28e"
server_key_iv: "ec4366a1cd7b8832508434d10ae62f94"
server_key_version: "encryptionkey@0"
I20260812 00:05:45.755275 13306 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 00:05:45.755919 13331 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:45.756062 13306 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:05:45.756146 13306 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492899949492-12089-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492899949492-12089-0/minicluster-data/ts-1/wal
uuid: "267c76389f954e3399d781c8eab14ca0"
format_stamp: "Formatted at 2026-08-12 00:05:45 on dist-test-slave-f0tn"
server_key: "0cd84a25fc90fa8ce8a675bcac47e28e"
server_key_iv: "ec4366a1cd7b8832508434d10ae62f94"
server_key_version: "encryptionkey@0"
I20260812 00:05:45.756206 13306 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492899949492-12089-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492899949492-12089-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492899949492-12089-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:45.771750 13306 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:45.772037 13306 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:45.772162 13306 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:45.772367 13306 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:05:45.772691 13306 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:05:45.772725 13306 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:45.772754 13306 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:05:45.772778 13306 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:45.778273 13306 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.66:44979
I20260812 00:05:45.778329 13547 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.66:44979 every 8 connection(s)
I20260812 00:05:45.778640 13306 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
I20260812 00:05:45.783349 13033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:45.779293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.66:48179 (local address 127.11.206.126:38935)
0812 00:05:45.779345 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:45.779347 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:45.779581 (+ 234us) server_negotiation.cc:407] Connection header received
0812 00:05:45.780054 (+ 473us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:45.780055 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:45.780064 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:45.780134 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:45.780744 (+ 610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:45.781234 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:45.782197 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:45.782391 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:45.782445 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:45.783175 (+ 730us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:45.783175 (+ 0us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:45.783175 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:05:45.783179 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:45.783188 (+ 9us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:05:45.783191 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:45.783223 (+ 32us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:45.783275 (+ 52us) server_negotiation.cc:299] Negotiation successful
0812 00:05:45.783292 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 00:05:45.783532 13552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:45.779276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:38935 (local address 127.11.206.66:48179)
0812 00:05:45.779463 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:45.779497 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:45.779976 (+ 479us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:45.780196 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:45.780199 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:45.780207 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:45.780682 (+ 475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:45.780686 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:45.781295 (+ 609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:45.781296 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:45.782120 (+ 824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:45.782122 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:45.782450 (+ 328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:45.782450 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:45.782549 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:45.783055 (+ 506us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:05:45.783055 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:45.783085 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:05:45.783113 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:45.783225 (+ 112us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:45.783227 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:45.783229 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 00:05:45.783273 (+ 44us) client_negotiation.cc:240] Negotiation successful
0812 00:05:45.783347 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":89,"threads_started":1}
I20260812 00:05:45.783967 13549 heartbeater.cc:347] Connected to a master server at 127.11.206.126:38935
I20260812 00:05:45.784054 13549 heartbeater.cc:464] Registering TS with master...
I20260812 00:05:45.784242 13549 heartbeater.cc:511] Master 127.11.206.126:38935 requested a full tablet report, sending...
I20260812 00:05:45.784597 12958 ts_manager.cc:194] Registered new tserver with Master: 267c76389f954e3399d781c8eab14ca0 (127.11.206.66:44979)
I20260812 00:05:45.784951 12958 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.206.66:48179
I20260812 00:05:45.785056 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 13306
I20260812 00:05:45.785180 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492899949492-12089-0/minicluster-data/ts-1/wal/instance
I20260812 00:05:45.785365 12089 external_mini_cluster.cc:1428] Setting key 26f2600fd6bad0a6c28c5f96866dc8a4
I20260812 00:05:45.786254 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492899949492-12089-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492899949492-12089-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492899949492-12089-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.67:0
--local_ip_for_outbound_sockets=127.11.206.67
--webserver_interface=127.11.206.67
--webserver_port=0
--tserver_master_addrs=127.11.206.126:38935
--builtin_ntp_servers=127.11.206.84:33423
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 00:05:45.866400 13559 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:45.866591 13559 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:45.866619 13559 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:45.867720 13559 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:45.867758 13559 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:45.867789 13559 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.67
I20260812 00:05:45.869082 13559 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:33423
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492899949492-12089-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492899949492-12089-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.206.67
--webserver_port=0
--tserver_master_addrs=127.11.206.126:38935
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13559
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.67
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492899949492-12089-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:05:45.869319 13559 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:45.869604 13559 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:45.874393 13571 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:45.874395 13574 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:45.874552 13559 server_base.cc:1034] running on GCE node
W20260812 00:05:45.874396 13569 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:45.874828 13559 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:45.875043 13559 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:45.876185 13559 hybrid_clock.cc:648] HybridClock initialized: now 1786493145876171 us; error 30 us; skew 500 ppm
I20260812 00:05:45.877421 13559 webserver.cc:460] Webserver started at http://127.11.206.67:39073/ using document root <none> and password file <none>
I20260812 00:05:45.877656 13559 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:45.877704 13559 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:45.877823 13559 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:45.878829 13559 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492899949492-12089-0/minicluster-data/ts-2/data/instance:
uuid: "2bccfc1270e04a8fbd7b48a6341e74ef"
format_stamp: "Formatted at 2026-08-12 00:05:45 on dist-test-slave-f0tn"
server_key: "510bb43a4b21cf8b0567981b501b9fbe"
server_key_iv: "4855d285c79702063e92dacc7cd2b1e2"
server_key_version: "encryptionkey@0"
I20260812 00:05:45.879148 13559 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492899949492-12089-0/minicluster-data/ts-2/wal/instance:
uuid: "2bccfc1270e04a8fbd7b48a6341e74ef"
format_stamp: "Formatted at 2026-08-12 00:05:45 on dist-test-slave-f0tn"
server_key: "510bb43a4b21cf8b0567981b501b9fbe"
server_key_iv: "4855d285c79702063e92dacc7cd2b1e2"
server_key_version: "encryptionkey@0"
I20260812 00:05:45.880334 13559 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 00:05:45.880998 13591 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:45.881130 13559 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 00:05:45.881207 13559 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492899949492-12089-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492899949492-12089-0/minicluster-data/ts-2/wal
uuid: "2bccfc1270e04a8fbd7b48a6341e74ef"
format_stamp: "Formatted at 2026-08-12 00:05:45 on dist-test-slave-f0tn"
server_key: "510bb43a4b21cf8b0567981b501b9fbe"
server_key_iv: "4855d285c79702063e92dacc7cd2b1e2"
server_key_version: "encryptionkey@0"
I20260812 00:05:45.881274 13559 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492899949492-12089-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492899949492-12089-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492899949492-12089-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:45.897054 13559 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:45.897336 13559 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:45.897480 13559 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:45.897689 13559 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:05:45.898026 13559 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:05:45.898061 13559 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:45.898083 13559 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:05:45.898108 13559 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:45.903420 13559 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.67:34283
I20260812 00:05:45.903482 13807 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.67:34283 every 8 connection(s)
I20260812 00:05:45.903788 13559 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
I20260812 00:05:45.908612 13033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:45.904471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.67:50749 (local address 127.11.206.126:38935)
0812 00:05:45.904513 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:45.904515 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:45.904732 (+ 217us) server_negotiation.cc:407] Connection header received
0812 00:05:45.905261 (+ 529us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:45.905262 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:45.905274 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:45.905322 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:45.905996 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:45.906494 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:45.907441 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:45.907619 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:45.907662 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:45.908386 (+ 724us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:45.908388 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:45.908388 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:05:45.908392 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:45.908407 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:05:45.908412 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:45.908456 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:45.908520 (+ 64us) server_negotiation.cc:299] Negotiation successful
0812 00:05:45.908550 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 00:05:45.908788 13811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:45.904454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:38935 (local address 127.11.206.67:50749)
0812 00:05:45.904623 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:45.904657 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:45.905161 (+ 504us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:45.905407 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:45.905411 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:45.905423 (+ 12us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:45.905932 (+ 509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:45.905937 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:45.906556 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:45.906557 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:45.907379 (+ 822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:45.907382 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:45.907675 (+ 293us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:45.907675 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:45.907787 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:45.908257 (+ 470us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:05:45.908257 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:45.908286 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:05:45.908310 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:45.908458 (+ 148us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:45.908461 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:45.908463 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 00:05:45.908508 (+ 45us) client_negotiation.cc:240] Negotiation successful
0812 00:05:45.908590 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":82,"threads_started":1}
I20260812 00:05:45.909265 13808 heartbeater.cc:347] Connected to a master server at 127.11.206.126:38935
I20260812 00:05:45.909346 13808 heartbeater.cc:464] Registering TS with master...
I20260812 00:05:45.909548 13808 heartbeater.cc:511] Master 127.11.206.126:38935 requested a full tablet report, sending...
I20260812 00:05:45.909935 12958 ts_manager.cc:194] Registered new tserver with Master: 2bccfc1270e04a8fbd7b48a6341e74ef (127.11.206.67:34283)
I20260812 00:05:45.910302 12958 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.206.67:50749
I20260812 00:05:45.911027 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 13559
I20260812 00:05:45.911129 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492899949492-12089-0/minicluster-data/ts-2/wal/instance
I20260812 00:05:45.911299 12089 external_mini_cluster.cc:1428] Setting key 7b219e10610be5a12f4db2317a31b594
I20260812 00:05:45.912050 12089 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:05:45.915967 13033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:45.913269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46078 (local address 127.11.206.126:38935)
0812 00:05:45.913309 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:45.913310 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:45.913430 (+ 120us) server_negotiation.cc:407] Connection header received
0812 00:05:45.913496 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:45.913497 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:45.913507 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:45.913549 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:45.913674 (+ 125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:45.914152 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:45.914902 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:45.915075 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:45.915132 (+ 57us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:45.915775 (+ 643us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:45.915776 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:45.915776 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:05:45.915780 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:45.915792 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:05:45.915796 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:45.915866 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:45.915905 (+ 39us) server_negotiation.cc:299] Negotiation successful
0812 00:05:45.915915 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 00:05:45.917568 12958 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46078:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:05:45.919051 12958 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:05:45.924950 13822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:45.921037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.65:44517 (local address 127.0.0.1:33456)
0812 00:05:45.921469 (+ 432us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:45.921478 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:45.921526 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:45.921701 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:45.921704 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:45.921706 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:05:45.921839 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:45.921842 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:45.922765 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:45.922766 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:45.923873 (+ 1107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:45.923875 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:45.924666 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:45.924667 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:45.924744 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:45.924757 (+ 13us) client_negotiation.cc:769] Sending connection context
0812 00:05:45.924826 (+ 69us) client_negotiation.cc:240] Negotiation successful
0812 00:05:45.924878 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":420,"thread_start_us":83,"threads_started":1}
I20260812 00:05:45.924961 13829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:45.921294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33456 (local address 127.11.206.65:44517)
0812 00:05:45.921465 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:45.921470 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:45.921517 (+ 47us) server_negotiation.cc:407] Connection header received
0812 00:05:45.921590 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:45.921591 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:45.921611 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:45.921683 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:05:45.921926 (+ 243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:45.922690 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:45.923967 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:45.924585 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:45.924654 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:45.924747 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:45.924842 (+ 95us) server_negotiation.cc:299] Negotiation successful
0812 00:05:45.924878 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":74,"threads_started":1}
I20260812 00:05:45.925241 13823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:45.921037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.66:44979 (local address 127.0.0.1:51220)
0812 00:05:45.921606 (+ 569us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:45.921612 (+ 6us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:45.921646 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:45.921834 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:45.921835 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:45.921837 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:05:45.921887 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:45.921889 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:45.923294 (+ 1405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:45.923295 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:45.924131 (+ 836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:45.924133 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:45.925032 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:45.925033 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:45.925087 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:45.925092 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 00:05:45.925118 (+ 26us) client_negotiation.cc:240] Negotiation successful
0812 00:05:45.925155 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":559,"mutex_wait_us":4,"thread_start_us":82,"threads_started":1}
I20260812 00:05:45.925483 13824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:45.921035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.67:34283 (local address 127.0.0.1:49766)
0812 00:05:45.921233 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:45.921273 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:45.921337 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:45.921935 (+ 598us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:45.921935 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:45.921937 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:05:45.921971 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:45.921972 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:45.923213 (+ 1241us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:45.923214 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:45.924228 (+ 1014us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:45.924230 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:45.925264 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:45.925265 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:45.925325 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:45.925328 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:05:45.925358 (+ 30us) client_negotiation.cc:240] Negotiation successful
0812 00:05:45.925422 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":108,"threads_started":1}
I20260812 00:05:45.925602 13830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:45.921307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51220 (local address 127.11.206.66:44979)
0812 00:05:45.921513 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:45.921518 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:45.921658 (+ 140us) server_negotiation.cc:407] Connection header received
0812 00:05:45.921703 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:45.921705 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:45.921721 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:45.922130 (+ 409us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:05:45.922190 (+ 60us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:45.923234 (+ 1044us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:45.924202 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:45.924927 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:45.925346 (+ 419us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:45.925467 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:45.925492 (+ 25us) server_negotiation.cc:299] Negotiation successful
0812 00:05:45.925527 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":92,"threads_started":1}
I20260812 00:05:45.925858 13184 tablet_service.cc:1467] Processing CreateTablet for tablet 253d4f2a54f74ac8926856ae130d0ba6 (DEFAULT_TABLE table=test-table [id=377938cefb0b4b9f84719d221204f232]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:05:45.926134 13828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:45.921124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49766 (local address 127.11.206.67:34283)
0812 00:05:45.921765 (+ 641us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:45.921768 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:45.921789 (+ 21us) server_negotiation.cc:407] Connection header received
0812 00:05:45.921823 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:45.921825 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:45.921838 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:45.921935 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:05:45.922026 (+ 91us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:45.923126 (+ 1100us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:45.924312 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:45.924990 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:45.925902 (+ 912us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:45.925977 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:45.925998 (+ 21us) server_negotiation.cc:299] Negotiation successful
0812 00:05:45.926029 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":600,"thread_start_us":71,"threads_started":1}
I20260812 00:05:45.926263 13184 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 253d4f2a54f74ac8926856ae130d0ba6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:45.926226 13428 tablet_service.cc:1467] Processing CreateTablet for tablet 253d4f2a54f74ac8926856ae130d0ba6 (DEFAULT_TABLE table=test-table [id=377938cefb0b4b9f84719d221204f232]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:05:45.926558 13428 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 253d4f2a54f74ac8926856ae130d0ba6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:45.926715 13677 tablet_service.cc:1467] Processing CreateTablet for tablet 253d4f2a54f74ac8926856ae130d0ba6 (DEFAULT_TABLE table=test-table [id=377938cefb0b4b9f84719d221204f232]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:05:45.927011 13677 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 253d4f2a54f74ac8926856ae130d0ba6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:45.929702 13833 tablet_bootstrap.cc:492] T 253d4f2a54f74ac8926856ae130d0ba6 P 2bccfc1270e04a8fbd7b48a6341e74ef: Bootstrap starting.
I20260812 00:05:45.929821 13835 tablet_bootstrap.cc:492] T 253d4f2a54f74ac8926856ae130d0ba6 P 267c76389f954e3399d781c8eab14ca0: Bootstrap starting.
I20260812 00:05:45.930271 13833 tablet_bootstrap.cc:654] T 253d4f2a54f74ac8926856ae130d0ba6 P 2bccfc1270e04a8fbd7b48a6341e74ef: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:45.930334 13835 tablet_bootstrap.cc:654] T 253d4f2a54f74ac8926856ae130d0ba6 P 267c76389f954e3399d781c8eab14ca0: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:45.930543 13833 log.cc:824] T 253d4f2a54f74ac8926856ae130d0ba6 P 2bccfc1270e04a8fbd7b48a6341e74ef: Log is configured to *not* fsync() on all Append() calls
I20260812 00:05:45.930594 13835 log.cc:824] T 253d4f2a54f74ac8926856ae130d0ba6 P 267c76389f954e3399d781c8eab14ca0: Log is configured to *not* fsync() on all Append() calls
I20260812 00:05:45.930887 13836 tablet_bootstrap.cc:492] T 253d4f2a54f74ac8926856ae130d0ba6 P 65badaeff50f4da69a07cffb9cf32942: Bootstrap starting.
I20260812 00:05:45.931209 13833 tablet_bootstrap.cc:492] T 253d4f2a54f74ac8926856ae130d0ba6 P 2bccfc1270e04a8fbd7b48a6341e74ef: No bootstrap required, opened a new log
I20260812 00:05:45.931265 13833 ts_tablet_manager.cc:1397] T 253d4f2a54f74ac8926856ae130d0ba6 P 2bccfc1270e04a8fbd7b48a6341e74ef: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 00:05:45.931391 13836 tablet_bootstrap.cc:654] T 253d4f2a54f74ac8926856ae130d0ba6 P 65badaeff50f4da69a07cffb9cf32942: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:45.931649 13836 log.cc:824] T 253d4f2a54f74ac8926856ae130d0ba6 P 65badaeff50f4da69a07cffb9cf32942: Log is configured to *not* fsync() on all Append() calls
I20260812 00:05:45.932243 13836 tablet_bootstrap.cc:492] T 253d4f2a54f74ac8926856ae130d0ba6 P 65badaeff50f4da69a07cffb9cf32942: No bootstrap required, opened a new log
I20260812 00:05:45.932300 13836 ts_tablet_manager.cc:1397] T 253d4f2a54f74ac8926856ae130d0ba6 P 65badaeff50f4da69a07cffb9cf32942: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 00:05:45.933202 13833 raft_consensus.cc:348] T 253d4f2a54f74ac8926856ae130d0ba6 P 2bccfc1270e04a8fbd7b48a6341e74ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "267c76389f954e3399d781c8eab14ca0" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 44979 } } peers { permanent_uuid: "2bccfc1270e04a8fbd7b48a6341e74ef" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 34283 } } peers { permanent_uuid: "65badaeff50f4da69a07cffb9cf32942" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 44517 } }
I20260812 00:05:45.933336 13833 raft_consensus.cc:374] T 253d4f2a54f74ac8926856ae130d0ba6 P 2bccfc1270e04a8fbd7b48a6341e74ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:45.933355 13833 raft_consensus.cc:729] T 253d4f2a54f74ac8926856ae130d0ba6 P 2bccfc1270e04a8fbd7b48a6341e74ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bccfc1270e04a8fbd7b48a6341e74ef, State: Initialized, Role: FOLLOWER
I20260812 00:05:45.933486 13833 consensus_queue.cc:260] T 253d4f2a54f74ac8926856ae130d0ba6 P 2bccfc1270e04a8fbd7b48a6341e74ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "267c76389f954e3399d781c8eab14ca0" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 44979 } } peers { permanent_uuid: "2bccfc1270e04a8fbd7b48a6341e74ef" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 34283 } } peers { permanent_uuid: "65badaeff50f4da69a07cffb9cf32942" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 44517 } }
I20260812 00:05:45.933734 13833 ts_tablet_manager.cc:1428] T 253d4f2a54f74ac8926856ae130d0ba6 P 2bccfc1270e04a8fbd7b48a6341e74ef: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260812 00:05:45.933809 13808 heartbeater.cc:503] Master 127.11.206.126:38935 was elected leader, sending a full tablet report...
I20260812 00:05:45.934064 13835 tablet_bootstrap.cc:492] T 253d4f2a54f74ac8926856ae130d0ba6 P 267c76389f954e3399d781c8eab14ca0: No bootstrap required, opened a new log
I20260812 00:05:45.934132 13835 ts_tablet_manager.cc:1397] T 253d4f2a54f74ac8926856ae130d0ba6 P 267c76389f954e3399d781c8eab14ca0: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260812 00:05:45.934437 13836 raft_consensus.cc:348] T 253d4f2a54f74ac8926856ae130d0ba6 P 65badaeff50f4da69a07cffb9cf32942 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "267c76389f954e3399d781c8eab14ca0" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 44979 } } peers { permanent_uuid: "2bccfc1270e04a8fbd7b48a6341e74ef" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 34283 } } peers { permanent_uuid: "65badaeff50f4da69a07cffb9cf32942" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 44517 } }
I20260812 00:05:45.934561 13836 raft_consensus.cc:374] T 253d4f2a54f74ac8926856ae130d0ba6 P 65badaeff50f4da69a07cffb9cf32942 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:45.934594 13836 raft_consensus.cc:729] T 253d4f2a54f74ac8926856ae130d0ba6 P 65badaeff50f4da69a07cffb9cf32942 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65badaeff50f4da69a07cffb9cf32942, State: Initialized, Role: FOLLOWER
I20260812 00:05:45.934731 13836 consensus_queue.cc:260] T 253d4f2a54f74ac8926856ae130d0ba6 P 65badaeff50f4da69a07cffb9cf32942 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "267c76389f954e3399d781c8eab14ca0" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 44979 } } peers { permanent_uuid: "2bccfc1270e04a8fbd7b48a6341e74ef" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 34283 } } peers { permanent_uuid: "65badaeff50f4da69a07cffb9cf32942" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 44517 } }
I20260812 00:05:45.934970 13836 ts_tablet_manager.cc:1428] T 253d4f2a54f74ac8926856ae130d0ba6 P 65badaeff50f4da69a07cffb9cf32942: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 00:05:45.935111 13303 heartbeater.cc:503] Master 127.11.206.126:38935 was elected leader, sending a full tablet report...
I20260812 00:05:45.936265 13835 raft_consensus.cc:348] T 253d4f2a54f74ac8926856ae130d0ba6 P 267c76389f954e3399d781c8eab14ca0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "267c76389f954e3399d781c8eab14ca0" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 44979 } } peers { permanent_uuid: "2bccfc1270e04a8fbd7b48a6341e74ef" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 34283 } } peers { permanent_uuid: "65badaeff50f4da69a07cffb9cf32942" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 44517 } }
I20260812 00:05:45.936386 13835 raft_consensus.cc:374] T 253d4f2a54f74ac8926856ae130d0ba6 P 267c76389f954e3399d781c8eab14ca0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:45.936406 13835 raft_consensus.cc:729] T 253d4f2a54f74ac8926856ae130d0ba6 P 267c76389f954e3399d781c8eab14ca0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 267c76389f954e3399d781c8eab14ca0, State: Initialized, Role: FOLLOWER
I20260812 00:05:45.936479 13835 consensus_queue.cc:260] T 253d4f2a54f74ac8926856ae130d0ba6 P 267c76389f954e3399d781c8eab14ca0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "267c76389f954e3399d781c8eab14ca0" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 44979 } } peers { permanent_uuid: "2bccfc1270e04a8fbd7b48a6341e74ef" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 34283 } } peers { permanent_uuid: "65badaeff50f4da69a07cffb9cf32942" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 44517 } }
I20260812 00:05:45.936659 13835 ts_tablet_manager.cc:1428] T 253d4f2a54f74ac8926856ae130d0ba6 P 267c76389f954e3399d781c8eab14ca0: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260812 00:05:45.936720 13549 heartbeater.cc:503] Master 127.11.206.126:38935 was elected leader, sending a full tablet report...
I20260812 00:05:45.954779 13844 raft_consensus.cc:482] T 253d4f2a54f74ac8926856ae130d0ba6 P 2bccfc1270e04a8fbd7b48a6341e74ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:05:45.954893 13844 raft_consensus.cc:504] T 253d4f2a54f74ac8926856ae130d0ba6 P 2bccfc1270e04a8fbd7b48a6341e74ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "267c76389f954e3399d781c8eab14ca0" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 44979 } } peers { permanent_uuid: "2bccfc1270e04a8fbd7b48a6341e74ef" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 34283 } } peers { permanent_uuid: "65badaeff50f4da69a07cffb9cf32942" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 44517 } }
I20260812 00:05:45.955241 13844 leader_election.cc:288] T 253d4f2a54f74ac8926856ae130d0ba6 P 2bccfc1270e04a8fbd7b48a6341e74ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 267c76389f954e3399d781c8eab14ca0 (127.11.206.66:44979), 65badaeff50f4da69a07cffb9cf32942 (127.11.206.65:44517)
I20260812 00:05:45.958066 13829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:45.955500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.67:57509 (local address 127.11.206.65:44517)
0812 00:05:45.955550 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:45.955552 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:45.955560 (+ 8us) server_negotiation.cc:407] Connection header received
0812 00:05:45.955582 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:45.955583 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:45.955592 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:45.955646 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:05:45.955785 (+ 139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:45.956252 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:45.957284 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:45.957781 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:45.957832 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:45.957839 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:45.957988 (+ 149us) server_negotiation.cc:299] Negotiation successful
0812 00:05:45.958015 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 00:05:45.958086 13811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:45.955390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.65:44517 (local address 127.11.206.67:57509)
0812 00:05:45.955438 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:45.955451 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:45.955501 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:45.955654 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:45.955655 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:45.955656 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:05:45.955724 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:45.955726 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:45.956327 (+ 601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:45.956328 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:45.957195 (+ 867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:45.957197 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:45.957846 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:45.957847 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:45.957919 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:45.957924 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 00:05:45.957975 (+ 51us) client_negotiation.cc:240] Negotiation successful
0812 00:05:45.958015 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27}
I20260812 00:05:45.958364 13830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:45.955457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.67:34417 (local address 127.11.206.66:44979)
0812 00:05:45.955520 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:45.955522 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:45.955767 (+ 245us) server_negotiation.cc:407] Connection header received
0812 00:05:45.955826 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:45.955827 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:45.955835 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:45.955883 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:05:45.956012 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:45.956614 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:45.957620 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:45.958045 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:45.958105 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:45.958112 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:45.958260 (+ 148us) server_negotiation.cc:299] Negotiation successful
0812 00:05:45.958301 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260812 00:05:45.958370 13847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:45.955390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.66:44979 (local address 127.11.206.67:34417)
0812 00:05:45.955692 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:45.955700 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:45.955766 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:45.955889 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:45.955890 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:45.955891 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:05:45.955959 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:45.955961 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:45.956704 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:45.956705 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:45.957539 (+ 834us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:45.957541 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:45.958123 (+ 582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:45.958124 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:45.958193 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:45.958197 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:05:45.958252 (+ 55us) client_negotiation.cc:240] Negotiation successful
0812 00:05:45.958284 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":278,"mutex_wait_us":137,"thread_start_us":101,"threads_started":1}
I20260812 00:05:45.958400 13217 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "253d4f2a54f74ac8926856ae130d0ba6" candidate_uuid: "2bccfc1270e04a8fbd7b48a6341e74ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65badaeff50f4da69a07cffb9cf32942" is_pre_election: true
I20260812 00:05:45.958549 13217 raft_consensus.cc:2454] T 253d4f2a54f74ac8926856ae130d0ba6 P 65badaeff50f4da69a07cffb9cf32942 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bccfc1270e04a8fbd7b48a6341e74ef in term 0.
I20260812 00:05:45.958775 13594 leader_election.cc:302] T 253d4f2a54f74ac8926856ae130d0ba6 P 2bccfc1270e04a8fbd7b48a6341e74ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bccfc1270e04a8fbd7b48a6341e74ef, 65badaeff50f4da69a07cffb9cf32942; no voters:
I20260812 00:05:45.958745 13467 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "253d4f2a54f74ac8926856ae130d0ba6" candidate_uuid: "2bccfc1270e04a8fbd7b48a6341e74ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "267c76389f954e3399d781c8eab14ca0" is_pre_election: true
I20260812 00:05:45.958904 13467 raft_consensus.cc:2454] T 253d4f2a54f74ac8926856ae130d0ba6 P 267c76389f954e3399d781c8eab14ca0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bccfc1270e04a8fbd7b48a6341e74ef in term 0.
I20260812 00:05:45.958892 13844 raft_consensus.cc:2781] T 253d4f2a54f74ac8926856ae130d0ba6 P 2bccfc1270e04a8fbd7b48a6341e74ef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:05:45.958957 13844 raft_consensus.cc:482] T 253d4f2a54f74ac8926856ae130d0ba6 P 2bccfc1270e04a8fbd7b48a6341e74ef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:05:45.958990 13844 raft_consensus.cc:3037] T 253d4f2a54f74ac8926856ae130d0ba6 P 2bccfc1270e04a8fbd7b48a6341e74ef [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:45.959678 13844 raft_consensus.cc:504] T 253d4f2a54f74ac8926856ae130d0ba6 P 2bccfc1270e04a8fbd7b48a6341e74ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "267c76389f954e3399d781c8eab14ca0" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 44979 } } peers { permanent_uuid: "2bccfc1270e04a8fbd7b48a6341e74ef" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 34283 } } peers { permanent_uuid: "65badaeff50f4da69a07cffb9cf32942" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 44517 } }
I20260812 00:05:45.959802 13844 leader_election.cc:288] T 253d4f2a54f74ac8926856ae130d0ba6 P 2bccfc1270e04a8fbd7b48a6341e74ef [CANDIDATE]: Term 1 election: Requested vote from peers 267c76389f954e3399d781c8eab14ca0 (127.11.206.66:44979), 65badaeff50f4da69a07cffb9cf32942 (127.11.206.65:44517)
I20260812 00:05:45.959940 13467 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "253d4f2a54f74ac8926856ae130d0ba6" candidate_uuid: "2bccfc1270e04a8fbd7b48a6341e74ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "267c76389f954e3399d781c8eab14ca0"
I20260812 00:05:45.959967 13217 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "253d4f2a54f74ac8926856ae130d0ba6" candidate_uuid: "2bccfc1270e04a8fbd7b48a6341e74ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65badaeff50f4da69a07cffb9cf32942"
I20260812 00:05:45.960016 13467 raft_consensus.cc:3037] T 253d4f2a54f74ac8926856ae130d0ba6 P 267c76389f954e3399d781c8eab14ca0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:45.960029 13217 raft_consensus.cc:3037] T 253d4f2a54f74ac8926856ae130d0ba6 P 65badaeff50f4da69a07cffb9cf32942 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:45.960683 13467 raft_consensus.cc:2454] T 253d4f2a54f74ac8926856ae130d0ba6 P 267c76389f954e3399d781c8eab14ca0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bccfc1270e04a8fbd7b48a6341e74ef in term 1.
I20260812 00:05:45.960767 13217 raft_consensus.cc:2454] T 253d4f2a54f74ac8926856ae130d0ba6 P 65badaeff50f4da69a07cffb9cf32942 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bccfc1270e04a8fbd7b48a6341e74ef in term 1.
I20260812 00:05:45.960865 13596 leader_election.cc:302] T 253d4f2a54f74ac8926856ae130d0ba6 P 2bccfc1270e04a8fbd7b48a6341e74ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 267c76389f954e3399d781c8eab14ca0, 2bccfc1270e04a8fbd7b48a6341e74ef; no voters:
I20260812 00:05:45.960955 13844 raft_consensus.cc:2781] T 253d4f2a54f74ac8926856ae130d0ba6 P 2bccfc1270e04a8fbd7b48a6341e74ef [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:05:45.961112 13844 raft_consensus.cc:686] T 253d4f2a54f74ac8926856ae130d0ba6 P 2bccfc1270e04a8fbd7b48a6341e74ef [term 1 LEADER]: Becoming Leader. State: Replica: 2bccfc1270e04a8fbd7b48a6341e74ef, State: Running, Role: LEADER
I20260812 00:05:45.961205 13844 consensus_queue.cc:237] T 253d4f2a54f74ac8926856ae130d0ba6 P 2bccfc1270e04a8fbd7b48a6341e74ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "267c76389f954e3399d781c8eab14ca0" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 44979 } } peers { permanent_uuid: "2bccfc1270e04a8fbd7b48a6341e74ef" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 34283 } } peers { permanent_uuid: "65badaeff50f4da69a07cffb9cf32942" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 44517 } }
I20260812 00:05:45.962033 12952 catalog_manager.cc:5495] T 253d4f2a54f74ac8926856ae130d0ba6 P 2bccfc1270e04a8fbd7b48a6341e74ef reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bccfc1270e04a8fbd7b48a6341e74ef (127.11.206.67). New cstate: current_term: 1 leader_uuid: "2bccfc1270e04a8fbd7b48a6341e74ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "267c76389f954e3399d781c8eab14ca0" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 44979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bccfc1270e04a8fbd7b48a6341e74ef" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 34283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65badaeff50f4da69a07cffb9cf32942" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 44517 } health_report { overall_health: UNKNOWN } } }
I20260812 00:05:45.970450 13828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:45.968184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49772 (local address 127.11.206.67:34283)
0812 00:05:45.968237 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:45.968239 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:45.968246 (+ 7us) server_negotiation.cc:407] Connection header received
0812 00:05:45.968280 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:45.968281 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:45.968300 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:45.968362 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:05:45.968498 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:45.968970 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:45.969751 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:45.969939 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:45.969991 (+ 52us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:45.970131 (+ 140us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:05:45.970223 (+ 92us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:05:45.970306 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:45.970352 (+ 46us) server_negotiation.cc:299] Negotiation successful
0812 00:05:45.970360 (+ 8us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260812 00:05:45.972471 13217 raft_consensus.cc:1261] T 253d4f2a54f74ac8926856ae130d0ba6 P 65badaeff50f4da69a07cffb9cf32942 [term 1 FOLLOWER]: Refusing update from remote peer 2bccfc1270e04a8fbd7b48a6341e74ef: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:05:45.972535 13467 raft_consensus.cc:1261] T 253d4f2a54f74ac8926856ae130d0ba6 P 267c76389f954e3399d781c8eab14ca0 [term 1 FOLLOWER]: Refusing update from remote peer 2bccfc1270e04a8fbd7b48a6341e74ef: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:05:45.972820 13848 consensus_queue.cc:1035] T 253d4f2a54f74ac8926856ae130d0ba6 P 2bccfc1270e04a8fbd7b48a6341e74ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "65badaeff50f4da69a07cffb9cf32942" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:05:45.972944 13844 consensus_queue.cc:1035] T 253d4f2a54f74ac8926856ae130d0ba6 P 2bccfc1270e04a8fbd7b48a6341e74ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "267c76389f954e3399d781c8eab14ca0" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 44979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:05:45.975685 13853 mvcc.cc:205] Tried to move back new op lower bound from 7317475925900521472 to 7317475925857947648. Current Snapshot: MvccSnapshot[applied={T|T < 7317475925900521472}]
I20260812 00:05:45.977676 12954 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46078:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:05:45.977794 12954 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46078:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:05:45.978626 12954 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 05ce2580909f49b09f2af178ab6b869d: Sending DeleteTablet for 3 replicas of tablet 253d4f2a54f74ac8926856ae130d0ba6
I20260812 00:05:45.978955 13428 tablet_service.cc:1514] Processing DeleteTablet for tablet 253d4f2a54f74ac8926856ae130d0ba6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:05:45 UTC) from {username='slave'} at 127.0.0.1:51220
I20260812 00:05:45.979054 13184 tablet_service.cc:1514] Processing DeleteTablet for tablet 253d4f2a54f74ac8926856ae130d0ba6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:05:45 UTC) from {username='slave'} at 127.0.0.1:33456
I20260812 00:05:45.979200 13865 tablet_replica.cc:330] T 253d4f2a54f74ac8926856ae130d0ba6 P 267c76389f954e3399d781c8eab14ca0: stopping tablet replica
I20260812 00:05:45.979193 13677 tablet_service.cc:1514] Processing DeleteTablet for tablet 253d4f2a54f74ac8926856ae130d0ba6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:05:45 UTC) from {username='slave'} at 127.0.0.1:49766
I20260812 00:05:45.979310 13865 raft_consensus.cc:2229] T 253d4f2a54f74ac8926856ae130d0ba6 P 267c76389f954e3399d781c8eab14ca0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:05:45.979419 13865 raft_consensus.cc:2258] T 253d4f2a54f74ac8926856ae130d0ba6 P 267c76389f954e3399d781c8eab14ca0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:05:45.979439 13868 tablet_replica.cc:330] T 253d4f2a54f74ac8926856ae130d0ba6 P 2bccfc1270e04a8fbd7b48a6341e74ef: stopping tablet replica
I20260812 00:05:45.979589 13868 raft_consensus.cc:2229] T 253d4f2a54f74ac8926856ae130d0ba6 P 2bccfc1270e04a8fbd7b48a6341e74ef [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:05:45.979663 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 13065
I20260812 00:05:46.002519 13868 raft_consensus.cc:2258] T 253d4f2a54f74ac8926856ae130d0ba6 P 2bccfc1270e04a8fbd7b48a6341e74ef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:05:46.002846 13865 ts_tablet_manager.cc:1905] T 253d4f2a54f74ac8926856ae130d0ba6 P 267c76389f954e3399d781c8eab14ca0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:05:46.003233 13868 ts_tablet_manager.cc:1905] T 253d4f2a54f74ac8926856ae130d0ba6 P 2bccfc1270e04a8fbd7b48a6341e74ef: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:05:46.004992 13865 ts_tablet_manager.cc:1918] T 253d4f2a54f74ac8926856ae130d0ba6 P 267c76389f954e3399d781c8eab14ca0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:05:46.005015 13868 ts_tablet_manager.cc:1918] T 253d4f2a54f74ac8926856ae130d0ba6 P 2bccfc1270e04a8fbd7b48a6341e74ef: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:05:46.005076 13865 log.cc:1196] T 253d4f2a54f74ac8926856ae130d0ba6 P 267c76389f954e3399d781c8eab14ca0: Deleting WAL directory at /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492899949492-12089-0/minicluster-data/ts-1/wal/wals/253d4f2a54f74ac8926856ae130d0ba6
I20260812 00:05:46.005092 13868 log.cc:1196] T 253d4f2a54f74ac8926856ae130d0ba6 P 2bccfc1270e04a8fbd7b48a6341e74ef: Deleting WAL directory at /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786492899949492-12089-0/minicluster-data/ts-2/wal/wals/253d4f2a54f74ac8926856ae130d0ba6
I20260812 00:05:46.005338 13865 ts_tablet_manager.cc:1939] T 253d4f2a54f74ac8926856ae130d0ba6 P 267c76389f954e3399d781c8eab14ca0: Deleting consensus metadata
I20260812 00:05:46.005404 13868 ts_tablet_manager.cc:1939] T 253d4f2a54f74ac8926856ae130d0ba6 P 2bccfc1270e04a8fbd7b48a6341e74ef: Deleting consensus metadata
I20260812 00:05:46.005908 12938 catalog_manager.cc:4841] TS 267c76389f954e3399d781c8eab14ca0 (127.11.206.66:44979): tablet 253d4f2a54f74ac8926856ae130d0ba6 (table test-table [id=377938cefb0b4b9f84719d221204f232]) successfully deleted
I20260812 00:05:46.005908 12935 catalog_manager.cc:4841] TS 2bccfc1270e04a8fbd7b48a6341e74ef (127.11.206.67:34283): tablet 253d4f2a54f74ac8926856ae130d0ba6 (table test-table [id=377938cefb0b4b9f84719d221204f232]) successfully deleted
W20260812 00:05:46.009608 12937 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.206.65:44517 (error 108)
I20260812 00:05:46.009904 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 13306
I20260812 00:05:46.010164 13824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:46.010025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.65:44517 (local address 127.0.0.1:33462)
0812 00:05:46.010084 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:46.010127 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.65:44517: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260812 00:05:46.010293 12937 catalog_manager.cc:4584] TS 65badaeff50f4da69a07cffb9cf32942 (127.11.206.65:44517): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 253d4f2a54f74ac8926856ae130d0ba6: Network error: Client connection negotiation failed: client connection to 127.11.206.65:44517: connect: Connection refused (error 111)
I20260812 00:05:46.018637 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 13559
I20260812 00:05:46.033667 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 12907
2026-08-12T00:05:46Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (692 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:05:46 dist-test-slave-f0tn krb5kdc[13878](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:05:46 dist-test-slave-f0tn krb5kdc[13878](info): set up 2 sockets
Aug 12 00:05:46 dist-test-slave-f0tn krb5kdc[13878](info): commencing operation
krb5kdc: starting...
W20260812 00:05:47.225466 12089 mini_kdc.cc:121] Time spent starting KDC: real 1.162s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/krb5kdc/test-user.keytab.
Aug 12 00:05:47 dist-test-slave-f0tn krb5kdc[13878](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493147, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:05:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:05:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.206.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab.
Entry for principal kudu/127.11.206.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab.
I20260812 00:05:47.345968 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:41191
--webserver_interface=127.11.206.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab
--principal=kudu/127.11.206.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:40815
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.206.126:41191
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:05:47.428958 13907 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:47.429177 13907 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:47.429208 13907 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:47.430377 13907 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:05:47.430419 13907 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:47.430437 13907 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:47.430454 13907 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:05:47.430469 13907 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:05:47.431955 13907 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:40815
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.206.126:41191
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab
--principal=kudu/127.11.206.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:41191
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.206.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13907
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:05:47.432212 13907 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:47.432430 13907 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:47.437193 13916 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:47.437203 13912 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:47.437204 13919 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:47.437355 13907 server_base.cc:1034] running on GCE node
I20260812 00:05:47.437686 13907 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:47.437934 13907 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:47.439088 13907 hybrid_clock.cc:648] HybridClock initialized: now 1786493147439075 us; error 31 us; skew 500 ppm
Aug 12 00:05:47 dist-test-slave-f0tn krb5kdc[13878](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493147, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:47.441576 13907 init.cc:377] Logged in from keytab as kudu/127.11.206.126@KRBTEST.COM (short username kudu)
I20260812 00:05:47.442028 13907 webserver.cc:460] Webserver started at http://127.11.206.126:37411/ using document root <none> and password file <none>
I20260812 00:05:47.442261 13907 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:47.442305 13907 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:47.442428 13907 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:47.443490 13907 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/minicluster-data/master-0/data/instance:
uuid: "cdb55c620f874546b75a0459c1ab0b1c"
format_stamp: "Formatted at 2026-08-12 00:05:47 on dist-test-slave-f0tn"
server_key: "276c9b6cd34a859daf8900118b0d534c"
server_key_iv: "bed594852f4a74fdae9841ed7be36353"
server_key_version: "encryptionkey@0"
I20260812 00:05:47.443830 13907 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/minicluster-data/master-0/wal/instance:
uuid: "cdb55c620f874546b75a0459c1ab0b1c"
format_stamp: "Formatted at 2026-08-12 00:05:47 on dist-test-slave-f0tn"
server_key: "276c9b6cd34a859daf8900118b0d534c"
server_key_iv: "bed594852f4a74fdae9841ed7be36353"
server_key_version: "encryptionkey@0"
I20260812 00:05:47.445088 13907 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:05:47.445842 13932 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:47.445996 13907 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:47.446079 13907 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/minicluster-data/master-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/minicluster-data/master-0/wal
uuid: "cdb55c620f874546b75a0459c1ab0b1c"
format_stamp: "Formatted at 2026-08-12 00:05:47 on dist-test-slave-f0tn"
server_key: "276c9b6cd34a859daf8900118b0d534c"
server_key_iv: "bed594852f4a74fdae9841ed7be36353"
server_key_version: "encryptionkey@0"
I20260812 00:05:47.446164 13907 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:47.464707 13907 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:47.466709 13907 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:47.466848 13907 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:47.470687 13907 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.126:41191
I20260812 00:05:47.470739 14022 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.126:41191 every 8 connection(s)
I20260812 00:05:47.471055 13907 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
I20260812 00:05:47.471295 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 13907
I20260812 00:05:47.471405 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/minicluster-data/master-0/wal/instance
I20260812 00:05:47.471604 12089 external_mini_cluster.cc:1428] Setting key 0d46b146f960afb785a32a3ba1277966
I20260812 00:05:47.472016 14023 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:47.475103 14023 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cdb55c620f874546b75a0459c1ab0b1c: Bootstrap starting.
I20260812 00:05:47.475857 14023 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cdb55c620f874546b75a0459c1ab0b1c: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:47.476125 14023 log.cc:824] T 00000000000000000000000000000000 P cdb55c620f874546b75a0459c1ab0b1c: Log is configured to *not* fsync() on all Append() calls
I20260812 00:05:47.476832 14023 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cdb55c620f874546b75a0459c1ab0b1c: No bootstrap required, opened a new log
Aug 12 00:05:47 dist-test-slave-f0tn krb5kdc[13878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493147, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:05:47.478888 14023 raft_consensus.cc:348] T 00000000000000000000000000000000 P cdb55c620f874546b75a0459c1ab0b1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdb55c620f874546b75a0459c1ab0b1c" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 41191 } }
I20260812 00:05:47.479061 14023 raft_consensus.cc:374] T 00000000000000000000000000000000 P cdb55c620f874546b75a0459c1ab0b1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:47.479120 14023 raft_consensus.cc:729] T 00000000000000000000000000000000 P cdb55c620f874546b75a0459c1ab0b1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cdb55c620f874546b75a0459c1ab0b1c, State: Initialized, Role: FOLLOWER
I20260812 00:05:47.479256 14023 consensus_queue.cc:260] T 00000000000000000000000000000000 P cdb55c620f874546b75a0459c1ab0b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdb55c620f874546b75a0459c1ab0b1c" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 41191 } }
I20260812 00:05:47.479348 14023 raft_consensus.cc:388] T 00000000000000000000000000000000 P cdb55c620f874546b75a0459c1ab0b1c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:05:47.479387 14023 raft_consensus.cc:482] T 00000000000000000000000000000000 P cdb55c620f874546b75a0459c1ab0b1c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:05:47.479436 14023 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cdb55c620f874546b75a0459c1ab0b1c [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:47.480058 14023 raft_consensus.cc:504] T 00000000000000000000000000000000 P cdb55c620f874546b75a0459c1ab0b1c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdb55c620f874546b75a0459c1ab0b1c" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 41191 } }
I20260812 00:05:47.480177 14023 leader_election.cc:302] T 00000000000000000000000000000000 P cdb55c620f874546b75a0459c1ab0b1c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cdb55c620f874546b75a0459c1ab0b1c; no voters:
I20260812 00:05:47.480345 14023 leader_election.cc:288] T 00000000000000000000000000000000 P cdb55c620f874546b75a0459c1ab0b1c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:05:47.480388 14030 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cdb55c620f874546b75a0459c1ab0b1c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:05:47.480535 14030 raft_consensus.cc:686] T 00000000000000000000000000000000 P cdb55c620f874546b75a0459c1ab0b1c [term 1 LEADER]: Becoming Leader. State: Replica: cdb55c620f874546b75a0459c1ab0b1c, State: Running, Role: LEADER
I20260812 00:05:47.480598 14023 sys_catalog.cc:564] T 00000000000000000000000000000000 P cdb55c620f874546b75a0459c1ab0b1c [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:05:47.480628 14030 consensus_queue.cc:237] T 00000000000000000000000000000000 P cdb55c620f874546b75a0459c1ab0b1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdb55c620f874546b75a0459c1ab0b1c" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 41191 } }
I20260812 00:05:47.480963 14030 sys_catalog.cc:455] T 00000000000000000000000000000000 P cdb55c620f874546b75a0459c1ab0b1c [sys.catalog]: SysCatalogTable state changed. Reason: New leader cdb55c620f874546b75a0459c1ab0b1c. Latest consensus state: current_term: 1 leader_uuid: "cdb55c620f874546b75a0459c1ab0b1c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdb55c620f874546b75a0459c1ab0b1c" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 41191 } } }
I20260812 00:05:47.481051 14030 sys_catalog.cc:458] T 00000000000000000000000000000000 P cdb55c620f874546b75a0459c1ab0b1c [sys.catalog]: This master's current role is: LEADER
I20260812 00:05:47.480969 14033 sys_catalog.cc:455] T 00000000000000000000000000000000 P cdb55c620f874546b75a0459c1ab0b1c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cdb55c620f874546b75a0459c1ab0b1c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdb55c620f874546b75a0459c1ab0b1c" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 41191 } } }
I20260812 00:05:47.481194 14033 sys_catalog.cc:458] T 00000000000000000000000000000000 P cdb55c620f874546b75a0459c1ab0b1c [sys.catalog]: This master's current role is: LEADER
I20260812 00:05:47.481510 14043 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:05:47.482090 14043 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:05:47.482704 14026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:47.472112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38714 (local address 127.11.206.126:41191)
0812 00:05:47.472290 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:47.472303 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:47.472329 (+ 26us) server_negotiation.cc:407] Connection header received
0812 00:05:47.472767 (+ 438us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:47.472774 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:47.472822 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:47.472936 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:47.473748 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:47.474634 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:47.475652 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:47.476090 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:47.476170 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:47.478644 (+ 2474us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:47.478648 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:47.478648 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:47.478659 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:47.480550 (+ 1891us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:47.480987 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:47.480990 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:47.480991 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:47.481124 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:47.481355 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:47.481356 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:47.481356 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:47.481735 (+ 379us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:47.482347 (+ 612us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:47.482423 (+ 76us) server_negotiation.cc:299] Negotiation successful
0812 00:05:47.482553 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":130,"thread_start_us":78,"threads_started":1}
I20260812 00:05:47.486316 14043 catalog_manager.cc:1347] Generated new cluster ID: 44c39bb242234dc59e1e901f07d192b1
I20260812 00:05:47.486372 14043 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:05:47.495106 14043 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:05:47.495859 14043 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:05:47.503019 14043 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cdb55c620f874546b75a0459c1ab0b1c: Generated new TSK 0
I20260812 00:05:47.503218 14043 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.206.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.65.keytab.
Entry for principal kudu/127.11.206.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.65.keytab.
I20260812 00:05:47.528963 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.65:0
--local_ip_for_outbound_sockets=127.11.206.65
--webserver_interface=127.11.206.65
--webserver_port=0
--tserver_master_addrs=127.11.206.126:41191
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.65.keytab
--principal=kudu/127.11.206.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:40815
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:05:47.609395 14069 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:47.609630 14069 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:47.609665 14069 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:47.610818 14069 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:47.610857 14069 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:47.610893 14069 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.65
I20260812 00:05:47.612349 14069 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:40815
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.65.keytab
--principal=kudu/127.11.206.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.206.65
--webserver_port=0
--tserver_master_addrs=127.11.206.126:41191
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14069
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.65
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:05:47.612588 14069 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:47.612812 14069 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:47.617770 14079 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:47.617766 14080 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:47.617952 14069 server_base.cc:1034] running on GCE node
W20260812 00:05:47.617833 14085 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:47.618300 14069 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:47.618573 14069 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:47.619724 14069 hybrid_clock.cc:648] HybridClock initialized: now 1786493147619706 us; error 29 us; skew 500 ppm
Aug 12 00:05:47 dist-test-slave-f0tn krb5kdc[13878](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493147, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:47.622301 14069 init.cc:377] Logged in from keytab as kudu/127.11.206.65@KRBTEST.COM (short username kudu)
I20260812 00:05:47.622735 14069 webserver.cc:460] Webserver started at http://127.11.206.65:41949/ using document root <none> and password file <none>
I20260812 00:05:47.622938 14069 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:47.622987 14069 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:47.623112 14069 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:47.624172 14069 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/minicluster-data/ts-0/data/instance:
uuid: "0b6e6a0a88d2436380357f5d4b69d777"
format_stamp: "Formatted at 2026-08-12 00:05:47 on dist-test-slave-f0tn"
server_key: "8c4bd765871d4f2d86eda49a1e0665ab"
server_key_iv: "b692307f275b9cf09c19e62193cd4f4e"
server_key_version: "encryptionkey@0"
I20260812 00:05:47.624526 14069 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/minicluster-data/ts-0/wal/instance:
uuid: "0b6e6a0a88d2436380357f5d4b69d777"
format_stamp: "Formatted at 2026-08-12 00:05:47 on dist-test-slave-f0tn"
server_key: "8c4bd765871d4f2d86eda49a1e0665ab"
server_key_iv: "b692307f275b9cf09c19e62193cd4f4e"
server_key_version: "encryptionkey@0"
I20260812 00:05:47.625821 14069 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 00:05:47.626536 14096 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:47.626704 14069 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 00:05:47.626791 14069 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/minicluster-data/ts-0/wal
uuid: "0b6e6a0a88d2436380357f5d4b69d777"
format_stamp: "Formatted at 2026-08-12 00:05:47 on dist-test-slave-f0tn"
server_key: "8c4bd765871d4f2d86eda49a1e0665ab"
server_key_iv: "b692307f275b9cf09c19e62193cd4f4e"
server_key_version: "encryptionkey@0"
I20260812 00:05:47.626850 14069 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:47.637357 14069 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:47.639499 14069 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:47.639629 14069 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:47.639832 14069 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:05:47.640129 14069 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:05:47.640163 14069 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:47.640192 14069 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:05:47.640223 14069 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:47.645955 14069 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.65:38447
I20260812 00:05:47.646049 14298 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.65:38447 every 8 connection(s)
I20260812 00:05:47.646333 14069 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
Aug 12 00:05:47 dist-test-slave-f0tn krb5kdc[13878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493147, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.65@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:05:47.654039 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 14069
I20260812 00:05:47.654150 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/minicluster-data/ts-0/wal/instance
I20260812 00:05:47.654361 12089 external_mini_cluster.cc:1428] Setting key a661fd4fad376507acc78eb0342c4f81
I20260812 00:05:47.655323 14026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:47.647018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.65:43477 (local address 127.11.206.126:41191)
0812 00:05:47.647091 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:47.647094 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:47.647247 (+ 153us) server_negotiation.cc:407] Connection header received
0812 00:05:47.647726 (+ 479us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:47.647727 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:47.647736 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:47.647786 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:47.648743 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:47.649246 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:47.650303 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:47.650512 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:47.650560 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:47.652665 (+ 2105us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:47.652666 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:47.652666 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:47.652673 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:47.653910 (+ 1237us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:47.654328 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:47.654329 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:47.654330 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:47.654397 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:47.654666 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:47.654667 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:47.654668 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:47.654798 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:47.654852 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:47.655139 (+ 287us) server_negotiation.cc:299] Negotiation successful
0812 00:05:47.655233 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260812 00:05:47.655439 14307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:47.646974 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:41191 (local address 127.11.206.65:43477)
0812 00:05:47.647133 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:47.647170 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:47.647642 (+ 472us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:47.647838 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:47.647841 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:47.648429 (+ 588us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:47.648673 (+ 244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:47.648679 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:47.649323 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:47.649324 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:47.650223 (+ 899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:47.650226 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:47.650570 (+ 344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:47.650571 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:47.650686 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:47.651165 (+ 479us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:47.651174 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:47.652553 (+ 1379us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:47.653992 (+ 1439us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:47.653997 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:47.653999 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:47.654260 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:47.654483 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:47.654485 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:47.654485 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:47.654616 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:47.654867 (+ 251us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:47.654874 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:47.655020 (+ 146us) client_negotiation.cc:769] Sending connection context
0812 00:05:47.655107 (+ 87us) client_negotiation.cc:240] Negotiation successful
0812 00:05:47.655253 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":77,"threads_started":1}
I20260812 00:05:47.655923 14300 heartbeater.cc:347] Connected to a master server at 127.11.206.126:41191
I20260812 00:05:47.656020 14300 heartbeater.cc:464] Registering TS with master...
I20260812 00:05:47.656199 14300 heartbeater.cc:511] Master 127.11.206.126:41191 requested a full tablet report, sending...
I20260812 00:05:47.656771 13958 ts_manager.cc:194] Registered new tserver with Master: 0b6e6a0a88d2436380357f5d4b69d777 (127.11.206.65:38447)
I20260812 00:05:47.657346 13958 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.206.65@KRBTEST.COM'} at 127.11.206.65:43477
WARNING: no policy specified for kudu/127.11.206.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.66.keytab.
Entry for principal kudu/127.11.206.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.66.keytab.
I20260812 00:05:47.678021 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.66:0
--local_ip_for_outbound_sockets=127.11.206.66
--webserver_interface=127.11.206.66
--webserver_port=0
--tserver_master_addrs=127.11.206.126:41191
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.66.keytab
--principal=kudu/127.11.206.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:40815
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:05:47.758360 14311 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:47.758567 14311 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:47.758590 14311 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:47.759732 14311 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:47.759773 14311 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:47.759797 14311 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.66
I20260812 00:05:47.761255 14311 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:40815
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.66.keytab
--principal=kudu/127.11.206.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.206.66
--webserver_port=0
--tserver_master_addrs=127.11.206.126:41191
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14311
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.66
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:05:47.761499 14311 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:47.761729 14311 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:47.766723 14321 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:47.766774 14325 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:47.766799 14311 server_base.cc:1034] running on GCE node
W20260812 00:05:47.766723 14323 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:47.767161 14311 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:47.767416 14311 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:47.768553 14311 hybrid_clock.cc:648] HybridClock initialized: now 1786493147768539 us; error 29 us; skew 500 ppm
Aug 12 00:05:47 dist-test-slave-f0tn krb5kdc[13878](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493147, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:47.770951 14311 init.cc:377] Logged in from keytab as kudu/127.11.206.66@KRBTEST.COM (short username kudu)
I20260812 00:05:47.771380 14311 webserver.cc:460] Webserver started at http://127.11.206.66:40643/ using document root <none> and password file <none>
I20260812 00:05:47.771592 14311 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:47.771641 14311 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:47.771770 14311 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:47.772783 14311 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/minicluster-data/ts-1/data/instance:
uuid: "cbd144f1d8a349c0a182ca1c0bbbc1e3"
format_stamp: "Formatted at 2026-08-12 00:05:47 on dist-test-slave-f0tn"
server_key: "f7ad04c33d61e8c983ce36fc9ed32d9c"
server_key_iv: "296215488b0a3a96395f98fc352410d8"
server_key_version: "encryptionkey@0"
I20260812 00:05:47.773111 14311 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/minicluster-data/ts-1/wal/instance:
uuid: "cbd144f1d8a349c0a182ca1c0bbbc1e3"
format_stamp: "Formatted at 2026-08-12 00:05:47 on dist-test-slave-f0tn"
server_key: "f7ad04c33d61e8c983ce36fc9ed32d9c"
server_key_iv: "296215488b0a3a96395f98fc352410d8"
server_key_version: "encryptionkey@0"
I20260812 00:05:47.774422 14311 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:05:47.775143 14337 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:47.775290 14311 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:05:47.775374 14311 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/minicluster-data/ts-1/wal
uuid: "cbd144f1d8a349c0a182ca1c0bbbc1e3"
format_stamp: "Formatted at 2026-08-12 00:05:47 on dist-test-slave-f0tn"
server_key: "f7ad04c33d61e8c983ce36fc9ed32d9c"
server_key_iv: "296215488b0a3a96395f98fc352410d8"
server_key_version: "encryptionkey@0"
I20260812 00:05:47.775440 14311 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:47.783556 14311 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:47.785288 14311 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:47.785440 14311 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:47.785645 14311 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:05:47.785930 14311 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:05:47.785964 14311 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:47.785992 14311 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:05:47.786016 14311 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:47.791383 14311 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.66:36347
I20260812 00:05:47.791445 14545 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.66:36347 every 8 connection(s)
I20260812 00:05:47.791725 14311 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
I20260812 00:05:47.792433 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 14311
I20260812 00:05:47.792550 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/minicluster-data/ts-1/wal/instance
I20260812 00:05:47.792726 12089 external_mini_cluster.cc:1428] Setting key dd872ee9174bc2e3a9e41cd6b4f907b6
Aug 12 00:05:47 dist-test-slave-f0tn krb5kdc[13878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493147, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.66@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:05:47.801194 14026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:47.792418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.66:36777 (local address 127.11.206.126:41191)
0812 00:05:47.792481 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:47.792483 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:47.792654 (+ 171us) server_negotiation.cc:407] Connection header received
0812 00:05:47.793150 (+ 496us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:47.793151 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:47.793161 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:47.793220 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:47.794176 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:47.794729 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:47.795719 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:47.795915 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:47.795970 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:47.798285 (+ 2315us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:47.798287 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:47.798287 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:47.798294 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:47.799623 (+ 1329us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:47.800144 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:47.800146 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:47.800146 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:47.800214 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:47.800519 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:47.800520 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:47.800521 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:47.800645 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:47.800705 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:47.801048 (+ 343us) server_negotiation.cc:299] Negotiation successful
0812 00:05:47.801126 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260812 00:05:47.801553 14553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:47.792367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:41191 (local address 127.11.206.66:36777)
0812 00:05:47.792533 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:47.792573 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:47.793065 (+ 492us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:47.793286 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:47.793291 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:47.793894 (+ 603us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:47.794082 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:47.794086 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:47.794836 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:47.794837 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:47.795633 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:47.795635 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:47.795977 (+ 342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:47.795977 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:47.796076 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:47.796579 (+ 503us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:47.796587 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:47.798151 (+ 1564us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:47.799703 (+ 1552us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:47.799711 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:47.799714 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:47.800014 (+ 300us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:47.800290 (+ 276us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:47.800291 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:47.800292 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:47.800433 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:47.800714 (+ 281us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:47.800721 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:47.800896 (+ 175us) client_negotiation.cc:769] Sending connection context
0812 00:05:47.801025 (+ 129us) client_negotiation.cc:240] Negotiation successful
0812 00:05:47.801222 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":89,"threads_started":1}
WARNING: no policy specified for kudu/127.11.206.67@KRBTEST.COM; defaulting to no policy
I20260812 00:05:47.802196 14546 heartbeater.cc:347] Connected to a master server at 127.11.206.126:41191
I20260812 00:05:47.802291 14546 heartbeater.cc:464] Registering TS with master...
I20260812 00:05:47.802448 14546 heartbeater.cc:511] Master 127.11.206.126:41191 requested a full tablet report, sending...
I20260812 00:05:47.802896 13958 ts_manager.cc:194] Registered new tserver with Master: cbd144f1d8a349c0a182ca1c0bbbc1e3 (127.11.206.66:36347)
I20260812 00:05:47.803253 13958 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.206.66@KRBTEST.COM'} at 127.11.206.66:36777
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.67.keytab.
Entry for principal kudu/127.11.206.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.67.keytab.
I20260812 00:05:47.817770 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.67:0
--local_ip_for_outbound_sockets=127.11.206.67
--webserver_interface=127.11.206.67
--webserver_port=0
--tserver_master_addrs=127.11.206.126:41191
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.67.keytab
--principal=kudu/127.11.206.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:40815
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:05:47.899132 14557 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:47.899353 14557 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:47.899384 14557 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:47.900552 14557 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:47.900597 14557 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:47.900633 14557 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.67
I20260812 00:05:47.902230 14557 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:40815
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.67.keytab
--principal=kudu/127.11.206.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.206.67
--webserver_port=0
--tserver_master_addrs=127.11.206.126:41191
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14557
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.67
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:05:47.902488 14557 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:47.902719 14557 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:47.907640 14567 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:47.907835 14572 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:47.907867 14565 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:47.908074 14557 server_base.cc:1034] running on GCE node
I20260812 00:05:47.908298 14557 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:47.908532 14557 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:47.909685 14557 hybrid_clock.cc:648] HybridClock initialized: now 1786493147909664 us; error 34 us; skew 500 ppm
Aug 12 00:05:47 dist-test-slave-f0tn krb5kdc[13878](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493147, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:47.912276 14557 init.cc:377] Logged in from keytab as kudu/127.11.206.67@KRBTEST.COM (short username kudu)
I20260812 00:05:47.912741 14557 webserver.cc:460] Webserver started at http://127.11.206.67:39771/ using document root <none> and password file <none>
I20260812 00:05:47.912946 14557 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:47.912994 14557 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:47.913121 14557 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:47.914211 14557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/minicluster-data/ts-2/data/instance:
uuid: "866e6712808c494ea87b6456fba37ce4"
format_stamp: "Formatted at 2026-08-12 00:05:47 on dist-test-slave-f0tn"
server_key: "7bdc37cd54ff43fa534a7138e09e706c"
server_key_iv: "a150e60ce14be182d80cdf2452481745"
server_key_version: "encryptionkey@0"
I20260812 00:05:47.914549 14557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/minicluster-data/ts-2/wal/instance:
uuid: "866e6712808c494ea87b6456fba37ce4"
format_stamp: "Formatted at 2026-08-12 00:05:47 on dist-test-slave-f0tn"
server_key: "7bdc37cd54ff43fa534a7138e09e706c"
server_key_iv: "a150e60ce14be182d80cdf2452481745"
server_key_version: "encryptionkey@0"
I20260812 00:05:47.915815 14557 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260812 00:05:47.916465 14584 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:47.916630 14557 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 00:05:47.916726 14557 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/minicluster-data/ts-2/wal
uuid: "866e6712808c494ea87b6456fba37ce4"
format_stamp: "Formatted at 2026-08-12 00:05:47 on dist-test-slave-f0tn"
server_key: "7bdc37cd54ff43fa534a7138e09e706c"
server_key_iv: "a150e60ce14be182d80cdf2452481745"
server_key_version: "encryptionkey@0"
I20260812 00:05:47.916786 14557 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:47.937068 14557 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:47.939378 14557 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:47.939525 14557 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:47.939764 14557 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:05:47.940076 14557 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:05:47.940111 14557 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:47.940141 14557 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:05:47.940166 14557 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:47.945725 14557 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.67:45129
I20260812 00:05:47.945770 14782 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.67:45129 every 8 connection(s)
I20260812 00:05:47.946110 14557 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
Aug 12 00:05:47 dist-test-slave-f0tn krb5kdc[13878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493147, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.67@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:05:47.952616 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 14557
I20260812 00:05:47.952725 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/minicluster-data/ts-2/wal/instance
I20260812 00:05:47.952922 12089 external_mini_cluster.cc:1428] Setting key 51f61de77ed569d079605b12cab45a46
I20260812 00:05:47.955392 14026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:47.946815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.67:38335 (local address 127.11.206.126:41191)
0812 00:05:47.946873 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:47.946875 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:47.947073 (+ 198us) server_negotiation.cc:407] Connection header received
0812 00:05:47.947566 (+ 493us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:47.947567 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:47.947579 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:47.947641 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:47.948603 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:47.949106 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:47.950204 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:47.950405 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:47.950467 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:47.952588 (+ 2121us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:47.952590 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:47.952590 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:47.952597 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:47.953971 (+ 1374us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:47.954346 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:47.954347 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:47.954348 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:47.954407 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:47.954626 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:47.954627 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:47.954627 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:47.954755 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:47.954810 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:47.955201 (+ 391us) server_negotiation.cc:299] Negotiation successful
0812 00:05:47.955300 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260812 00:05:47.955557 14791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:47.946786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:41191 (local address 127.11.206.67:38335)
0812 00:05:47.946950 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:47.946995 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:47.947459 (+ 464us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:47.947708 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:47.947712 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:47.948295 (+ 583us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:47.948535 (+ 240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:47.948540 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:47.949175 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:47.949176 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:47.950129 (+ 953us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:47.950131 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:47.950517 (+ 386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:47.950518 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:47.950651 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:47.951144 (+ 493us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:05:47.951152 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:47.952498 (+ 1346us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:47.954048 (+ 1550us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:47.954055 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:47.954057 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:47.954280 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:47.954461 (+ 181us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:05:47.954462 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:05:47.954462 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:05:47.954572 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:05:47.954811 (+ 239us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:47.954817 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:47.955027 (+ 210us) client_negotiation.cc:769] Sending connection context
0812 00:05:47.955155 (+ 128us) client_negotiation.cc:240] Negotiation successful
0812 00:05:47.955334 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":85,"threads_started":1}
I20260812 00:05:47.955981 14785 heartbeater.cc:347] Connected to a master server at 127.11.206.126:41191
I20260812 00:05:47.956077 14785 heartbeater.cc:464] Registering TS with master...
I20260812 00:05:47.956267 14785 heartbeater.cc:511] Master 127.11.206.126:41191 requested a full tablet report, sending...
I20260812 00:05:47.956620 13958 ts_manager.cc:194] Registered new tserver with Master: 866e6712808c494ea87b6456fba37ce4 (127.11.206.67:45129)
I20260812 00:05:47.956981 13958 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.206.67@KRBTEST.COM'} at 127.11.206.67:38335
I20260812 00:05:47.964689 12089 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:05:47.971872 14026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:47.966136 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38720 (local address 127.11.206.126:41191)
0812 00:05:47.966193 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:47.966195 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:47.966272 (+ 77us) server_negotiation.cc:407] Connection header received
0812 00:05:47.966321 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:47.966322 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:47.966330 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:47.966379 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:47.966974 (+ 595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:47.967477 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:47.968206 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:47.968403 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:47.968475 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:47.969646 (+ 1171us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:47.969647 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:47.969647 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:47.969655 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:47.970878 (+ 1223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:47.971165 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:47.971166 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:47.971166 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:47.971210 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:47.971349 (+ 139us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:47.971349 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:47.971350 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:47.971499 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:47.971569 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:47.971696 (+ 127us) server_negotiation.cc:299] Negotiation successful
0812 00:05:47.971778 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260812 00:05:47.973281 13958 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38720:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:05:47.974892 13958 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:05:47.981264 14803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:47.977121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37774 (local address 127.11.206.67:45129)
0812 00:05:47.977327 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:47.977331 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:47.977432 (+ 101us) server_negotiation.cc:407] Connection header received
0812 00:05:47.977546 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:47.977549 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:47.977566 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:47.977642 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:05:47.977931 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:47.978719 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:47.980107 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:47.980853 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:47.980922 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:47.981036 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:47.981138 (+ 102us) server_negotiation.cc:299] Negotiation successful
0812 00:05:47.981181 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":180,"thread_start_us":83,"threads_started":1}
I20260812 00:05:47.981273 14800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:47.976877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.67:45129 (local address 127.0.0.1:37774)
0812 00:05:47.977324 (+ 447us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:47.977360 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:47.977452 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:47.977775 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:47.977779 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:47.977781 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:05:47.977847 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:47.977849 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:47.978818 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:47.978819 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:47.980025 (+ 1206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:47.980028 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:47.980933 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:47.980934 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:47.981012 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:47.981028 (+ 16us) client_negotiation.cc:769] Sending connection context
0812 00:05:47.981109 (+ 81us) client_negotiation.cc:240] Negotiation successful
0812 00:05:47.981165 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":420,"thread_start_us":86,"threads_started":1}
I20260812 00:05:47.981573 14804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:47.977150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51716 (local address 127.11.206.66:36347)
0812 00:05:47.977429 (+ 279us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:47.977432 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:47.977611 (+ 179us) server_negotiation.cc:407] Connection header received
0812 00:05:47.977653 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:47.977656 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:47.977671 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:47.977738 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:05:47.977932 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:47.979138 (+ 1206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:47.980196 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:47.980852 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:47.980919 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:47.980980 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:47.981457 (+ 477us) server_negotiation.cc:299] Negotiation successful
0812 00:05:47.981499 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":244,"thread_start_us":86,"threads_started":1}
I20260812 00:05:47.981647 14798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:47.976881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.65:38447 (local address 127.0.0.1:38186)
0812 00:05:47.977572 (+ 691us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:47.977580 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:47.977622 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:47.977889 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:47.977890 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:47.977892 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:05:47.977938 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:47.977939 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:47.979260 (+ 1321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:47.979261 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:47.980451 (+ 1190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:47.980453 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:47.981436 (+ 983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:47.981437 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:47.981496 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:47.981501 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 00:05:47.981548 (+ 47us) client_negotiation.cc:240] Negotiation successful
0812 00:05:47.981582 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":682,"mutex_wait_us":31,"spinlock_wait_cycles":896,"thread_start_us":74,"threads_started":1}
I20260812 00:05:47.981927 14802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:47.977103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38186 (local address 127.11.206.65:38447)
0812 00:05:47.977293 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:47.977299 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:47.977674 (+ 375us) server_negotiation.cc:407] Connection header received
0812 00:05:47.977722 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:47.977724 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:47.977740 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:47.977808 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:05:47.978062 (+ 254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:47.979158 (+ 1096us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:47.980521 (+ 1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:47.981105 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:47.981160 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:47.981214 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:47.981811 (+ 597us) server_negotiation.cc:299] Negotiation successful
0812 00:05:47.981852 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":94,"threads_started":1}
I20260812 00:05:47.982133 14666 tablet_service.cc:1467] Processing CreateTablet for tablet 40bc01191d60411fb5f5e56cd7516bad (DEFAULT_TABLE table=test-table [id=d5ac05244e0f4ed1826d4188c472f08f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:05:47.982457 14666 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 40bc01191d60411fb5f5e56cd7516bad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:47.982616 14184 tablet_service.cc:1467] Processing CreateTablet for tablet 40bc01191d60411fb5f5e56cd7516bad (DEFAULT_TABLE table=test-table [id=d5ac05244e0f4ed1826d4188c472f08f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:05:47.982924 14184 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 40bc01191d60411fb5f5e56cd7516bad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:47.985106 14807 tablet_bootstrap.cc:492] T 40bc01191d60411fb5f5e56cd7516bad P 866e6712808c494ea87b6456fba37ce4: Bootstrap starting.
I20260812 00:05:47.985152 14801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:47.976880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.66:36347 (local address 127.0.0.1:51716)
0812 00:05:47.977457 (+ 577us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:47.977467 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:47.977515 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:47.977819 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:47.977820 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:47.977821 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:05:47.977860 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:47.977861 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:47.979257 (+ 1396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:47.979258 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:47.980067 (+ 809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:47.980070 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:47.981047 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:47.981048 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:47.981114 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:47.981119 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 00:05:47.981159 (+ 40us) client_negotiation.cc:240] Negotiation successful
0812 00:05:47.981195 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":565,"mutex_wait_us":39,"thread_start_us":73,"threads_started":1}
I20260812 00:05:47.985605 14808 tablet_bootstrap.cc:492] T 40bc01191d60411fb5f5e56cd7516bad P 0b6e6a0a88d2436380357f5d4b69d777: Bootstrap starting.
I20260812 00:05:47.986006 14807 tablet_bootstrap.cc:654] T 40bc01191d60411fb5f5e56cd7516bad P 866e6712808c494ea87b6456fba37ce4: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:47.985903 14424 tablet_service.cc:1467] Processing CreateTablet for tablet 40bc01191d60411fb5f5e56cd7516bad (DEFAULT_TABLE table=test-table [id=d5ac05244e0f4ed1826d4188c472f08f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:05:47.986160 14808 tablet_bootstrap.cc:654] T 40bc01191d60411fb5f5e56cd7516bad P 0b6e6a0a88d2436380357f5d4b69d777: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:47.986217 14424 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 40bc01191d60411fb5f5e56cd7516bad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:47.986585 14807 log.cc:824] T 40bc01191d60411fb5f5e56cd7516bad P 866e6712808c494ea87b6456fba37ce4: Log is configured to *not* fsync() on all Append() calls
I20260812 00:05:47.986621 14808 log.cc:824] T 40bc01191d60411fb5f5e56cd7516bad P 0b6e6a0a88d2436380357f5d4b69d777: Log is configured to *not* fsync() on all Append() calls
I20260812 00:05:47.987371 14807 tablet_bootstrap.cc:492] T 40bc01191d60411fb5f5e56cd7516bad P 866e6712808c494ea87b6456fba37ce4: No bootstrap required, opened a new log
I20260812 00:05:47.987418 14808 tablet_bootstrap.cc:492] T 40bc01191d60411fb5f5e56cd7516bad P 0b6e6a0a88d2436380357f5d4b69d777: No bootstrap required, opened a new log
I20260812 00:05:47.987445 14807 ts_tablet_manager.cc:1397] T 40bc01191d60411fb5f5e56cd7516bad P 866e6712808c494ea87b6456fba37ce4: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260812 00:05:47.987475 14808 ts_tablet_manager.cc:1397] T 40bc01191d60411fb5f5e56cd7516bad P 0b6e6a0a88d2436380357f5d4b69d777: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 00:05:47.988853 14808 raft_consensus.cc:348] T 40bc01191d60411fb5f5e56cd7516bad P 0b6e6a0a88d2436380357f5d4b69d777 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b6e6a0a88d2436380357f5d4b69d777" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 38447 } } peers { permanent_uuid: "866e6712808c494ea87b6456fba37ce4" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 45129 } } peers { permanent_uuid: "cbd144f1d8a349c0a182ca1c0bbbc1e3" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 36347 } }
I20260812 00:05:47.988998 14808 raft_consensus.cc:374] T 40bc01191d60411fb5f5e56cd7516bad P 0b6e6a0a88d2436380357f5d4b69d777 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:47.989032 14808 raft_consensus.cc:729] T 40bc01191d60411fb5f5e56cd7516bad P 0b6e6a0a88d2436380357f5d4b69d777 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b6e6a0a88d2436380357f5d4b69d777, State: Initialized, Role: FOLLOWER
I20260812 00:05:47.989149 14808 consensus_queue.cc:260] T 40bc01191d60411fb5f5e56cd7516bad P 0b6e6a0a88d2436380357f5d4b69d777 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b6e6a0a88d2436380357f5d4b69d777" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 38447 } } peers { permanent_uuid: "866e6712808c494ea87b6456fba37ce4" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 45129 } } peers { permanent_uuid: "cbd144f1d8a349c0a182ca1c0bbbc1e3" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 36347 } }
I20260812 00:05:47.989466 14300 heartbeater.cc:503] Master 127.11.206.126:41191 was elected leader, sending a full tablet report...
I20260812 00:05:47.989427 14807 raft_consensus.cc:348] T 40bc01191d60411fb5f5e56cd7516bad P 866e6712808c494ea87b6456fba37ce4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b6e6a0a88d2436380357f5d4b69d777" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 38447 } } peers { permanent_uuid: "866e6712808c494ea87b6456fba37ce4" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 45129 } } peers { permanent_uuid: "cbd144f1d8a349c0a182ca1c0bbbc1e3" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 36347 } }
I20260812 00:05:47.989570 14808 ts_tablet_manager.cc:1428] T 40bc01191d60411fb5f5e56cd7516bad P 0b6e6a0a88d2436380357f5d4b69d777: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 00:05:47.989595 14807 raft_consensus.cc:374] T 40bc01191d60411fb5f5e56cd7516bad P 866e6712808c494ea87b6456fba37ce4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:47.989629 14807 raft_consensus.cc:729] T 40bc01191d60411fb5f5e56cd7516bad P 866e6712808c494ea87b6456fba37ce4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 866e6712808c494ea87b6456fba37ce4, State: Initialized, Role: FOLLOWER
I20260812 00:05:47.989756 14819 tablet_bootstrap.cc:492] T 40bc01191d60411fb5f5e56cd7516bad P cbd144f1d8a349c0a182ca1c0bbbc1e3: Bootstrap starting.
I20260812 00:05:47.989864 14807 consensus_queue.cc:260] T 40bc01191d60411fb5f5e56cd7516bad P 866e6712808c494ea87b6456fba37ce4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b6e6a0a88d2436380357f5d4b69d777" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 38447 } } peers { permanent_uuid: "866e6712808c494ea87b6456fba37ce4" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 45129 } } peers { permanent_uuid: "cbd144f1d8a349c0a182ca1c0bbbc1e3" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 36347 } }
I20260812 00:05:47.990155 14785 heartbeater.cc:503] Master 127.11.206.126:41191 was elected leader, sending a full tablet report...
I20260812 00:05:47.990144 14807 ts_tablet_manager.cc:1428] T 40bc01191d60411fb5f5e56cd7516bad P 866e6712808c494ea87b6456fba37ce4: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260812 00:05:47.990386 14819 tablet_bootstrap.cc:654] T 40bc01191d60411fb5f5e56cd7516bad P cbd144f1d8a349c0a182ca1c0bbbc1e3: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:47.990911 14819 log.cc:824] T 40bc01191d60411fb5f5e56cd7516bad P cbd144f1d8a349c0a182ca1c0bbbc1e3: Log is configured to *not* fsync() on all Append() calls
I20260812 00:05:47.991552 14819 tablet_bootstrap.cc:492] T 40bc01191d60411fb5f5e56cd7516bad P cbd144f1d8a349c0a182ca1c0bbbc1e3: No bootstrap required, opened a new log
I20260812 00:05:47.991613 14819 ts_tablet_manager.cc:1397] T 40bc01191d60411fb5f5e56cd7516bad P cbd144f1d8a349c0a182ca1c0bbbc1e3: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 00:05:47.993044 14819 raft_consensus.cc:348] T 40bc01191d60411fb5f5e56cd7516bad P cbd144f1d8a349c0a182ca1c0bbbc1e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b6e6a0a88d2436380357f5d4b69d777" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 38447 } } peers { permanent_uuid: "866e6712808c494ea87b6456fba37ce4" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 45129 } } peers { permanent_uuid: "cbd144f1d8a349c0a182ca1c0bbbc1e3" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 36347 } }
I20260812 00:05:47.993177 14819 raft_consensus.cc:374] T 40bc01191d60411fb5f5e56cd7516bad P cbd144f1d8a349c0a182ca1c0bbbc1e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:47.993207 14819 raft_consensus.cc:729] T 40bc01191d60411fb5f5e56cd7516bad P cbd144f1d8a349c0a182ca1c0bbbc1e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbd144f1d8a349c0a182ca1c0bbbc1e3, State: Initialized, Role: FOLLOWER
I20260812 00:05:47.993316 14819 consensus_queue.cc:260] T 40bc01191d60411fb5f5e56cd7516bad P cbd144f1d8a349c0a182ca1c0bbbc1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b6e6a0a88d2436380357f5d4b69d777" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 38447 } } peers { permanent_uuid: "866e6712808c494ea87b6456fba37ce4" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 45129 } } peers { permanent_uuid: "cbd144f1d8a349c0a182ca1c0bbbc1e3" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 36347 } }
I20260812 00:05:47.993561 14819 ts_tablet_manager.cc:1428] T 40bc01191d60411fb5f5e56cd7516bad P cbd144f1d8a349c0a182ca1c0bbbc1e3: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 00:05:47.993594 14546 heartbeater.cc:503] Master 127.11.206.126:41191 was elected leader, sending a full tablet report...
W20260812 00:05:48.042273 14548 tablet.cc:2369] T 40bc01191d60411fb5f5e56cd7516bad P cbd144f1d8a349c0a182ca1c0bbbc1e3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:05:48.060726 14829 raft_consensus.cc:482] T 40bc01191d60411fb5f5e56cd7516bad P cbd144f1d8a349c0a182ca1c0bbbc1e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:05:48.060861 14829 raft_consensus.cc:504] T 40bc01191d60411fb5f5e56cd7516bad P cbd144f1d8a349c0a182ca1c0bbbc1e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b6e6a0a88d2436380357f5d4b69d777" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 38447 } } peers { permanent_uuid: "866e6712808c494ea87b6456fba37ce4" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 45129 } } peers { permanent_uuid: "cbd144f1d8a349c0a182ca1c0bbbc1e3" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 36347 } }
I20260812 00:05:48.061259 14829 leader_election.cc:288] T 40bc01191d60411fb5f5e56cd7516bad P cbd144f1d8a349c0a182ca1c0bbbc1e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b6e6a0a88d2436380357f5d4b69d777 (127.11.206.65:38447), 866e6712808c494ea87b6456fba37ce4 (127.11.206.67:45129)
I20260812 00:05:48.064545 14803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:48.061543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.66:34465 (local address 127.11.206.67:45129)
0812 00:05:48.061588 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:48.061589 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:48.061788 (+ 199us) server_negotiation.cc:407] Connection header received
0812 00:05:48.061843 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:48.061844 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:48.061854 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:48.061897 (+ 43us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:05:48.062027 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:48.062742 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:48.063829 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:48.064230 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:48.064293 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:48.064302 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:48.064430 (+ 128us) server_negotiation.cc:299] Negotiation successful
0812 00:05:48.064470 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260812 00:05:48.064548 14802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:48.061613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.66:40845 (local address 127.11.206.65:38447)
0812 00:05:48.061695 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:48.061696 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:48.061704 (+ 8us) server_negotiation.cc:407] Connection header received
0812 00:05:48.061734 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:48.061734 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:48.061742 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:48.061814 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:05:48.061970 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:48.062733 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:48.063813 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:48.064226 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:48.064293 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:48.064303 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:48.064432 (+ 129us) server_negotiation.cc:299] Negotiation successful
0812 00:05:48.064473 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260812 00:05:48.064566 14553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:48.061491 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.65:38447 (local address 127.11.206.66:40845)
0812 00:05:48.061560 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:48.061571 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:48.061617 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:48.061822 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:48.061824 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:48.061825 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:05:48.061903 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:48.061905 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:48.062855 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:48.062856 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:48.063720 (+ 864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:48.063722 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:48.064297 (+ 575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:48.064298 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:48.064371 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:48.064374 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:05:48.064419 (+ 45us) client_negotiation.cc:240] Negotiation successful
0812 00:05:48.064460 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48,"mutex_wait_us":47}
I20260812 00:05:48.064574 14831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:48.061491 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.67:45129 (local address 127.11.206.66:34465)
0812 00:05:48.061689 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:48.061700 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:48.061769 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:48.061911 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:48.061912 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:48.061913 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:05:48.061969 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:48.061970 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:48.062849 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:48.062850 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:48.063734 (+ 884us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:48.063737 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:48.064308 (+ 571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:48.064309 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:48.064371 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:48.064374 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:05:48.064418 (+ 44us) client_negotiation.cc:240] Negotiation successful
0812 00:05:48.064460 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"mutex_wait_us":64,"thread_start_us":107,"threads_started":1}
I20260812 00:05:48.064963 14220 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40bc01191d60411fb5f5e56cd7516bad" candidate_uuid: "cbd144f1d8a349c0a182ca1c0bbbc1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b6e6a0a88d2436380357f5d4b69d777" is_pre_election: true
I20260812 00:05:48.065121 14220 raft_consensus.cc:2454] T 40bc01191d60411fb5f5e56cd7516bad P 0b6e6a0a88d2436380357f5d4b69d777 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbd144f1d8a349c0a182ca1c0bbbc1e3 in term 0.
I20260812 00:05:48.065323 14702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40bc01191d60411fb5f5e56cd7516bad" candidate_uuid: "cbd144f1d8a349c0a182ca1c0bbbc1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "866e6712808c494ea87b6456fba37ce4" is_pre_election: true
I20260812 00:05:48.065349 14338 leader_election.cc:302] T 40bc01191d60411fb5f5e56cd7516bad P cbd144f1d8a349c0a182ca1c0bbbc1e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b6e6a0a88d2436380357f5d4b69d777, cbd144f1d8a349c0a182ca1c0bbbc1e3; no voters:
I20260812 00:05:48.065483 14702 raft_consensus.cc:2454] T 40bc01191d60411fb5f5e56cd7516bad P 866e6712808c494ea87b6456fba37ce4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbd144f1d8a349c0a182ca1c0bbbc1e3 in term 0.
I20260812 00:05:48.065505 14829 raft_consensus.cc:2781] T 40bc01191d60411fb5f5e56cd7516bad P cbd144f1d8a349c0a182ca1c0bbbc1e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:05:48.065567 14829 raft_consensus.cc:482] T 40bc01191d60411fb5f5e56cd7516bad P cbd144f1d8a349c0a182ca1c0bbbc1e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:05:48.065599 14829 raft_consensus.cc:3037] T 40bc01191d60411fb5f5e56cd7516bad P cbd144f1d8a349c0a182ca1c0bbbc1e3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:48.066380 14829 raft_consensus.cc:504] T 40bc01191d60411fb5f5e56cd7516bad P cbd144f1d8a349c0a182ca1c0bbbc1e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b6e6a0a88d2436380357f5d4b69d777" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 38447 } } peers { permanent_uuid: "866e6712808c494ea87b6456fba37ce4" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 45129 } } peers { permanent_uuid: "cbd144f1d8a349c0a182ca1c0bbbc1e3" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 36347 } }
I20260812 00:05:48.066501 14829 leader_election.cc:288] T 40bc01191d60411fb5f5e56cd7516bad P cbd144f1d8a349c0a182ca1c0bbbc1e3 [CANDIDATE]: Term 1 election: Requested vote from peers 0b6e6a0a88d2436380357f5d4b69d777 (127.11.206.65:38447), 866e6712808c494ea87b6456fba37ce4 (127.11.206.67:45129)
I20260812 00:05:48.066658 14702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40bc01191d60411fb5f5e56cd7516bad" candidate_uuid: "cbd144f1d8a349c0a182ca1c0bbbc1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "866e6712808c494ea87b6456fba37ce4"
I20260812 00:05:48.066649 14220 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40bc01191d60411fb5f5e56cd7516bad" candidate_uuid: "cbd144f1d8a349c0a182ca1c0bbbc1e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b6e6a0a88d2436380357f5d4b69d777"
I20260812 00:05:48.066725 14702 raft_consensus.cc:3037] T 40bc01191d60411fb5f5e56cd7516bad P 866e6712808c494ea87b6456fba37ce4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:48.066725 14220 raft_consensus.cc:3037] T 40bc01191d60411fb5f5e56cd7516bad P 0b6e6a0a88d2436380357f5d4b69d777 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:48.067574 14220 raft_consensus.cc:2454] T 40bc01191d60411fb5f5e56cd7516bad P 0b6e6a0a88d2436380357f5d4b69d777 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbd144f1d8a349c0a182ca1c0bbbc1e3 in term 1.
I20260812 00:05:48.067574 14702 raft_consensus.cc:2454] T 40bc01191d60411fb5f5e56cd7516bad P 866e6712808c494ea87b6456fba37ce4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbd144f1d8a349c0a182ca1c0bbbc1e3 in term 1.
I20260812 00:05:48.067759 14342 leader_election.cc:302] T 40bc01191d60411fb5f5e56cd7516bad P cbd144f1d8a349c0a182ca1c0bbbc1e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 866e6712808c494ea87b6456fba37ce4, cbd144f1d8a349c0a182ca1c0bbbc1e3; no voters:
I20260812 00:05:48.067850 14829 raft_consensus.cc:2781] T 40bc01191d60411fb5f5e56cd7516bad P cbd144f1d8a349c0a182ca1c0bbbc1e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:05:48.068004 14829 raft_consensus.cc:686] T 40bc01191d60411fb5f5e56cd7516bad P cbd144f1d8a349c0a182ca1c0bbbc1e3 [term 1 LEADER]: Becoming Leader. State: Replica: cbd144f1d8a349c0a182ca1c0bbbc1e3, State: Running, Role: LEADER
I20260812 00:05:48.068122 14829 consensus_queue.cc:237] T 40bc01191d60411fb5f5e56cd7516bad P cbd144f1d8a349c0a182ca1c0bbbc1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b6e6a0a88d2436380357f5d4b69d777" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 38447 } } peers { permanent_uuid: "866e6712808c494ea87b6456fba37ce4" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 45129 } } peers { permanent_uuid: "cbd144f1d8a349c0a182ca1c0bbbc1e3" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 36347 } }
I20260812 00:05:48.068935 13957 catalog_manager.cc:5495] T 40bc01191d60411fb5f5e56cd7516bad P cbd144f1d8a349c0a182ca1c0bbbc1e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to cbd144f1d8a349c0a182ca1c0bbbc1e3 (127.11.206.66). New cstate: current_term: 1 leader_uuid: "cbd144f1d8a349c0a182ca1c0bbbc1e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b6e6a0a88d2436380357f5d4b69d777" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 38447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "866e6712808c494ea87b6456fba37ce4" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 45129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbd144f1d8a349c0a182ca1c0bbbc1e3" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 36347 } health_report { overall_health: HEALTHY } } }
I20260812 00:05:48.076308 14804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:48.074234 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51728 (local address 127.11.206.66:36347)
0812 00:05:48.074275 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:48.074277 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:48.074285 (+ 8us) server_negotiation.cc:407] Connection header received
0812 00:05:48.074342 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:48.074343 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:48.074361 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:48.074431 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:05:48.074564 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:48.075005 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:48.075699 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:48.075875 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:48.075923 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:48.076017 (+ 94us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:05:48.076113 (+ 96us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:05:48.076167 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:48.076218 (+ 51us) server_negotiation.cc:299] Negotiation successful
0812 00:05:48.076234 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 00:05:48.077955 14702 raft_consensus.cc:1261] T 40bc01191d60411fb5f5e56cd7516bad P 866e6712808c494ea87b6456fba37ce4 [term 1 FOLLOWER]: Refusing update from remote peer cbd144f1d8a349c0a182ca1c0bbbc1e3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:05:48.077955 14220 raft_consensus.cc:1261] T 40bc01191d60411fb5f5e56cd7516bad P 0b6e6a0a88d2436380357f5d4b69d777 [term 1 FOLLOWER]: Refusing update from remote peer cbd144f1d8a349c0a182ca1c0bbbc1e3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:05:48.078295 14833 consensus_queue.cc:1035] T 40bc01191d60411fb5f5e56cd7516bad P cbd144f1d8a349c0a182ca1c0bbbc1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "866e6712808c494ea87b6456fba37ce4" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 45129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:05:48.078420 14829 consensus_queue.cc:1035] T 40bc01191d60411fb5f5e56cd7516bad P cbd144f1d8a349c0a182ca1c0bbbc1e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b6e6a0a88d2436380357f5d4b69d777" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 38447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:05:48.081002 14836 mvcc.cc:205] Tried to move back new op lower bound from 7317475934524911616 to 7317475934487572480. Current Snapshot: MvccSnapshot[applied={T|T < 7317475934524911616}]
I20260812 00:05:48.081702 14840 mvcc.cc:205] Tried to move back new op lower bound from 7317475934524911616 to 7317475934487572480. Current Snapshot: MvccSnapshot[applied={T|T < 7317475934524911616}]
I20260812 00:05:48.081605 14839 mvcc.cc:205] Tried to move back new op lower bound from 7317475934524911616 to 7317475934487572480. Current Snapshot: MvccSnapshot[applied={T|T < 7317475934524911616 or (T in {7317475934524911616})}]
I20260812 00:05:48.083216 13953 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38720:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:05:48.083298 13953 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38720:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:05:48.083989 13953 catalog_manager.cc:5782] T 00000000000000000000000000000000 P cdb55c620f874546b75a0459c1ab0b1c: Sending DeleteTablet for 3 replicas of tablet 40bc01191d60411fb5f5e56cd7516bad
I20260812 00:05:48.084318 14666 tablet_service.cc:1514] Processing DeleteTablet for tablet 40bc01191d60411fb5f5e56cd7516bad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:05:48 UTC) from {username='kudu', principal='kudu/127.11.206.126@KRBTEST.COM'} at 127.0.0.1:37774
I20260812 00:05:48.084357 14184 tablet_service.cc:1514] Processing DeleteTablet for tablet 40bc01191d60411fb5f5e56cd7516bad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:05:48 UTC) from {username='kudu', principal='kudu/127.11.206.126@KRBTEST.COM'} at 127.0.0.1:38186
I20260812 00:05:48.084452 14424 tablet_service.cc:1514] Processing DeleteTablet for tablet 40bc01191d60411fb5f5e56cd7516bad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:05:48 UTC) from {username='kudu', principal='kudu/127.11.206.126@KRBTEST.COM'} at 127.0.0.1:51716
I20260812 00:05:48.084578 14854 tablet_replica.cc:330] T 40bc01191d60411fb5f5e56cd7516bad P 0b6e6a0a88d2436380357f5d4b69d777: stopping tablet replica
I20260812 00:05:48.084751 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 14069
I20260812 00:05:48.111433 14858 tablet_replica.cc:330] T 40bc01191d60411fb5f5e56cd7516bad P cbd144f1d8a349c0a182ca1c0bbbc1e3: stopping tablet replica
I20260812 00:05:48.111598 14858 raft_consensus.cc:2229] T 40bc01191d60411fb5f5e56cd7516bad P cbd144f1d8a349c0a182ca1c0bbbc1e3 [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:05:48.111761 14858 raft_consensus.cc:2258] T 40bc01191d60411fb5f5e56cd7516bad P cbd144f1d8a349c0a182ca1c0bbbc1e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:05:48.112033 14852 tablet_replica.cc:330] T 40bc01191d60411fb5f5e56cd7516bad P 866e6712808c494ea87b6456fba37ce4: stopping tablet replica
I20260812 00:05:48.112164 14852 raft_consensus.cc:2229] T 40bc01191d60411fb5f5e56cd7516bad P 866e6712808c494ea87b6456fba37ce4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:05:48.112282 14852 raft_consensus.cc:2258] T 40bc01191d60411fb5f5e56cd7516bad P 866e6712808c494ea87b6456fba37ce4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:05:48.112581 14858 ts_tablet_manager.cc:1905] T 40bc01191d60411fb5f5e56cd7516bad P cbd144f1d8a349c0a182ca1c0bbbc1e3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:05:48.112744 14852 ts_tablet_manager.cc:1905] T 40bc01191d60411fb5f5e56cd7516bad P 866e6712808c494ea87b6456fba37ce4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:05:48.114567 14858 ts_tablet_manager.cc:1918] T 40bc01191d60411fb5f5e56cd7516bad P cbd144f1d8a349c0a182ca1c0bbbc1e3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:05:48.114568 14852 ts_tablet_manager.cc:1918] T 40bc01191d60411fb5f5e56cd7516bad P 866e6712808c494ea87b6456fba37ce4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:05:48.114652 14852 log.cc:1196] T 40bc01191d60411fb5f5e56cd7516bad P 866e6712808c494ea87b6456fba37ce4: Deleting WAL directory at /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/minicluster-data/ts-2/wal/wals/40bc01191d60411fb5f5e56cd7516bad
I20260812 00:05:48.114755 14858 log.cc:1196] T 40bc01191d60411fb5f5e56cd7516bad P cbd144f1d8a349c0a182ca1c0bbbc1e3: Deleting WAL directory at /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786492899949492-12089-0/minicluster-data/ts-1/wal/wals/40bc01191d60411fb5f5e56cd7516bad
I20260812 00:05:48.114907 14852 ts_tablet_manager.cc:1939] T 40bc01191d60411fb5f5e56cd7516bad P 866e6712808c494ea87b6456fba37ce4: Deleting consensus metadata
I20260812 00:05:48.115129 14858 ts_tablet_manager.cc:1939] T 40bc01191d60411fb5f5e56cd7516bad P cbd144f1d8a349c0a182ca1c0bbbc1e3: Deleting consensus metadata
I20260812 00:05:48.115357 13935 catalog_manager.cc:4841] TS 866e6712808c494ea87b6456fba37ce4 (127.11.206.67:45129): tablet 40bc01191d60411fb5f5e56cd7516bad (table test-table [id=d5ac05244e0f4ed1826d4188c472f08f]) successfully deleted
I20260812 00:05:48.115587 13934 catalog_manager.cc:4841] TS cbd144f1d8a349c0a182ca1c0bbbc1e3 (127.11.206.66:36347): tablet 40bc01191d60411fb5f5e56cd7516bad (table test-table [id=d5ac05244e0f4ed1826d4188c472f08f]) successfully deleted
W20260812 00:05:48.116189 13933 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.206.65:38447 (error 108)
I20260812 00:05:48.116683 14801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:48.116553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.65:38447 (local address 127.0.0.1:38200)
0812 00:05:48.116606 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:48.116647 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.65:38447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260812 00:05:48.116742 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 14311
W20260812 00:05:48.122828 13933 catalog_manager.cc:4584] TS 0b6e6a0a88d2436380357f5d4b69d777 (127.11.206.65:38447): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 40bc01191d60411fb5f5e56cd7516bad: Network error: Client connection negotiation failed: client connection to 127.11.206.65:38447: connect: Connection refused (error 111)
I20260812 00:05:48.126609 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 14557
I20260812 00:05:48.142226 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 13907
2026-08-12T00:05:48Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2105 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-12T00:05:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:05:48Z Disabled control of system clock
I20260812 00:05:48.176512 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492899949492-12089-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492899949492-12089-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492899949492-12089-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:36761
--webserver_interface=127.11.206.126
--webserver_port=0
--builtin_ntp_servers=127.11.206.84:43133
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.206.126:36761
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 00:05:48.259203 14868 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:48.259421 14868 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:48.259449 14868 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:48.260612 14868 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:05:48.260654 14868 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:48.260671 14868 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:48.260686 14868 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:05:48.260703 14868 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:05:48.262100 14868 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:43133
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492899949492-12089-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492899949492-12089-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.206.126:36761
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:36761
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.206.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14868
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492899949492-12089-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:05:48.262351 14868 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:48.262621 14868 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:48.267251 14881 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:48.267279 14882 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:48.267428 14868 server_base.cc:1034] running on GCE node
W20260812 00:05:48.267300 14885 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:48.267688 14868 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:48.267967 14868 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:48.269155 14868 hybrid_clock.cc:648] HybridClock initialized: now 1786493148269130 us; error 33 us; skew 500 ppm
I20260812 00:05:48.270505 14868 webserver.cc:460] Webserver started at http://127.11.206.126:33093/ using document root <none> and password file <none>
I20260812 00:05:48.270743 14868 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:48.270793 14868 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:48.270921 14868 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:48.271970 14868 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492899949492-12089-0/minicluster-data/master-0/data/instance:
uuid: "4e27b3a334d5450f915e6d3e00b6c752"
format_stamp: "Formatted at 2026-08-12 00:05:48 on dist-test-slave-f0tn"
server_key: "59d9985d6cb571f38af3c59fd92f1470"
server_key_iv: "51db4d38f9efdd9253e147a393778662"
server_key_version: "encryptionkey@0"
I20260812 00:05:48.272321 14868 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492899949492-12089-0/minicluster-data/master-0/wal/instance:
uuid: "4e27b3a334d5450f915e6d3e00b6c752"
format_stamp: "Formatted at 2026-08-12 00:05:48 on dist-test-slave-f0tn"
server_key: "59d9985d6cb571f38af3c59fd92f1470"
server_key_iv: "51db4d38f9efdd9253e147a393778662"
server_key_version: "encryptionkey@0"
I20260812 00:05:48.273587 14868 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:05:48.274317 14901 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:48.274462 14868 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:05:48.274544 14868 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492899949492-12089-0/minicluster-data/master-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492899949492-12089-0/minicluster-data/master-0/wal
uuid: "4e27b3a334d5450f915e6d3e00b6c752"
format_stamp: "Formatted at 2026-08-12 00:05:48 on dist-test-slave-f0tn"
server_key: "59d9985d6cb571f38af3c59fd92f1470"
server_key_iv: "51db4d38f9efdd9253e147a393778662"
server_key_version: "encryptionkey@0"
I20260812 00:05:48.274606 14868 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492899949492-12089-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492899949492-12089-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492899949492-12089-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:48.282343 14868 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:48.282600 14868 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:48.282727 14868 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:48.286458 14868 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.126:36761
I20260812 00:05:48.286504 15004 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.126:36761 every 8 connection(s)
I20260812 00:05:48.286816 14868 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
I20260812 00:05:48.287716 15006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:48.289975 15006 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4e27b3a334d5450f915e6d3e00b6c752: Bootstrap starting.
I20260812 00:05:48.290514 15006 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4e27b3a334d5450f915e6d3e00b6c752: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:48.290566 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 14868
I20260812 00:05:48.290657 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492899949492-12089-0/minicluster-data/master-0/wal/instance
I20260812 00:05:48.290808 15006 log.cc:824] T 00000000000000000000000000000000 P 4e27b3a334d5450f915e6d3e00b6c752: Log is configured to *not* fsync() on all Append() calls
I20260812 00:05:48.290838 12089 external_mini_cluster.cc:1428] Setting key 73f3b277469f5bd9a0d9efb5f3053e5a
I20260812 00:05:48.291731 15006 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4e27b3a334d5450f915e6d3e00b6c752: No bootstrap required, opened a new log
I20260812 00:05:48.293685 15006 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4e27b3a334d5450f915e6d3e00b6c752 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e27b3a334d5450f915e6d3e00b6c752" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 36761 } }
I20260812 00:05:48.293869 15006 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4e27b3a334d5450f915e6d3e00b6c752 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:48.293911 15006 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4e27b3a334d5450f915e6d3e00b6c752 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e27b3a334d5450f915e6d3e00b6c752, State: Initialized, Role: FOLLOWER
I20260812 00:05:48.294041 15006 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4e27b3a334d5450f915e6d3e00b6c752 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e27b3a334d5450f915e6d3e00b6c752" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 36761 } }
I20260812 00:05:48.294116 15006 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4e27b3a334d5450f915e6d3e00b6c752 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:05:48.294150 15006 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4e27b3a334d5450f915e6d3e00b6c752 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:05:48.294193 15006 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4e27b3a334d5450f915e6d3e00b6c752 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:48.294780 15006 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4e27b3a334d5450f915e6d3e00b6c752 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e27b3a334d5450f915e6d3e00b6c752" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 36761 } }
I20260812 00:05:48.294870 15006 leader_election.cc:302] T 00000000000000000000000000000000 P 4e27b3a334d5450f915e6d3e00b6c752 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4e27b3a334d5450f915e6d3e00b6c752; no voters:
I20260812 00:05:48.295039 15006 leader_election.cc:288] T 00000000000000000000000000000000 P 4e27b3a334d5450f915e6d3e00b6c752 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:05:48.295085 15016 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4e27b3a334d5450f915e6d3e00b6c752 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:05:48.295205 15016 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4e27b3a334d5450f915e6d3e00b6c752 [term 1 LEADER]: Becoming Leader. State: Replica: 4e27b3a334d5450f915e6d3e00b6c752, State: Running, Role: LEADER
I20260812 00:05:48.295311 15006 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4e27b3a334d5450f915e6d3e00b6c752 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:05:48.295343 15016 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4e27b3a334d5450f915e6d3e00b6c752 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e27b3a334d5450f915e6d3e00b6c752" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 36761 } }
I20260812 00:05:48.295665 15016 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4e27b3a334d5450f915e6d3e00b6c752 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4e27b3a334d5450f915e6d3e00b6c752. Latest consensus state: current_term: 1 leader_uuid: "4e27b3a334d5450f915e6d3e00b6c752" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e27b3a334d5450f915e6d3e00b6c752" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 36761 } } }
I20260812 00:05:48.295676 15019 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4e27b3a334d5450f915e6d3e00b6c752 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4e27b3a334d5450f915e6d3e00b6c752" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e27b3a334d5450f915e6d3e00b6c752" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 36761 } } }
I20260812 00:05:48.295745 15016 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4e27b3a334d5450f915e6d3e00b6c752 [sys.catalog]: This master's current role is: LEADER
I20260812 00:05:48.295775 15019 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4e27b3a334d5450f915e6d3e00b6c752 [sys.catalog]: This master's current role is: LEADER
I20260812 00:05:48.295950 15026 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:05:48.296455 15026 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:05:48.297942 15015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:48.291301 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54840 (local address 127.11.206.126:36761)
0812 00:05:48.291485 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:48.291493 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:48.291525 (+ 32us) server_negotiation.cc:407] Connection header received
0812 00:05:48.292042 (+ 517us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:48.292052 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:48.292136 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:48.292286 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:48.292445 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:48.294404 (+ 1959us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:48.295324 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:48.295977 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:48.296075 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:48.297030 (+ 955us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:48.297034 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:48.297034 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:05:48.297221 (+ 187us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:48.297264 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:05:48.297279 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:48.297342 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:48.297623 (+ 281us) server_negotiation.cc:299] Negotiation successful
0812 00:05:48.297701 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102,"thread_start_us":60,"threads_started":1}
I20260812 00:05:48.297992 15026 catalog_manager.cc:1347] Generated new cluster ID: 991b5bfce020493dacc64fca86f70a32
I20260812 00:05:48.298027 15026 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:05:48.308871 15026 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:05:48.309410 15026 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:05:48.321624 15026 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4e27b3a334d5450f915e6d3e00b6c752: Generated new TSK 0
I20260812 00:05:48.321863 15026 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:05:48.325901 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492899949492-12089-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492899949492-12089-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492899949492-12089-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.65:0
--local_ip_for_outbound_sockets=127.11.206.65
--webserver_interface=127.11.206.65
--webserver_port=0
--tserver_master_addrs=127.11.206.126:36761
--builtin_ntp_servers=127.11.206.84:43133
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 00:05:48.425355 15047 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:48.425588 15047 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:48.425616 15047 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:48.426733 15047 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:48.426770 15047 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:48.426793 15047 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.65
I20260812 00:05:48.428108 15047 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:43133
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492899949492-12089-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492899949492-12089-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.206.65
--webserver_port=0
--tserver_master_addrs=127.11.206.126:36761
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15047
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.65
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492899949492-12089-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:05:48.428316 15047 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:48.428597 15047 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:48.433822 15055 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:48.433851 15054 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:48.433846 15058 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:48.433980 15047 server_base.cc:1034] running on GCE node
I20260812 00:05:48.434172 15047 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:48.434396 15047 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:48.435539 15047 hybrid_clock.cc:648] HybridClock initialized: now 1786493148435525 us; error 30 us; skew 500 ppm
I20260812 00:05:48.436751 15047 webserver.cc:460] Webserver started at http://127.11.206.65:43037/ using document root <none> and password file <none>
I20260812 00:05:48.436978 15047 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:48.437026 15047 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:48.437179 15047 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:48.438241 15047 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492899949492-12089-0/minicluster-data/ts-0/data/instance:
uuid: "13e7929b9c1e439dacbdce5205049b24"
format_stamp: "Formatted at 2026-08-12 00:05:48 on dist-test-slave-f0tn"
server_key: "6fe5d3154ab37e7bf4f37b428dad40ad"
server_key_iv: "848eeb852e028023bfa774bec1827a9e"
server_key_version: "encryptionkey@0"
I20260812 00:05:48.438566 15047 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492899949492-12089-0/minicluster-data/ts-0/wal/instance:
uuid: "13e7929b9c1e439dacbdce5205049b24"
format_stamp: "Formatted at 2026-08-12 00:05:48 on dist-test-slave-f0tn"
server_key: "6fe5d3154ab37e7bf4f37b428dad40ad"
server_key_iv: "848eeb852e028023bfa774bec1827a9e"
server_key_version: "encryptionkey@0"
I20260812 00:05:48.439805 15047 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260812 00:05:48.440500 15067 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:48.440655 15047 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 00:05:48.440745 15047 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492899949492-12089-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492899949492-12089-0/minicluster-data/ts-0/wal
uuid: "13e7929b9c1e439dacbdce5205049b24"
format_stamp: "Formatted at 2026-08-12 00:05:48 on dist-test-slave-f0tn"
server_key: "6fe5d3154ab37e7bf4f37b428dad40ad"
server_key_iv: "848eeb852e028023bfa774bec1827a9e"
server_key_version: "encryptionkey@0"
I20260812 00:05:48.440809 15047 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492899949492-12089-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492899949492-12089-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492899949492-12089-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:48.467336 15047 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:48.467636 15047 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:48.467759 15047 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:48.467983 15047 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:05:48.468329 15047 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:05:48.468364 15047 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:48.468394 15047 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:05:48.468411 15047 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:48.473907 15047 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.65:38213
I20260812 00:05:48.473976 15260 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.65:38213 every 8 connection(s)
I20260812 00:05:48.474264 15047 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492899949492-12089-0/minicluster-data/ts-0/data/info.pb
I20260812 00:05:48.479506 15015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:48.474938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.65:33935 (local address 127.11.206.126:36761)
0812 00:05:48.475014 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:48.475016 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:48.475211 (+ 195us) server_negotiation.cc:407] Connection header received
0812 00:05:48.475688 (+ 477us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:48.475689 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:48.475700 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:48.475749 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:48.476365 (+ 616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:48.476851 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:48.478213 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:48.478450 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:48.478501 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:48.479322 (+ 821us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:48.479323 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:48.479323 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:05:48.479327 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:48.479337 (+ 10us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:05:48.479340 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:48.479370 (+ 30us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:48.479433 (+ 63us) server_negotiation.cc:299] Negotiation successful
0812 00:05:48.479450 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 00:05:48.479736 15264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:48.474918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:36761 (local address 127.11.206.65:33935)
0812 00:05:48.475092 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:48.475127 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:48.475608 (+ 481us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:48.475805 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:48.475809 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:48.475818 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:48.476303 (+ 485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:48.476308 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:48.476967 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:48.476968 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:48.478106 (+ 1138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:48.478110 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:48.478519 (+ 409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:48.478520 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:48.478638 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:48.479201 (+ 563us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:05:48.479202 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:48.479233 (+ 31us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:05:48.479256 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:48.479380 (+ 124us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:48.479382 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:48.479385 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:05:48.479433 (+ 48us) client_negotiation.cc:240] Negotiation successful
0812 00:05:48.479520 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":75,"threads_started":1}
I20260812 00:05:48.480237 15261 heartbeater.cc:347] Connected to a master server at 127.11.206.126:36761
I20260812 00:05:48.480327 15261 heartbeater.cc:464] Registering TS with master...
I20260812 00:05:48.480484 15261 heartbeater.cc:511] Master 127.11.206.126:36761 requested a full tablet report, sending...
I20260812 00:05:48.480980 14936 ts_manager.cc:194] Registered new tserver with Master: 13e7929b9c1e439dacbdce5205049b24 (127.11.206.65:38213)
I20260812 00:05:48.481631 14936 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.206.65:33935
I20260812 00:05:48.481949 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 15047
I20260812 00:05:48.482043 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492899949492-12089-0/minicluster-data/ts-0/wal/instance
I20260812 00:05:48.482240 12089 external_mini_cluster.cc:1428] Setting key 45cff93f60995451ded95168a7876a87
I20260812 00:05:48.483075 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492899949492-12089-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492899949492-12089-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492899949492-12089-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.66:0
--local_ip_for_outbound_sockets=127.11.206.66
--webserver_interface=127.11.206.66
--webserver_port=0
--tserver_master_addrs=127.11.206.126:36761
--builtin_ntp_servers=127.11.206.84:43133
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 00:05:48.565049 15265 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:48.565254 15265 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:48.565274 15265 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:48.566414 15265 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:48.566455 15265 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:48.566483 15265 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.66
I20260812 00:05:48.567830 15265 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:43133
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492899949492-12089-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492899949492-12089-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.206.66
--webserver_port=0
--tserver_master_addrs=127.11.206.126:36761
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15265
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.66
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492899949492-12089-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:05:48.568048 15265 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:48.568332 15265 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:48.573135 15275 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:48.573171 15271 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:48.573175 15265 server_base.cc:1034] running on GCE node
W20260812 00:05:48.573143 15279 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:48.573576 15265 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:48.573835 15265 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:48.574977 15265 hybrid_clock.cc:648] HybridClock initialized: now 1786493148574964 us; error 28 us; skew 500 ppm
I20260812 00:05:48.576195 15265 webserver.cc:460] Webserver started at http://127.11.206.66:38313/ using document root <none> and password file <none>
I20260812 00:05:48.576432 15265 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:48.576481 15265 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:48.576609 15265 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:48.577734 15265 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492899949492-12089-0/minicluster-data/ts-1/data/instance:
uuid: "e79218111dbb4049bd7733d10432a949"
format_stamp: "Formatted at 2026-08-12 00:05:48 on dist-test-slave-f0tn"
server_key: "ba88f6101e4a1a5743656d02fa961cf4"
server_key_iv: "b53fbc42b0fcee4d4d8a6003f277d5b7"
server_key_version: "encryptionkey@0"
I20260812 00:05:48.578066 15265 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492899949492-12089-0/minicluster-data/ts-1/wal/instance:
uuid: "e79218111dbb4049bd7733d10432a949"
format_stamp: "Formatted at 2026-08-12 00:05:48 on dist-test-slave-f0tn"
server_key: "ba88f6101e4a1a5743656d02fa961cf4"
server_key_iv: "b53fbc42b0fcee4d4d8a6003f277d5b7"
server_key_version: "encryptionkey@0"
I20260812 00:05:48.579259 15265 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 00:05:48.579876 15292 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:48.580024 15265 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:05:48.580106 15265 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492899949492-12089-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492899949492-12089-0/minicluster-data/ts-1/wal
uuid: "e79218111dbb4049bd7733d10432a949"
format_stamp: "Formatted at 2026-08-12 00:05:48 on dist-test-slave-f0tn"
server_key: "ba88f6101e4a1a5743656d02fa961cf4"
server_key_iv: "b53fbc42b0fcee4d4d8a6003f277d5b7"
server_key_version: "encryptionkey@0"
I20260812 00:05:48.580164 15265 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492899949492-12089-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492899949492-12089-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492899949492-12089-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:48.590670 15265 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:48.590960 15265 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:48.591089 15265 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:48.591313 15265 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:05:48.591634 15265 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:05:48.591666 15265 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:48.591696 15265 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:05:48.591712 15265 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:48.597460 15265 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.66:46223
I20260812 00:05:48.597519 15461 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.66:46223 every 8 connection(s)
I20260812 00:05:48.597862 15265 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492899949492-12089-0/minicluster-data/ts-1/data/info.pb
I20260812 00:05:48.603121 15015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:48.598675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.66:51657 (local address 127.11.206.126:36761)
0812 00:05:48.598743 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:48.598745 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:48.598970 (+ 225us) server_negotiation.cc:407] Connection header received
0812 00:05:48.599460 (+ 490us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:48.599461 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:48.599472 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:48.599511 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:48.600170 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:48.600671 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:48.601856 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:48.602042 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:48.602091 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:48.602851 (+ 760us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:48.602853 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:48.602853 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:05:48.602857 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:48.602872 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:05:48.602876 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:48.602917 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:48.603035 (+ 118us) server_negotiation.cc:299] Negotiation successful
0812 00:05:48.603059 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260812 00:05:48.603381 15464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:48.598658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:36761 (local address 127.11.206.66:51657)
0812 00:05:48.598852 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:48.598888 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:48.599366 (+ 478us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:48.599569 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:48.599572 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:48.599580 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:48.600103 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:48.600110 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:48.600825 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:48.600826 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:48.601786 (+ 960us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:48.601789 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:48.602103 (+ 314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:48.602103 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:48.602216 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:48.602717 (+ 501us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:05:48.602717 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:48.602749 (+ 32us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:05:48.602774 (+ 25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:48.602951 (+ 177us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:48.602958 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:48.602961 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:05:48.603030 (+ 69us) client_negotiation.cc:240] Negotiation successful
0812 00:05:48.603149 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":92,"threads_started":1}
I20260812 00:05:48.603833 15462 heartbeater.cc:347] Connected to a master server at 127.11.206.126:36761
I20260812 00:05:48.603916 15462 heartbeater.cc:464] Registering TS with master...
I20260812 00:05:48.604101 15462 heartbeater.cc:511] Master 127.11.206.126:36761 requested a full tablet report, sending...
I20260812 00:05:48.604452 14936 ts_manager.cc:194] Registered new tserver with Master: e79218111dbb4049bd7733d10432a949 (127.11.206.66:46223)
I20260812 00:05:48.604817 14936 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.206.66:51657
I20260812 00:05:48.607888 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 15265
I20260812 00:05:48.607988 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492899949492-12089-0/minicluster-data/ts-1/wal/instance
I20260812 00:05:48.608210 12089 external_mini_cluster.cc:1428] Setting key 90a2dc3a3460307d694f4728d0bc36de
I20260812 00:05:48.609129 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492899949492-12089-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492899949492-12089-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492899949492-12089-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.206.67:0
--local_ip_for_outbound_sockets=127.11.206.67
--webserver_interface=127.11.206.67
--webserver_port=0
--tserver_master_addrs=127.11.206.126:36761
--builtin_ntp_servers=127.11.206.84:43133
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 00:05:48.691286 15465 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:48.691517 15465 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:48.691540 15465 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:48.692669 15465 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:48.692703 15465 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:48.692736 15465 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.206.67
I20260812 00:05:48.694067 15465 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:43133
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492899949492-12089-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492899949492-12089-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.206.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.206.67
--webserver_port=0
--tserver_master_addrs=127.11.206.126:36761
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15465
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.206.67
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492899949492-12089-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:05:48.694273 15465 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:48.694535 15465 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:48.699777 15477 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:48.699779 15472 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:48.699815 15480 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:48.699934 15465 server_base.cc:1034] running on GCE node
I20260812 00:05:48.700217 15465 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:48.700488 15465 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:48.701628 15465 hybrid_clock.cc:648] HybridClock initialized: now 1786493148701612 us; error 32 us; skew 500 ppm
I20260812 00:05:48.702834 15465 webserver.cc:460] Webserver started at http://127.11.206.67:45081/ using document root <none> and password file <none>
I20260812 00:05:48.703063 15465 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:48.703112 15465 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:48.703265 15465 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:48.704386 15465 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492899949492-12089-0/minicluster-data/ts-2/data/instance:
uuid: "41cf79d61892430785a34a3d684a32df"
format_stamp: "Formatted at 2026-08-12 00:05:48 on dist-test-slave-f0tn"
server_key: "33ac96c58bf5037f9fd7c52f18901fcc"
server_key_iv: "a1bf90960ea64832e5be60480fbe45b9"
server_key_version: "encryptionkey@0"
I20260812 00:05:48.704723 15465 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492899949492-12089-0/minicluster-data/ts-2/wal/instance:
uuid: "41cf79d61892430785a34a3d684a32df"
format_stamp: "Formatted at 2026-08-12 00:05:48 on dist-test-slave-f0tn"
server_key: "33ac96c58bf5037f9fd7c52f18901fcc"
server_key_iv: "a1bf90960ea64832e5be60480fbe45b9"
server_key_version: "encryptionkey@0"
I20260812 00:05:48.706032 15465 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 00:05:48.706722 15490 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:48.706868 15465 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 00:05:48.706954 15465 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492899949492-12089-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492899949492-12089-0/minicluster-data/ts-2/wal
uuid: "41cf79d61892430785a34a3d684a32df"
format_stamp: "Formatted at 2026-08-12 00:05:48 on dist-test-slave-f0tn"
server_key: "33ac96c58bf5037f9fd7c52f18901fcc"
server_key_iv: "a1bf90960ea64832e5be60480fbe45b9"
server_key_version: "encryptionkey@0"
I20260812 00:05:48.707013 15465 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492899949492-12089-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492899949492-12089-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492899949492-12089-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:48.722026 15465 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:48.722348 15465 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:48.722502 15465 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:48.722743 15465 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:05:48.723080 15465 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:05:48.723115 15465 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:48.723145 15465 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:05:48.723168 15465 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:48.728698 15465 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.67:44075
I20260812 00:05:48.728754 15693 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.67:44075 every 8 connection(s)
I20260812 00:05:48.729077 15465 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492899949492-12089-0/minicluster-data/ts-2/data/info.pb
I20260812 00:05:48.734009 15015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:48.729917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.67:35479 (local address 127.11.206.126:36761)
0812 00:05:48.729973 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:48.729976 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:48.730226 (+ 250us) server_negotiation.cc:407] Connection header received
0812 00:05:48.730717 (+ 491us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:48.730719 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:48.730730 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:48.730781 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:48.731412 (+ 631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:48.731891 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:48.732830 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:48.733006 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:48.733050 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:48.733792 (+ 742us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:48.733794 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:48.733794 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:05:48.733800 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:48.733814 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:05:48.733818 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:48.733858 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:48.733921 (+ 63us) server_negotiation.cc:299] Negotiation successful
0812 00:05:48.733948 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 00:05:48.734225 15698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:48.729897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:36761 (local address 127.11.206.67:35479)
0812 00:05:48.730093 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:48.730129 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:48.730634 (+ 505us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:48.730843 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:48.730846 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:48.730854 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:05:48.731349 (+ 495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:48.731353 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:48.731953 (+ 600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:48.731954 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:48.732762 (+ 808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:48.732765 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:48.733060 (+ 295us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:48.733061 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:48.733166 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:48.733657 (+ 491us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:05:48.733658 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:05:48.733688 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:05:48.733711 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:05:48.733864 (+ 153us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:05:48.733867 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:05:48.733870 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:05:48.733919 (+ 49us) client_negotiation.cc:240] Negotiation successful
0812 00:05:48.734002 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":90,"threads_started":1}
I20260812 00:05:48.734284 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 15465
I20260812 00:05:48.734381 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492899949492-12089-0/minicluster-data/ts-2/wal/instance
I20260812 00:05:48.734604 12089 external_mini_cluster.cc:1428] Setting key 1986bcefa1df2955b5fdef0532ba35e6
I20260812 00:05:48.734720 15695 heartbeater.cc:347] Connected to a master server at 127.11.206.126:36761
I20260812 00:05:48.734820 15695 heartbeater.cc:464] Registering TS with master...
I20260812 00:05:48.735081 15695 heartbeater.cc:511] Master 127.11.206.126:36761 requested a full tablet report, sending...
I20260812 00:05:48.735487 14936 ts_manager.cc:194] Registered new tserver with Master: 41cf79d61892430785a34a3d684a32df (127.11.206.67:44075)
I20260812 00:05:48.735823 14936 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.206.67:35479
I20260812 00:05:48.746309 12089 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:05:48.750366 15015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:48.747712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54854 (local address 127.11.206.126:36761)
0812 00:05:48.747767 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:48.747769 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:48.747883 (+ 114us) server_negotiation.cc:407] Connection header received
0812 00:05:48.747928 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:48.747929 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:48.747938 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:48.747989 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:48.748107 (+ 118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:48.748588 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:48.749271 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:48.749504 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:48.749547 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:48.750148 (+ 601us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:48.750149 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:48.750150 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:05:48.750153 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:48.750168 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:05:48.750171 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:48.750226 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:48.750262 (+ 36us) server_negotiation.cc:299] Negotiation successful
0812 00:05:48.750284 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260812 00:05:48.751747 14936 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54854:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:05:48.753324 14936 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:05:48.759333 15709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:48.755457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.67:44075 (local address 127.0.0.1:36444)
0812 00:05:48.755648 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:48.755691 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:48.755755 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:48.756049 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:48.756052 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:48.756054 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:05:48.756120 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:48.756121 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:48.757078 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:48.757080 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:48.758210 (+ 1130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:48.758213 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:48.759053 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:48.759054 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:48.759128 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:48.759142 (+ 14us) client_negotiation.cc:769] Sending connection context
0812 00:05:48.759207 (+ 65us) client_negotiation.cc:240] Negotiation successful
0812 00:05:48.759259 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":72,"threads_started":1}
I20260812 00:05:48.759344 15712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:48.755556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36444 (local address 127.11.206.67:44075)
0812 00:05:48.755895 (+ 339us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:48.755900 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:48.755910 (+ 10us) server_negotiation.cc:407] Connection header received
0812 00:05:48.755949 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:48.755951 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:48.755965 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:48.756031 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:05:48.756203 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:48.756989 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:48.758307 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:48.758975 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:48.759035 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:48.759139 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:48.759220 (+ 81us) server_negotiation.cc:299] Negotiation successful
0812 00:05:48.759258 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":301,"thread_start_us":102,"threads_started":1}
I20260812 00:05:48.759631 15715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:48.755678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.66:46223 (local address 127.0.0.1:42950)
0812 00:05:48.755805 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:48.755814 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:48.755855 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:48.756293 (+ 438us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:48.756294 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:48.756296 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:05:48.756323 (+ 27us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:48.756324 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:48.757653 (+ 1329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:48.757654 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:48.758493 (+ 839us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:48.758495 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:48.759401 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:48.759402 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:48.759469 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:48.759474 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 00:05:48.759528 (+ 54us) client_negotiation.cc:240] Negotiation successful
0812 00:05:48.759564 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":77,"threads_started":1}
I20260812 00:05:48.759682 15720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:48.755889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42950 (local address 127.11.206.66:46223)
0812 00:05:48.756045 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:48.756049 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:48.756060 (+ 11us) server_negotiation.cc:407] Connection header received
0812 00:05:48.756099 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:48.756130 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:48.756147 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:48.756227 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:05:48.756393 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:48.757534 (+ 1141us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:48.758568 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:48.759215 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:48.759282 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:48.759363 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:48.759557 (+ 194us) server_negotiation.cc:299] Negotiation successful
0812 00:05:48.759601 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":72,"threads_started":1}
I20260812 00:05:48.760228 15708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:48.755495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.65:38213 (local address 127.0.0.1:47054)
0812 00:05:48.755793 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:48.755803 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:48.755852 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:48.756261 (+ 409us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:48.756262 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:48.756265 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:05:48.756307 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:48.756309 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:48.757618 (+ 1309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:48.757620 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:48.758692 (+ 1072us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:48.758695 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:48.759981 (+ 1286us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:48.759983 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:48.760045 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:48.760049 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:05:48.760109 (+ 60us) client_negotiation.cc:240] Negotiation successful
0812 00:05:48.760159 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":283,"mutex_wait_us":33,"thread_start_us":81,"threads_started":1}
I20260812 00:05:48.760103 15577 tablet_service.cc:1467] Processing CreateTablet for tablet fcab4db911654044a53f6e7afae2000d (DEFAULT_TABLE table=test-table [id=cc1d30cb552a4d6ea53cb60b71a22ff9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:05:48.760502 15577 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fcab4db911654044a53f6e7afae2000d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:48.760759 15358 tablet_service.cc:1467] Processing CreateTablet for tablet fcab4db911654044a53f6e7afae2000d (DEFAULT_TABLE table=test-table [id=cc1d30cb552a4d6ea53cb60b71a22ff9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:05:48.761055 15358 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fcab4db911654044a53f6e7afae2000d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:48.763154 15721 tablet_bootstrap.cc:492] T fcab4db911654044a53f6e7afae2000d P 41cf79d61892430785a34a3d684a32df: Bootstrap starting.
I20260812 00:05:48.763463 15723 tablet_bootstrap.cc:492] T fcab4db911654044a53f6e7afae2000d P e79218111dbb4049bd7733d10432a949: Bootstrap starting.
I20260812 00:05:48.760258 15713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:48.755602 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47054 (local address 127.11.206.65:38213)
0812 00:05:48.756084 (+ 482us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:48.756089 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:48.756116 (+ 27us) server_negotiation.cc:407] Connection header received
0812 00:05:48.756153 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:48.756154 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:48.756168 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:48.756381 (+ 213us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:05:48.756442 (+ 61us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:48.757543 (+ 1101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:48.758773 (+ 1230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:48.759898 (+ 1125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:48.759959 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:48.760018 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:48.760139 (+ 121us) server_negotiation.cc:299] Negotiation successful
0812 00:05:48.760184 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":443,"thread_start_us":92,"threads_started":1}
I20260812 00:05:48.763841 15721 tablet_bootstrap.cc:654] T fcab4db911654044a53f6e7afae2000d P 41cf79d61892430785a34a3d684a32df: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:48.764063 15153 tablet_service.cc:1467] Processing CreateTablet for tablet fcab4db911654044a53f6e7afae2000d (DEFAULT_TABLE table=test-table [id=cc1d30cb552a4d6ea53cb60b71a22ff9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:05:48.764183 15721 log.cc:824] T fcab4db911654044a53f6e7afae2000d P 41cf79d61892430785a34a3d684a32df: Log is configured to *not* fsync() on all Append() calls
I20260812 00:05:48.764353 15723 tablet_bootstrap.cc:654] T fcab4db911654044a53f6e7afae2000d P e79218111dbb4049bd7733d10432a949: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:48.764361 15153 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fcab4db911654044a53f6e7afae2000d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:48.764611 15723 log.cc:824] T fcab4db911654044a53f6e7afae2000d P e79218111dbb4049bd7733d10432a949: Log is configured to *not* fsync() on all Append() calls
I20260812 00:05:48.765015 15721 tablet_bootstrap.cc:492] T fcab4db911654044a53f6e7afae2000d P 41cf79d61892430785a34a3d684a32df: No bootstrap required, opened a new log
I20260812 00:05:48.765116 15721 ts_tablet_manager.cc:1397] T fcab4db911654044a53f6e7afae2000d P 41cf79d61892430785a34a3d684a32df: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 00:05:48.765350 15723 tablet_bootstrap.cc:492] T fcab4db911654044a53f6e7afae2000d P e79218111dbb4049bd7733d10432a949: No bootstrap required, opened a new log
I20260812 00:05:48.765445 15723 ts_tablet_manager.cc:1397] T fcab4db911654044a53f6e7afae2000d P e79218111dbb4049bd7733d10432a949: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 00:05:48.766978 15729 tablet_bootstrap.cc:492] T fcab4db911654044a53f6e7afae2000d P 13e7929b9c1e439dacbdce5205049b24: Bootstrap starting.
I20260812 00:05:48.767596 15729 tablet_bootstrap.cc:654] T fcab4db911654044a53f6e7afae2000d P 13e7929b9c1e439dacbdce5205049b24: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:48.767858 15729 log.cc:824] T fcab4db911654044a53f6e7afae2000d P 13e7929b9c1e439dacbdce5205049b24: Log is configured to *not* fsync() on all Append() calls
I20260812 00:05:48.767846 15721 raft_consensus.cc:348] T fcab4db911654044a53f6e7afae2000d P 41cf79d61892430785a34a3d684a32df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cf79d61892430785a34a3d684a32df" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 44075 } } peers { permanent_uuid: "e79218111dbb4049bd7733d10432a949" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 46223 } } peers { permanent_uuid: "13e7929b9c1e439dacbdce5205049b24" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 38213 } }
I20260812 00:05:48.767846 15723 raft_consensus.cc:348] T fcab4db911654044a53f6e7afae2000d P e79218111dbb4049bd7733d10432a949 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cf79d61892430785a34a3d684a32df" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 44075 } } peers { permanent_uuid: "e79218111dbb4049bd7733d10432a949" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 46223 } } peers { permanent_uuid: "13e7929b9c1e439dacbdce5205049b24" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 38213 } }
I20260812 00:05:48.768021 15721 raft_consensus.cc:374] T fcab4db911654044a53f6e7afae2000d P 41cf79d61892430785a34a3d684a32df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:48.768021 15723 raft_consensus.cc:374] T fcab4db911654044a53f6e7afae2000d P e79218111dbb4049bd7733d10432a949 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:48.768067 15721 raft_consensus.cc:729] T fcab4db911654044a53f6e7afae2000d P 41cf79d61892430785a34a3d684a32df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41cf79d61892430785a34a3d684a32df, State: Initialized, Role: FOLLOWER
I20260812 00:05:48.768067 15723 raft_consensus.cc:729] T fcab4db911654044a53f6e7afae2000d P e79218111dbb4049bd7733d10432a949 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e79218111dbb4049bd7733d10432a949, State: Initialized, Role: FOLLOWER
I20260812 00:05:48.768193 15721 consensus_queue.cc:260] T fcab4db911654044a53f6e7afae2000d P 41cf79d61892430785a34a3d684a32df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cf79d61892430785a34a3d684a32df" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 44075 } } peers { permanent_uuid: "e79218111dbb4049bd7733d10432a949" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 46223 } } peers { permanent_uuid: "13e7929b9c1e439dacbdce5205049b24" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 38213 } }
I20260812 00:05:48.768193 15723 consensus_queue.cc:260] T fcab4db911654044a53f6e7afae2000d P e79218111dbb4049bd7733d10432a949 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cf79d61892430785a34a3d684a32df" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 44075 } } peers { permanent_uuid: "e79218111dbb4049bd7733d10432a949" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 46223 } } peers { permanent_uuid: "13e7929b9c1e439dacbdce5205049b24" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 38213 } }
I20260812 00:05:48.768461 15723 ts_tablet_manager.cc:1428] T fcab4db911654044a53f6e7afae2000d P e79218111dbb4049bd7733d10432a949: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 00:05:48.768461 15721 ts_tablet_manager.cc:1428] T fcab4db911654044a53f6e7afae2000d P 41cf79d61892430785a34a3d684a32df: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 00:05:48.768494 15462 heartbeater.cc:503] Master 127.11.206.126:36761 was elected leader, sending a full tablet report...
I20260812 00:05:48.768579 15695 heartbeater.cc:503] Master 127.11.206.126:36761 was elected leader, sending a full tablet report...
I20260812 00:05:48.769114 15729 tablet_bootstrap.cc:492] T fcab4db911654044a53f6e7afae2000d P 13e7929b9c1e439dacbdce5205049b24: No bootstrap required, opened a new log
I20260812 00:05:48.769187 15729 ts_tablet_manager.cc:1397] T fcab4db911654044a53f6e7afae2000d P 13e7929b9c1e439dacbdce5205049b24: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 00:05:48.771068 15729 raft_consensus.cc:348] T fcab4db911654044a53f6e7afae2000d P 13e7929b9c1e439dacbdce5205049b24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cf79d61892430785a34a3d684a32df" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 44075 } } peers { permanent_uuid: "e79218111dbb4049bd7733d10432a949" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 46223 } } peers { permanent_uuid: "13e7929b9c1e439dacbdce5205049b24" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 38213 } }
I20260812 00:05:48.771207 15729 raft_consensus.cc:374] T fcab4db911654044a53f6e7afae2000d P 13e7929b9c1e439dacbdce5205049b24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:48.771229 15729 raft_consensus.cc:729] T fcab4db911654044a53f6e7afae2000d P 13e7929b9c1e439dacbdce5205049b24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13e7929b9c1e439dacbdce5205049b24, State: Initialized, Role: FOLLOWER
I20260812 00:05:48.771358 15729 consensus_queue.cc:260] T fcab4db911654044a53f6e7afae2000d P 13e7929b9c1e439dacbdce5205049b24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cf79d61892430785a34a3d684a32df" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 44075 } } peers { permanent_uuid: "e79218111dbb4049bd7733d10432a949" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 46223 } } peers { permanent_uuid: "13e7929b9c1e439dacbdce5205049b24" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 38213 } }
I20260812 00:05:48.771607 15729 ts_tablet_manager.cc:1428] T fcab4db911654044a53f6e7afae2000d P 13e7929b9c1e439dacbdce5205049b24: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260812 00:05:48.771660 15261 heartbeater.cc:503] Master 127.11.206.126:36761 was elected leader, sending a full tablet report...
I20260812 00:05:48.810529 15733 raft_consensus.cc:482] T fcab4db911654044a53f6e7afae2000d P 41cf79d61892430785a34a3d684a32df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:05:48.810669 15733 raft_consensus.cc:504] T fcab4db911654044a53f6e7afae2000d P 41cf79d61892430785a34a3d684a32df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cf79d61892430785a34a3d684a32df" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 44075 } } peers { permanent_uuid: "e79218111dbb4049bd7733d10432a949" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 46223 } } peers { permanent_uuid: "13e7929b9c1e439dacbdce5205049b24" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 38213 } }
I20260812 00:05:48.811033 15733 leader_election.cc:288] T fcab4db911654044a53f6e7afae2000d P 41cf79d61892430785a34a3d684a32df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e79218111dbb4049bd7733d10432a949 (127.11.206.66:46223), 13e7929b9c1e439dacbdce5205049b24 (127.11.206.65:38213)
I20260812 00:05:48.814850 15713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:48.811291 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.67:33413 (local address 127.11.206.65:38213)
0812 00:05:48.811333 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:48.811335 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:48.811473 (+ 138us) server_negotiation.cc:407] Connection header received
0812 00:05:48.811504 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:48.811505 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:48.811516 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:48.811555 (+ 39us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:05:48.811690 (+ 135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:48.812375 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:48.813953 (+ 1578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:48.814510 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:48.814585 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:48.814593 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:48.814738 (+ 145us) server_negotiation.cc:299] Negotiation successful
0812 00:05:48.814778 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 00:05:48.814850 15720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:48.811276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.206.67:50975 (local address 127.11.206.66:46223)
0812 00:05:48.811322 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:48.811324 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:48.811359 (+ 35us) server_negotiation.cc:407] Connection header received
0812 00:05:48.811391 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:48.811392 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:48.811399 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:48.811440 (+ 41us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:05:48.811607 (+ 167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:48.812386 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:48.813947 (+ 1561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:48.814511 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:48.814585 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:48.814593 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:48.814738 (+ 145us) server_negotiation.cc:299] Negotiation successful
0812 00:05:48.814779 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 00:05:48.814852 15698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:48.811209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.66:46223 (local address 127.11.206.67:50975)
0812 00:05:48.811266 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:48.811277 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:48.811319 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:48.811463 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:48.811463 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:48.811465 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:05:48.811538 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:48.811540 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:48.812509 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:48.812510 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:48.813847 (+ 1337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:48.813851 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:48.814589 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:48.814590 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:48.814671 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:48.814675 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 00:05:48.814728 (+ 53us) client_negotiation.cc:240] Negotiation successful
0812 00:05:48.814781 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38,"mutex_wait_us":57}
I20260812 00:05:48.814863 15741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:48.811231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.65:38213 (local address 127.11.206.67:33413)
0812 00:05:48.811402 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:48.811409 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0812 00:05:48.811463 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:05:48.811571 (+ 108us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:05:48.811572 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:05:48.811573 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:05:48.811631 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:48.811633 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:48.812506 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:48.812508 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:48.813852 (+ 1344us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:05:48.813853 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:05:48.814590 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:05:48.814591 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:05:48.814676 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:48.814678 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 00:05:48.814728 (+ 50us) client_negotiation.cc:240] Negotiation successful
0812 00:05:48.814766 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"mutex_wait_us":73,"thread_start_us":114,"threads_started":1}
I20260812 00:05:48.815241 15182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fcab4db911654044a53f6e7afae2000d" candidate_uuid: "41cf79d61892430785a34a3d684a32df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13e7929b9c1e439dacbdce5205049b24" is_pre_election: true
I20260812 00:05:48.815236 15398 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fcab4db911654044a53f6e7afae2000d" candidate_uuid: "41cf79d61892430785a34a3d684a32df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e79218111dbb4049bd7733d10432a949" is_pre_election: true
I20260812 00:05:48.815379 15398 raft_consensus.cc:2454] T fcab4db911654044a53f6e7afae2000d P e79218111dbb4049bd7733d10432a949 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41cf79d61892430785a34a3d684a32df in term 0.
I20260812 00:05:48.815379 15182 raft_consensus.cc:2454] T fcab4db911654044a53f6e7afae2000d P 13e7929b9c1e439dacbdce5205049b24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41cf79d61892430785a34a3d684a32df in term 0.
I20260812 00:05:48.815594 15494 leader_election.cc:302] T fcab4db911654044a53f6e7afae2000d P 41cf79d61892430785a34a3d684a32df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13e7929b9c1e439dacbdce5205049b24, 41cf79d61892430785a34a3d684a32df; no voters:
I20260812 00:05:48.815769 15733 raft_consensus.cc:2781] T fcab4db911654044a53f6e7afae2000d P 41cf79d61892430785a34a3d684a32df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:05:48.815807 15733 raft_consensus.cc:482] T fcab4db911654044a53f6e7afae2000d P 41cf79d61892430785a34a3d684a32df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:05:48.815828 15733 raft_consensus.cc:3037] T fcab4db911654044a53f6e7afae2000d P 41cf79d61892430785a34a3d684a32df [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:48.816526 15733 raft_consensus.cc:504] T fcab4db911654044a53f6e7afae2000d P 41cf79d61892430785a34a3d684a32df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cf79d61892430785a34a3d684a32df" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 44075 } } peers { permanent_uuid: "e79218111dbb4049bd7733d10432a949" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 46223 } } peers { permanent_uuid: "13e7929b9c1e439dacbdce5205049b24" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 38213 } }
I20260812 00:05:48.816653 15733 leader_election.cc:288] T fcab4db911654044a53f6e7afae2000d P 41cf79d61892430785a34a3d684a32df [CANDIDATE]: Term 1 election: Requested vote from peers e79218111dbb4049bd7733d10432a949 (127.11.206.66:46223), 13e7929b9c1e439dacbdce5205049b24 (127.11.206.65:38213)
I20260812 00:05:48.816836 15182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fcab4db911654044a53f6e7afae2000d" candidate_uuid: "41cf79d61892430785a34a3d684a32df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13e7929b9c1e439dacbdce5205049b24"
I20260812 00:05:48.816838 15398 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fcab4db911654044a53f6e7afae2000d" candidate_uuid: "41cf79d61892430785a34a3d684a32df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e79218111dbb4049bd7733d10432a949"
I20260812 00:05:48.816906 15398 raft_consensus.cc:3037] T fcab4db911654044a53f6e7afae2000d P e79218111dbb4049bd7733d10432a949 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:48.816908 15182 raft_consensus.cc:3037] T fcab4db911654044a53f6e7afae2000d P 13e7929b9c1e439dacbdce5205049b24 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:48.817643 15398 raft_consensus.cc:2454] T fcab4db911654044a53f6e7afae2000d P e79218111dbb4049bd7733d10432a949 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41cf79d61892430785a34a3d684a32df in term 1.
I20260812 00:05:48.817647 15182 raft_consensus.cc:2454] T fcab4db911654044a53f6e7afae2000d P 13e7929b9c1e439dacbdce5205049b24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41cf79d61892430785a34a3d684a32df in term 1.
I20260812 00:05:48.817801 15494 leader_election.cc:302] T fcab4db911654044a53f6e7afae2000d P 41cf79d61892430785a34a3d684a32df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13e7929b9c1e439dacbdce5205049b24, 41cf79d61892430785a34a3d684a32df; no voters:
I20260812 00:05:48.817878 15733 raft_consensus.cc:2781] T fcab4db911654044a53f6e7afae2000d P 41cf79d61892430785a34a3d684a32df [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:05:48.818032 15733 raft_consensus.cc:686] T fcab4db911654044a53f6e7afae2000d P 41cf79d61892430785a34a3d684a32df [term 1 LEADER]: Becoming Leader. State: Replica: 41cf79d61892430785a34a3d684a32df, State: Running, Role: LEADER
I20260812 00:05:48.818120 15733 consensus_queue.cc:237] T fcab4db911654044a53f6e7afae2000d P 41cf79d61892430785a34a3d684a32df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cf79d61892430785a34a3d684a32df" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 44075 } } peers { permanent_uuid: "e79218111dbb4049bd7733d10432a949" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 46223 } } peers { permanent_uuid: "13e7929b9c1e439dacbdce5205049b24" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 38213 } }
I20260812 00:05:48.818929 14935 catalog_manager.cc:5495] T fcab4db911654044a53f6e7afae2000d P 41cf79d61892430785a34a3d684a32df reported cstate change: term changed from 0 to 1, leader changed from <none> to 41cf79d61892430785a34a3d684a32df (127.11.206.67). New cstate: current_term: 1 leader_uuid: "41cf79d61892430785a34a3d684a32df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cf79d61892430785a34a3d684a32df" member_type: VOTER last_known_addr { host: "127.11.206.67" port: 44075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e79218111dbb4049bd7733d10432a949" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 46223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13e7929b9c1e439dacbdce5205049b24" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 38213 } health_report { overall_health: UNKNOWN } } }
I20260812 00:05:48.832126 15712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:48.829827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36450 (local address 127.11.206.67:44075)
0812 00:05:48.829873 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:48.829875 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:48.829884 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:05:48.829948 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:48.829949 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:48.829967 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:48.830032 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:05:48.830152 (+ 120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:48.830679 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:48.831427 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:48.831631 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:48.831684 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:48.831830 (+ 146us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:05:48.831930 (+ 100us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:05:48.831999 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:48.832019 (+ 20us) server_negotiation.cc:299] Negotiation successful
0812 00:05:48.832037 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 00:05:48.833881 15182 raft_consensus.cc:1261] T fcab4db911654044a53f6e7afae2000d P 13e7929b9c1e439dacbdce5205049b24 [term 1 FOLLOWER]: Refusing update from remote peer 41cf79d61892430785a34a3d684a32df: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:05:48.833881 15398 raft_consensus.cc:1261] T fcab4db911654044a53f6e7afae2000d P e79218111dbb4049bd7733d10432a949 [term 1 FOLLOWER]: Refusing update from remote peer 41cf79d61892430785a34a3d684a32df: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:05:48.834251 15742 consensus_queue.cc:1035] T fcab4db911654044a53f6e7afae2000d P 41cf79d61892430785a34a3d684a32df [LEADER]: Connected to new peer: Peer: permanent_uuid: "13e7929b9c1e439dacbdce5205049b24" member_type: VOTER last_known_addr { host: "127.11.206.65" port: 38213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:05:48.834373 15733 consensus_queue.cc:1035] T fcab4db911654044a53f6e7afae2000d P 41cf79d61892430785a34a3d684a32df [LEADER]: Connected to new peer: Peer: permanent_uuid: "e79218111dbb4049bd7733d10432a949" member_type: VOTER last_known_addr { host: "127.11.206.66" port: 46223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:05:48.836935 15747 mvcc.cc:205] Tried to move back new op lower bound from 7317475937620824064 to 7317475937559695360. Current Snapshot: MvccSnapshot[applied={T|T < 7317475937620824064}]
I20260812 00:05:48.838943 14935 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:54854:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:05:48.839025 14935 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:54854:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:05:48.839687 14935 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4e27b3a334d5450f915e6d3e00b6c752: Sending DeleteTablet for 3 replicas of tablet fcab4db911654044a53f6e7afae2000d
I20260812 00:05:48.840036 15358 tablet_service.cc:1514] Processing DeleteTablet for tablet fcab4db911654044a53f6e7afae2000d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:05:48 UTC) from {username='slave'} at 127.0.0.1:42950
I20260812 00:05:48.840042 15577 tablet_service.cc:1514] Processing DeleteTablet for tablet fcab4db911654044a53f6e7afae2000d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:05:48 UTC) from {username='slave'} at 127.0.0.1:36444
I20260812 00:05:48.840121 15153 tablet_service.cc:1514] Processing DeleteTablet for tablet fcab4db911654044a53f6e7afae2000d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:05:48 UTC) from {username='slave'} at 127.0.0.1:47054
I20260812 00:05:48.840245 15765 tablet_replica.cc:330] T fcab4db911654044a53f6e7afae2000d P 41cf79d61892430785a34a3d684a32df: stopping tablet replica
I20260812 00:05:48.840338 15767 tablet_replica.cc:330] T fcab4db911654044a53f6e7afae2000d P 13e7929b9c1e439dacbdce5205049b24: stopping tablet replica
I20260812 00:05:48.840340 15765 raft_consensus.cc:2229] T fcab4db911654044a53f6e7afae2000d P 41cf79d61892430785a34a3d684a32df [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:05:48.840410 15767 raft_consensus.cc:2229] T fcab4db911654044a53f6e7afae2000d P 13e7929b9c1e439dacbdce5205049b24 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:05:48.840425 15765 raft_consensus.cc:2258] T fcab4db911654044a53f6e7afae2000d P 41cf79d61892430785a34a3d684a32df [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:05:48.840502 15767 raft_consensus.cc:2258] T fcab4db911654044a53f6e7afae2000d P 13e7929b9c1e439dacbdce5205049b24 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:05:48.840552 15763 tablet_replica.cc:330] T fcab4db911654044a53f6e7afae2000d P e79218111dbb4049bd7733d10432a949: stopping tablet replica
I20260812 00:05:48.840713 15763 raft_consensus.cc:2229] T fcab4db911654044a53f6e7afae2000d P e79218111dbb4049bd7733d10432a949 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:05:48.840754 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 15047
I20260812 00:05:48.840826 15763 raft_consensus.cc:2258] T fcab4db911654044a53f6e7afae2000d P e79218111dbb4049bd7733d10432a949 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:05:48.841146 15767 ts_tablet_manager.cc:1905] T fcab4db911654044a53f6e7afae2000d P 13e7929b9c1e439dacbdce5205049b24: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:05:48.843842 15763 ts_tablet_manager.cc:1905] T fcab4db911654044a53f6e7afae2000d P e79218111dbb4049bd7733d10432a949: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:05:48.845660 15763 ts_tablet_manager.cc:1918] T fcab4db911654044a53f6e7afae2000d P e79218111dbb4049bd7733d10432a949: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:05:48.845732 15763 log.cc:1196] T fcab4db911654044a53f6e7afae2000d P e79218111dbb4049bd7733d10432a949: Deleting WAL directory at /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492899949492-12089-0/minicluster-data/ts-1/wal/wals/fcab4db911654044a53f6e7afae2000d
I20260812 00:05:48.846012 15763 ts_tablet_manager.cc:1939] T fcab4db911654044a53f6e7afae2000d P e79218111dbb4049bd7733d10432a949: Deleting consensus metadata
I20260812 00:05:48.849689 15765 ts_tablet_manager.cc:1905] T fcab4db911654044a53f6e7afae2000d P 41cf79d61892430785a34a3d684a32df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:05:48.851500 15765 ts_tablet_manager.cc:1918] T fcab4db911654044a53f6e7afae2000d P 41cf79d61892430785a34a3d684a32df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:05:48.851577 15765 log.cc:1196] T fcab4db911654044a53f6e7afae2000d P 41cf79d61892430785a34a3d684a32df: Deleting WAL directory at /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786492899949492-12089-0/minicluster-data/ts-2/wal/wals/fcab4db911654044a53f6e7afae2000d
I20260812 00:05:48.851838 15765 ts_tablet_manager.cc:1939] T fcab4db911654044a53f6e7afae2000d P 41cf79d61892430785a34a3d684a32df: Deleting consensus metadata
W20260812 00:05:48.855532 14912 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.206.65:38213 (error 108)
I20260812 00:05:48.855870 14909 catalog_manager.cc:4841] TS 41cf79d61892430785a34a3d684a32df (127.11.206.67:44075): tablet fcab4db911654044a53f6e7afae2000d (table test-table [id=cc1d30cb552a4d6ea53cb60b71a22ff9]) successfully deleted
I20260812 00:05:48.856082 15708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:48.855913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.65:38213 (local address 127.0.0.1:47058)
0812 00:05:48.855974 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0812 00:05:48.856019 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.65:38213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260812 00:05:48.856135 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 15265
W20260812 00:05:48.856293 14912 catalog_manager.cc:4584] TS 13e7929b9c1e439dacbdce5205049b24 (127.11.206.65:38213): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet fcab4db911654044a53f6e7afae2000d: Network error: Client connection negotiation failed: client connection to 127.11.206.65:38213: connect: Connection refused (error 111)
I20260812 00:05:48.856025 14909 catalog_manager.cc:4841] TS e79218111dbb4049bd7733d10432a949 (127.11.206.66:46223): tablet fcab4db911654044a53f6e7afae2000d (table test-table [id=cc1d30cb552a4d6ea53cb60b71a22ff9]) successfully deleted
I20260812 00:05:48.888109 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 15465
I20260812 00:05:48.896510 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 14868
2026-08-12T00:05:48Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (754 ms)
[----------] 6 tests from EncryptionPolicyTest (8332 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786492899949492-12089-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:05:48 dist-test-slave-f0tn krb5kdc[15772](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:05:48 dist-test-slave-f0tn krb5kdc[15772](info): set up 2 sockets
Aug 12 00:05:48 dist-test-slave-f0tn krb5kdc[15772](info): commencing operation
krb5kdc: starting...
W20260812 00:05:50.108534 12089 mini_kdc.cc:121] Time spent starting KDC: real 1.185s user 0.002s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786492899949492-12089-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786492899949492-12089-0/krb5kdc/test-user.keytab.
Aug 12 00:05:50 dist-test-slave-f0tn krb5kdc[15772](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493150, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:05:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:05:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786492899949492-12089-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786492899949492-12089-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 00:05:50.225946 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786492899949492-12089-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786492899949492-12089-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786492899949492-12089-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34631
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786492899949492-12089-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41365
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34631
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:05:50.306975 15788 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:50.307174 15788 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:50.307204 15788 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:50.308333 15788 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:05:50.308377 15788 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:50.308395 15788 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:50.308411 15788 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:05:50.308426 15788 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:05:50.309921 15788 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41365
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786492899949492-12089-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786492899949492-12089-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34631
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786492899949492-12089-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34631
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15788
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786492899949492-12089-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:05:50.310166 15788 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:50.310364 15788 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:50.315083 15805 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:50.315076 15800 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:50.315104 15801 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:50.315276 15788 server_base.cc:1034] running on GCE node
I20260812 00:05:50.315521 15788 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:50.315842 15788 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:50.316982 15788 hybrid_clock.cc:648] HybridClock initialized: now 1786493150316964 us; error 37 us; skew 500 ppm
Aug 12 00:05:50 dist-test-slave-f0tn krb5kdc[15772](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493150, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:50.319365 15788 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 00:05:50.319813 15788 webserver.cc:460] Webserver started at http://127.0.0.1:45361/ using document root <none> and password file <none>
I20260812 00:05:50.320010 15788 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:50.320052 15788 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:50.320178 15788 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:50.321224 15788 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786492899949492-12089-0/minicluster-data/master-0/data/instance:
uuid: "35ff6a86ebc74fc392be83c84e651e72"
format_stamp: "Formatted at 2026-08-12 00:05:50 on dist-test-slave-f0tn"
server_key: "f64e74a451a087b6a56be0da83a09ba6"
server_key_iv: "67d5552bbeea1b80aeea2e765a734d7a"
server_key_version: "encryptionkey@0"
I20260812 00:05:50.321596 15788 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786492899949492-12089-0/minicluster-data/master-0/wal/instance:
uuid: "35ff6a86ebc74fc392be83c84e651e72"
format_stamp: "Formatted at 2026-08-12 00:05:50 on dist-test-slave-f0tn"
server_key: "f64e74a451a087b6a56be0da83a09ba6"
server_key_iv: "67d5552bbeea1b80aeea2e765a734d7a"
server_key_version: "encryptionkey@0"
I20260812 00:05:50.322841 15788 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 00:05:50.323558 15817 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:50.323727 15788 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 00:05:50.323810 15788 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786492899949492-12089-0/minicluster-data/master-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786492899949492-12089-0/minicluster-data/master-0/wal
uuid: "35ff6a86ebc74fc392be83c84e651e72"
format_stamp: "Formatted at 2026-08-12 00:05:50 on dist-test-slave-f0tn"
server_key: "f64e74a451a087b6a56be0da83a09ba6"
server_key_iv: "67d5552bbeea1b80aeea2e765a734d7a"
server_key_version: "encryptionkey@0"
I20260812 00:05:50.323880 15788 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786492899949492-12089-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786492899949492-12089-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786492899949492-12089-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:50.339810 15788 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:50.341784 15788 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:50.341924 15788 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:50.345861 15788 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34631
I20260812 00:05:50.345904 15898 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34631 every 8 connection(s)
I20260812 00:05:50.346256 15788 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
I20260812 00:05:50.347159 15900 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:50.349619 15900 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 35ff6a86ebc74fc392be83c84e651e72: Bootstrap starting.
I20260812 00:05:50.350243 15900 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 35ff6a86ebc74fc392be83c84e651e72: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:50.350512 15900 log.cc:824] T 00000000000000000000000000000000 P 35ff6a86ebc74fc392be83c84e651e72: Log is configured to *not* fsync() on all Append() calls
I20260812 00:05:50.350824 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 15788
I20260812 00:05:50.350950 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786492899949492-12089-0/minicluster-data/master-0/wal/instance
I20260812 00:05:50.351148 12089 external_mini_cluster.cc:1428] Setting key dc645e8e7b8aad9c8f41caf0a98ab18c
I20260812 00:05:50.351351 15900 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 35ff6a86ebc74fc392be83c84e651e72: No bootstrap required, opened a new log
I20260812 00:05:50.353554 15900 raft_consensus.cc:348] T 00000000000000000000000000000000 P 35ff6a86ebc74fc392be83c84e651e72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35ff6a86ebc74fc392be83c84e651e72" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34631 } }
I20260812 00:05:50.353708 15900 raft_consensus.cc:374] T 00000000000000000000000000000000 P 35ff6a86ebc74fc392be83c84e651e72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:50.353742 15900 raft_consensus.cc:729] T 00000000000000000000000000000000 P 35ff6a86ebc74fc392be83c84e651e72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35ff6a86ebc74fc392be83c84e651e72, State: Initialized, Role: FOLLOWER
I20260812 00:05:50.353870 15900 consensus_queue.cc:260] T 00000000000000000000000000000000 P 35ff6a86ebc74fc392be83c84e651e72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35ff6a86ebc74fc392be83c84e651e72" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34631 } }
I20260812 00:05:50.353950 15900 raft_consensus.cc:388] T 00000000000000000000000000000000 P 35ff6a86ebc74fc392be83c84e651e72 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:05:50.353981 15900 raft_consensus.cc:482] T 00000000000000000000000000000000 P 35ff6a86ebc74fc392be83c84e651e72 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:05:50.354027 15900 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 35ff6a86ebc74fc392be83c84e651e72 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:50.354588 15900 raft_consensus.cc:504] T 00000000000000000000000000000000 P 35ff6a86ebc74fc392be83c84e651e72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35ff6a86ebc74fc392be83c84e651e72" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34631 } }
I20260812 00:05:50.354691 15900 leader_election.cc:302] T 00000000000000000000000000000000 P 35ff6a86ebc74fc392be83c84e651e72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 35ff6a86ebc74fc392be83c84e651e72; no voters:
I20260812 00:05:50.354872 15900 leader_election.cc:288] T 00000000000000000000000000000000 P 35ff6a86ebc74fc392be83c84e651e72 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:05:50.354924 15908 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 35ff6a86ebc74fc392be83c84e651e72 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:05:50.355050 15908 raft_consensus.cc:686] T 00000000000000000000000000000000 P 35ff6a86ebc74fc392be83c84e651e72 [term 1 LEADER]: Becoming Leader. State: Replica: 35ff6a86ebc74fc392be83c84e651e72, State: Running, Role: LEADER
I20260812 00:05:50.355158 15900 sys_catalog.cc:564] T 00000000000000000000000000000000 P 35ff6a86ebc74fc392be83c84e651e72 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:05:50.355134 15908 consensus_queue.cc:237] T 00000000000000000000000000000000 P 35ff6a86ebc74fc392be83c84e651e72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35ff6a86ebc74fc392be83c84e651e72" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34631 } }
I20260812 00:05:50.355535 15908 sys_catalog.cc:455] T 00000000000000000000000000000000 P 35ff6a86ebc74fc392be83c84e651e72 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 35ff6a86ebc74fc392be83c84e651e72. Latest consensus state: current_term: 1 leader_uuid: "35ff6a86ebc74fc392be83c84e651e72" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35ff6a86ebc74fc392be83c84e651e72" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34631 } } }
I20260812 00:05:50.355669 15908 sys_catalog.cc:458] T 00000000000000000000000000000000 P 35ff6a86ebc74fc392be83c84e651e72 [sys.catalog]: This master's current role is: LEADER
I20260812 00:05:50.355538 15910 sys_catalog.cc:455] T 00000000000000000000000000000000 P 35ff6a86ebc74fc392be83c84e651e72 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "35ff6a86ebc74fc392be83c84e651e72" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35ff6a86ebc74fc392be83c84e651e72" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34631 } } }
I20260812 00:05:50.355757 15910 sys_catalog.cc:458] T 00000000000000000000000000000000 P 35ff6a86ebc74fc392be83c84e651e72 [sys.catalog]: This master's current role is: LEADER
I20260812 00:05:50.355893 15918 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:05:50.356443 15918 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 12 00:05:50 dist-test-slave-f0tn krb5kdc[15772](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493150, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260812 00:05:50.360654 15918 catalog_manager.cc:1347] Generated new cluster ID: 565f94d93b2c459f9c9a8d9cb2fa6208
I20260812 00:05:50.360713 15918 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:05:50.362774 15907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:50.351679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44655 (local address 127.0.0.1:34631)
0812 00:05:50.351855 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:50.351864 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:50.351893 (+ 29us) server_negotiation.cc:407] Connection header received
0812 00:05:50.352597 (+ 704us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:50.352605 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:50.352657 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:50.352775 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:50.353556 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:50.355008 (+ 1452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:50.356147 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:50.356757 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:50.357194 (+ 437us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:50.359443 (+ 2249us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:50.359448 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:50.359448 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:50.359460 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:50.361287 (+ 1827us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:50.361679 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:50.361683 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:50.361683 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:50.361783 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:50.361997 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:50.361998 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:50.361998 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:50.362242 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:50.362398 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:50.362523 (+ 125us) server_negotiation.cc:299] Negotiation successful
0812 00:05:50.362620 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":79,"threads_started":1}
I20260812 00:05:50.366313 12089 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:05:50.370864 15918 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:05:50.371531 15918 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:05:50.376166 15907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:50.367624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53619 (local address 127.0.0.1:34631)
0812 00:05:50.367660 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:50.367662 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:50.369564 (+ 1902us) server_negotiation.cc:407] Connection header received
0812 00:05:50.369621 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:50.369622 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:50.369631 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:50.369676 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:50.370170 (+ 494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:50.370751 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:50.371730 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:50.372060 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:50.372145 (+ 85us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:50.373474 (+ 1329us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:50.373476 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:50.373476 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:50.373483 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:50.375023 (+ 1540us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:50.375410 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:50.375411 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:50.375411 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:50.375484 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:50.375668 (+ 184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:50.375668 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:50.375669 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:50.375796 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:50.375890 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:50.375999 (+ 109us) server_negotiation.cc:299] Negotiation successful
0812 00:05:50.376064 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 00:05:50.377797 15918 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 35ff6a86ebc74fc392be83c84e651e72: Generated new TSK 0
I20260812 00:05:50.377976 15918 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:05:50.382146 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 15788
W20260812 00:05:50.397684 15770 connection.cc:535] client connection to 127.0.0.1:34631 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:34631): Connection reset by peer (error 104)
2026-08-12T00:05:50Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1487 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786492899949492-12089-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:05:50 dist-test-slave-f0tn krb5kdc[15956](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:05:50 dist-test-slave-f0tn krb5kdc[15956](info): set up 2 sockets
Aug 12 00:05:50 dist-test-slave-f0tn krb5kdc[15956](info): commencing operation
krb5kdc: starting...
W20260812 00:05:51.563086 12089 mini_kdc.cc:121] Time spent starting KDC: real 1.152s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786492899949492-12089-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786492899949492-12089-0/krb5kdc/test-user.keytab.
Aug 12 00:05:51 dist-test-slave-f0tn krb5kdc[15956](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493151, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:05:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:05:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786492899949492-12089-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786492899949492-12089-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 00:05:51.684559 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786492899949492-12089-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786492899949492-12089-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786492899949492-12089-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39089
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786492899949492-12089-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33573
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39089
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:05:51.765573 15970 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:51.765776 15970 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:51.765797 15970 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:51.766886 15970 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:05:51.766919 15970 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:51.766932 15970 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:51.766943 15970 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:05:51.766959 15970 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:05:51.768373 15970 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33573
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786492899949492-12089-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786492899949492-12089-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39089
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786492899949492-12089-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39089
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15970
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786492899949492-12089-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:05:51.768563 15970 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:51.768734 15970 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:51.773449 15978 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:51.773458 15980 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:51.773478 15977 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:51.773691 15970 server_base.cc:1034] running on GCE node
I20260812 00:05:51.773919 15970 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:51.774181 15970 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:51.775319 15970 hybrid_clock.cc:648] HybridClock initialized: now 1786493151775307 us; error 31 us; skew 500 ppm
Aug 12 00:05:51 dist-test-slave-f0tn krb5kdc[15956](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493151, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:51.777823 15970 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 00:05:51.778256 15970 webserver.cc:460] Webserver started at http://127.0.0.1:45491/ using document root <none> and password file <none>
I20260812 00:05:51.778452 15970 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:51.778498 15970 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:51.778632 15970 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:51.779688 15970 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786492899949492-12089-0/minicluster-data/master-0/data/instance:
uuid: "784b2932d11f4285bfb38a5e8f60f79f"
format_stamp: "Formatted at 2026-08-12 00:05:51 on dist-test-slave-f0tn"
server_key: "e6eeb6cf4f8dc9b6b7685ab61bb14342"
server_key_iv: "139fce5dfb56d3d231d41180c8e2a601"
server_key_version: "encryptionkey@0"
I20260812 00:05:51.780016 15970 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786492899949492-12089-0/minicluster-data/master-0/wal/instance:
uuid: "784b2932d11f4285bfb38a5e8f60f79f"
format_stamp: "Formatted at 2026-08-12 00:05:51 on dist-test-slave-f0tn"
server_key: "e6eeb6cf4f8dc9b6b7685ab61bb14342"
server_key_iv: "139fce5dfb56d3d231d41180c8e2a601"
server_key_version: "encryptionkey@0"
I20260812 00:05:51.781236 15970 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 00:05:51.782016 15992 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:51.782171 15970 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:51.782254 15970 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786492899949492-12089-0/minicluster-data/master-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786492899949492-12089-0/minicluster-data/master-0/wal
uuid: "784b2932d11f4285bfb38a5e8f60f79f"
format_stamp: "Formatted at 2026-08-12 00:05:51 on dist-test-slave-f0tn"
server_key: "e6eeb6cf4f8dc9b6b7685ab61bb14342"
server_key_iv: "139fce5dfb56d3d231d41180c8e2a601"
server_key_version: "encryptionkey@0"
I20260812 00:05:51.782315 15970 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786492899949492-12089-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786492899949492-12089-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786492899949492-12089-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:51.790782 15970 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:51.792461 15970 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:51.792594 15970 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:51.797050 15970 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39089
I20260812 00:05:51.797078 16072 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39089 every 8 connection(s)
I20260812 00:05:51.797492 15970 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
I20260812 00:05:51.798403 16073 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:51.799396 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 15970
I20260812 00:05:51.799510 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786492899949492-12089-0/minicluster-data/master-0/wal/instance
I20260812 00:05:51.799695 12089 external_mini_cluster.cc:1428] Setting key ccc49ce565a7e39c9d42709c319b6968
I20260812 00:05:51.801240 16073 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 784b2932d11f4285bfb38a5e8f60f79f: Bootstrap starting.
I20260812 00:05:51.802021 16073 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 784b2932d11f4285bfb38a5e8f60f79f: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:51.802340 16073 log.cc:824] T 00000000000000000000000000000000 P 784b2932d11f4285bfb38a5e8f60f79f: Log is configured to *not* fsync() on all Append() calls
I20260812 00:05:51.803092 16073 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 784b2932d11f4285bfb38a5e8f60f79f: No bootstrap required, opened a new log
I20260812 00:05:51.805409 16073 raft_consensus.cc:348] T 00000000000000000000000000000000 P 784b2932d11f4285bfb38a5e8f60f79f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "784b2932d11f4285bfb38a5e8f60f79f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39089 } }
I20260812 00:05:51.805599 16073 raft_consensus.cc:374] T 00000000000000000000000000000000 P 784b2932d11f4285bfb38a5e8f60f79f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:51.805639 16073 raft_consensus.cc:729] T 00000000000000000000000000000000 P 784b2932d11f4285bfb38a5e8f60f79f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 784b2932d11f4285bfb38a5e8f60f79f, State: Initialized, Role: FOLLOWER
I20260812 00:05:51.805759 16073 consensus_queue.cc:260] T 00000000000000000000000000000000 P 784b2932d11f4285bfb38a5e8f60f79f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "784b2932d11f4285bfb38a5e8f60f79f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39089 } }
I20260812 00:05:51.805843 16073 raft_consensus.cc:388] T 00000000000000000000000000000000 P 784b2932d11f4285bfb38a5e8f60f79f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:05:51.805857 16080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:51.800237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53785 (local address 127.0.0.1:39089)
0812 00:05:51.800430 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:51.800442 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:51.800477 (+ 35us) server_negotiation.cc:407] Connection header received
0812 00:05:51.800977 (+ 500us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:51.800987 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:51.801053 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:51.801210 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:51.801482 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:51.802818 (+ 1336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:51.803605 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:51.804261 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:51.804382 (+ 121us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:51.805120 (+ 738us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:51.805125 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:51.805125 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:05:51.805333 (+ 208us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:51.805398 (+ 65us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:05:51.805415 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:51.805504 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:51.805596 (+ 92us) server_negotiation.cc:299] Negotiation successful
0812 00:05:51.805629 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":86,"threads_started":1}
I20260812 00:05:51.805889 16073 raft_consensus.cc:482] T 00000000000000000000000000000000 P 784b2932d11f4285bfb38a5e8f60f79f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:05:51.805931 16073 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 784b2932d11f4285bfb38a5e8f60f79f [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:51.806566 16073 raft_consensus.cc:504] T 00000000000000000000000000000000 P 784b2932d11f4285bfb38a5e8f60f79f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "784b2932d11f4285bfb38a5e8f60f79f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39089 } }
I20260812 00:05:51.806681 16073 leader_election.cc:302] T 00000000000000000000000000000000 P 784b2932d11f4285bfb38a5e8f60f79f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 784b2932d11f4285bfb38a5e8f60f79f; no voters:
I20260812 00:05:51.806860 16073 leader_election.cc:288] T 00000000000000000000000000000000 P 784b2932d11f4285bfb38a5e8f60f79f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:05:51.806948 12089 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:05:51.806945 16083 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 784b2932d11f4285bfb38a5e8f60f79f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:05:51.807119 16073 sys_catalog.cc:564] T 00000000000000000000000000000000 P 784b2932d11f4285bfb38a5e8f60f79f [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:05:51.807128 16083 raft_consensus.cc:686] T 00000000000000000000000000000000 P 784b2932d11f4285bfb38a5e8f60f79f [term 1 LEADER]: Becoming Leader. State: Replica: 784b2932d11f4285bfb38a5e8f60f79f, State: Running, Role: LEADER
I20260812 00:05:51.807315 16083 consensus_queue.cc:237] T 00000000000000000000000000000000 P 784b2932d11f4285bfb38a5e8f60f79f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "784b2932d11f4285bfb38a5e8f60f79f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39089 } }
I20260812 00:05:51.807704 16087 sys_catalog.cc:455] T 00000000000000000000000000000000 P 784b2932d11f4285bfb38a5e8f60f79f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 784b2932d11f4285bfb38a5e8f60f79f. Latest consensus state: current_term: 1 leader_uuid: "784b2932d11f4285bfb38a5e8f60f79f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "784b2932d11f4285bfb38a5e8f60f79f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39089 } } }
I20260812 00:05:51.807804 16087 sys_catalog.cc:458] T 00000000000000000000000000000000 P 784b2932d11f4285bfb38a5e8f60f79f [sys.catalog]: This master's current role is: LEADER
I20260812 00:05:51.808014 16097 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:05:51.808122 16086 sys_catalog.cc:455] T 00000000000000000000000000000000 P 784b2932d11f4285bfb38a5e8f60f79f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "784b2932d11f4285bfb38a5e8f60f79f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "784b2932d11f4285bfb38a5e8f60f79f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39089 } } }
I20260812 00:05:51.808188 16086 sys_catalog.cc:458] T 00000000000000000000000000000000 P 784b2932d11f4285bfb38a5e8f60f79f [sys.catalog]: This master's current role is: LEADER
I20260812 00:05:51.808615 16097 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:05:51.810782 16097 catalog_manager.cc:1347] Generated new cluster ID: 50c5a0bb5afa47abb24d05ef1020fb4c
I20260812 00:05:51.810832 16097 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:05:51.812263 16080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:51.808572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38409 (local address 127.0.0.1:39089)
0812 00:05:51.808619 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:51.808620 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:51.808812 (+ 192us) server_negotiation.cc:407] Connection header received
0812 00:05:51.808904 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:51.808905 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:51.808915 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:51.808941 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:51.809144 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:51.809884 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:51.810935 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:51.811236 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:51.811303 (+ 67us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:51.812028 (+ 725us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:51.812030 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:51.812031 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:05:51.812036 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:51.812054 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:05:51.812058 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:51.812120 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:51.812180 (+ 60us) server_negotiation.cc:299] Negotiation successful
0812 00:05:51.812191 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 00:05:51.815203 16097 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:05:51.815670 16097 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:05:51.821511 16097 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 784b2932d11f4285bfb38a5e8f60f79f: Generated new TSK 0
I20260812 00:05:51.821691 16097 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:05:51.826785 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 15970
W20260812 00:05:51.842089 15951 connection.cc:535] client connection to 127.0.0.1:39089 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:39089): Connection reset by peer (error 104)
2026-08-12T00:05:51Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1444 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786492899949492-12089-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:05:51 dist-test-slave-f0tn krb5kdc[16130](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:05:51 dist-test-slave-f0tn krb5kdc[16130](info): set up 2 sockets
Aug 12 00:05:51 dist-test-slave-f0tn krb5kdc[16130](info): commencing operation
krb5kdc: starting...
W20260812 00:05:53.007524 12089 mini_kdc.cc:121] Time spent starting KDC: real 1.152s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786492899949492-12089-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786492899949492-12089-0/krb5kdc/test-user.keytab.
Aug 12 00:05:53 dist-test-slave-f0tn krb5kdc[16130](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493153, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:05:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:05:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786492899949492-12089-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786492899949492-12089-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 00:05:53.122355 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786492899949492-12089-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786492899949492-12089-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786492899949492-12089-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36407
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786492899949492-12089-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46437
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36407
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:05:53.203100 16151 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:53.203330 16151 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:53.203354 16151 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:53.204501 16151 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:05:53.204547 16151 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:53.204560 16151 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:53.204571 16151 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:05:53.204586 16151 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:05:53.206672 16151 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46437
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786492899949492-12089-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786492899949492-12089-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36407
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786492899949492-12089-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36407
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16151
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786492899949492-12089-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:05:53.206962 16151 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:53.207242 16151 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:53.212462 16160 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:53.212448 16168 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:53.212448 16161 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:53.212787 16151 server_base.cc:1034] running on GCE node
I20260812 00:05:53.213033 16151 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:53.213342 16151 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:53.214529 16151 hybrid_clock.cc:648] HybridClock initialized: now 1786493153214513 us; error 34 us; skew 500 ppm
Aug 12 00:05:53 dist-test-slave-f0tn krb5kdc[16130](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493153, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:53.217137 16151 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 00:05:53.217633 16151 webserver.cc:460] Webserver started at http://127.0.0.1:35195/ using document root <none> and password file <none>
I20260812 00:05:53.217861 16151 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:53.217911 16151 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:53.218041 16151 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:53.219125 16151 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786492899949492-12089-0/minicluster-data/master-0/data/instance:
uuid: "4ce03c82160e45849a36062b494fca3d"
format_stamp: "Formatted at 2026-08-12 00:05:53 on dist-test-slave-f0tn"
server_key: "7483080c73de9b126b9df28f86d7759f"
server_key_iv: "9163a399310069d78b6618c3663bdb8b"
server_key_version: "encryptionkey@0"
I20260812 00:05:53.219467 16151 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786492899949492-12089-0/minicluster-data/master-0/wal/instance:
uuid: "4ce03c82160e45849a36062b494fca3d"
format_stamp: "Formatted at 2026-08-12 00:05:53 on dist-test-slave-f0tn"
server_key: "7483080c73de9b126b9df28f86d7759f"
server_key_iv: "9163a399310069d78b6618c3663bdb8b"
server_key_version: "encryptionkey@0"
I20260812 00:05:53.220748 16151 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 00:05:53.221463 16178 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:53.221603 16151 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:05:53.221692 16151 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786492899949492-12089-0/minicluster-data/master-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786492899949492-12089-0/minicluster-data/master-0/wal
uuid: "4ce03c82160e45849a36062b494fca3d"
format_stamp: "Formatted at 2026-08-12 00:05:53 on dist-test-slave-f0tn"
server_key: "7483080c73de9b126b9df28f86d7759f"
server_key_iv: "9163a399310069d78b6618c3663bdb8b"
server_key_version: "encryptionkey@0"
I20260812 00:05:53.221765 16151 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786492899949492-12089-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786492899949492-12089-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786492899949492-12089-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:53.225024 16151 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:53.227324 16151 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:53.227458 16151 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:53.231189 16151 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36407
I20260812 00:05:53.231238 16281 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36407 every 8 connection(s)
I20260812 00:05:53.231527 16151 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
I20260812 00:05:53.232530 16282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:53.234869 16282 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ce03c82160e45849a36062b494fca3d: Bootstrap starting.
I20260812 00:05:53.235431 16282 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4ce03c82160e45849a36062b494fca3d: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:53.235687 16282 log.cc:824] T 00000000000000000000000000000000 P 4ce03c82160e45849a36062b494fca3d: Log is configured to *not* fsync() on all Append() calls
I20260812 00:05:53.236321 16282 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ce03c82160e45849a36062b494fca3d: No bootstrap required, opened a new log
I20260812 00:05:53.237001 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 16151
I20260812 00:05:53.237112 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786492899949492-12089-0/minicluster-data/master-0/wal/instance
I20260812 00:05:53.237300 12089 external_mini_cluster.cc:1428] Setting key 5ea9222659f4b13841b7d8a5acfd5fb5
I20260812 00:05:53.238179 16282 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4ce03c82160e45849a36062b494fca3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ce03c82160e45849a36062b494fca3d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36407 } }
I20260812 00:05:53.238360 16282 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4ce03c82160e45849a36062b494fca3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:53.238411 16282 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4ce03c82160e45849a36062b494fca3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ce03c82160e45849a36062b494fca3d, State: Initialized, Role: FOLLOWER
I20260812 00:05:53.238538 16282 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4ce03c82160e45849a36062b494fca3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ce03c82160e45849a36062b494fca3d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36407 } }
I20260812 00:05:53.238623 16282 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4ce03c82160e45849a36062b494fca3d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:05:53.238646 16282 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4ce03c82160e45849a36062b494fca3d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:05:53.238692 16282 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4ce03c82160e45849a36062b494fca3d [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:53.239333 16290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:53.237795 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50037 (local address 127.0.0.1:36407)
0812 00:05:53.237952 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:53.237960 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:53.237985 (+ 25us) server_negotiation.cc:407] Connection header received
0812 00:05:53.238135 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:53.238140 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:53.238163 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:53.238271 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:53.238929 (+ 658us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:53.238932 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:53.238932 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:05:53.238936 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:53.238973 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:05:53.238984 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:53.239035 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:53.239115 (+ 80us) server_negotiation.cc:299] Negotiation successful
0812 00:05:53.239147 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109,"thread_start_us":67,"threads_started":1}
I20260812 00:05:53.239686 16282 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4ce03c82160e45849a36062b494fca3d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ce03c82160e45849a36062b494fca3d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36407 } }
I20260812 00:05:53.239792 16282 leader_election.cc:302] T 00000000000000000000000000000000 P 4ce03c82160e45849a36062b494fca3d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4ce03c82160e45849a36062b494fca3d; no voters:
I20260812 00:05:53.239946 16282 leader_election.cc:288] T 00000000000000000000000000000000 P 4ce03c82160e45849a36062b494fca3d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:05:53.239984 16291 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4ce03c82160e45849a36062b494fca3d [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:05:53.240097 16291 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4ce03c82160e45849a36062b494fca3d [term 1 LEADER]: Becoming Leader. State: Replica: 4ce03c82160e45849a36062b494fca3d, State: Running, Role: LEADER
I20260812 00:05:53.240204 12089 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:05:53.240199 16282 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4ce03c82160e45849a36062b494fca3d [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:05:53.240193 16291 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4ce03c82160e45849a36062b494fca3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ce03c82160e45849a36062b494fca3d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36407 } }
I20260812 00:05:53.240540 16291 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ce03c82160e45849a36062b494fca3d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4ce03c82160e45849a36062b494fca3d. Latest consensus state: current_term: 1 leader_uuid: "4ce03c82160e45849a36062b494fca3d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ce03c82160e45849a36062b494fca3d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36407 } } }
I20260812 00:05:53.240602 16291 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ce03c82160e45849a36062b494fca3d [sys.catalog]: This master's current role is: LEADER
I20260812 00:05:53.240748 16293 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ce03c82160e45849a36062b494fca3d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4ce03c82160e45849a36062b494fca3d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ce03c82160e45849a36062b494fca3d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36407 } } }
I20260812 00:05:53.240800 16293 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ce03c82160e45849a36062b494fca3d [sys.catalog]: This master's current role is: LEADER
W20260812 00:05:53.241984 16327 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4ce03c82160e45849a36062b494fca3d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 00:05:53.242040 16327 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 00:05:53.242092 16305 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:05:53.242229 16305 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:05:53.243590 16305 catalog_manager.cc:1347] Generated new cluster ID: 439eba5cc128402683587367d1ef06f8
I20260812 00:05:53.243641 16305 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:05:53.246407 16290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:53.241754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35853 (local address 127.0.0.1:36407)
0812 00:05:53.241799 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:53.241801 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:53.245548 (+ 3747us) server_negotiation.cc:407] Connection header received
0812 00:05:53.245615 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:53.245616 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:53.245621 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:53.245670 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:53.246212 (+ 542us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:53.246213 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:53.246214 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:05:53.246217 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:53.246232 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:05:53.246235 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:53.246277 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:53.246338 (+ 61us) server_negotiation.cc:299] Negotiation successful
0812 00:05:53.246349 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260812 00:05:53.257968 16305 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:05:53.258104 16305 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:05:53.265240 16305 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4ce03c82160e45849a36062b494fca3d: Generated new TSK 0
I20260812 00:05:53.265429 16305 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:05:53.273932 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 16151
2026-08-12T00:05:53Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1443 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786492899949492-12089-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:05:53 dist-test-slave-f0tn krb5kdc[16340](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:05:53 dist-test-slave-f0tn krb5kdc[16340](info): set up 2 sockets
Aug 12 00:05:53 dist-test-slave-f0tn krb5kdc[16340](info): commencing operation
krb5kdc: starting...
W20260812 00:05:54.486227 12089 mini_kdc.cc:121] Time spent starting KDC: real 1.187s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786492899949492-12089-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786492899949492-12089-0/krb5kdc/test-user.keytab.
Aug 12 00:05:54 dist-test-slave-f0tn krb5kdc[16340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493154, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:05:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:05:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786492899949492-12089-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786492899949492-12089-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 00:05:54.602537 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786492899949492-12089-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786492899949492-12089-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786492899949492-12089-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33001
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786492899949492-12089-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37655
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33001
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:05:54.684490 16362 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:54.684712 16362 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:54.684736 16362 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:54.685928 16362 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:05:54.685973 16362 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:54.685986 16362 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:54.685997 16362 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:05:54.686010 16362 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:05:54.687525 16362 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37655
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786492899949492-12089-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786492899949492-12089-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33001
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786492899949492-12089-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33001
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16362
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786492899949492-12089-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:05:54.687759 16362 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:54.687978 16362 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:54.693143 16378 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:54.693301 16362 server_base.cc:1034] running on GCE node
W20260812 00:05:54.693161 16369 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:54.693161 16372 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:54.693668 16362 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:54.693984 16362 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:54.695127 16362 hybrid_clock.cc:648] HybridClock initialized: now 1786493154695110 us; error 34 us; skew 500 ppm
Aug 12 00:05:54 dist-test-slave-f0tn krb5kdc[16340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493154, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:54.697620 16362 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 00:05:54.698065 16362 webserver.cc:460] Webserver started at http://127.0.0.1:33381/ using document root <none> and password file <none>
I20260812 00:05:54.698251 16362 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:54.698290 16362 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:54.698377 16362 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:54.699458 16362 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786492899949492-12089-0/minicluster-data/master-0/data/instance:
uuid: "3d9b544d35ea48e89753059c1dc219f3"
format_stamp: "Formatted at 2026-08-12 00:05:54 on dist-test-slave-f0tn"
server_key: "0375cebf0f2313e639a5fc148d2e5f8f"
server_key_iv: "27f16a73d6d700ed9f8e522d7bb75b10"
server_key_version: "encryptionkey@0"
I20260812 00:05:54.699795 16362 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786492899949492-12089-0/minicluster-data/master-0/wal/instance:
uuid: "3d9b544d35ea48e89753059c1dc219f3"
format_stamp: "Formatted at 2026-08-12 00:05:54 on dist-test-slave-f0tn"
server_key: "0375cebf0f2313e639a5fc148d2e5f8f"
server_key_iv: "27f16a73d6d700ed9f8e522d7bb75b10"
server_key_version: "encryptionkey@0"
I20260812 00:05:54.701049 16362 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 00:05:54.701748 16386 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:54.701920 16362 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:54.702003 16362 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786492899949492-12089-0/minicluster-data/master-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786492899949492-12089-0/minicluster-data/master-0/wal
uuid: "3d9b544d35ea48e89753059c1dc219f3"
format_stamp: "Formatted at 2026-08-12 00:05:54 on dist-test-slave-f0tn"
server_key: "0375cebf0f2313e639a5fc148d2e5f8f"
server_key_iv: "27f16a73d6d700ed9f8e522d7bb75b10"
server_key_version: "encryptionkey@0"
I20260812 00:05:54.702056 16362 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786492899949492-12089-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786492899949492-12089-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786492899949492-12089-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:54.744005 16362 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:54.746254 16362 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:54.746371 16362 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:54.750061 16362 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33001
I20260812 00:05:54.750113 16473 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33001 every 8 connection(s)
I20260812 00:05:54.750432 16362 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
I20260812 00:05:54.751333 16475 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:54.753630 16475 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d9b544d35ea48e89753059c1dc219f3: Bootstrap starting.
I20260812 00:05:54.754163 16475 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3d9b544d35ea48e89753059c1dc219f3: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:54.754400 16475 log.cc:824] T 00000000000000000000000000000000 P 3d9b544d35ea48e89753059c1dc219f3: Log is configured to *not* fsync() on all Append() calls
I20260812 00:05:54.755048 16475 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d9b544d35ea48e89753059c1dc219f3: No bootstrap required, opened a new log
I20260812 00:05:54.756556 16475 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3d9b544d35ea48e89753059c1dc219f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d9b544d35ea48e89753059c1dc219f3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33001 } }
I20260812 00:05:54.756698 16475 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3d9b544d35ea48e89753059c1dc219f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:54.756726 16475 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3d9b544d35ea48e89753059c1dc219f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d9b544d35ea48e89753059c1dc219f3, State: Initialized, Role: FOLLOWER
I20260812 00:05:54.756846 16475 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3d9b544d35ea48e89753059c1dc219f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d9b544d35ea48e89753059c1dc219f3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33001 } }
I20260812 00:05:54.756924 16475 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3d9b544d35ea48e89753059c1dc219f3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:05:54.756954 16475 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3d9b544d35ea48e89753059c1dc219f3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:05:54.756987 16475 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3d9b544d35ea48e89753059c1dc219f3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:54.757493 16475 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3d9b544d35ea48e89753059c1dc219f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d9b544d35ea48e89753059c1dc219f3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33001 } }
I20260812 00:05:54.757580 16475 leader_election.cc:302] T 00000000000000000000000000000000 P 3d9b544d35ea48e89753059c1dc219f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3d9b544d35ea48e89753059c1dc219f3; no voters:
I20260812 00:05:54.757728 16475 leader_election.cc:288] T 00000000000000000000000000000000 P 3d9b544d35ea48e89753059c1dc219f3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:05:54.757787 16481 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3d9b544d35ea48e89753059c1dc219f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:05:54.757825 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 16362
I20260812 00:05:54.757918 16481 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3d9b544d35ea48e89753059c1dc219f3 [term 1 LEADER]: Becoming Leader. State: Replica: 3d9b544d35ea48e89753059c1dc219f3, State: Running, Role: LEADER
I20260812 00:05:54.757947 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786492899949492-12089-0/minicluster-data/master-0/wal/instance
I20260812 00:05:54.757997 16475 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3d9b544d35ea48e89753059c1dc219f3 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:05:54.758152 12089 external_mini_cluster.cc:1428] Setting key 295fe495250939cc138fd63ea70475a5
I20260812 00:05:54.758153 16481 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3d9b544d35ea48e89753059c1dc219f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d9b544d35ea48e89753059c1dc219f3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33001 } }
I20260812 00:05:54.759258 16484 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d9b544d35ea48e89753059c1dc219f3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3d9b544d35ea48e89753059c1dc219f3. Latest consensus state: current_term: 1 leader_uuid: "3d9b544d35ea48e89753059c1dc219f3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d9b544d35ea48e89753059c1dc219f3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33001 } } }
I20260812 00:05:54.759346 16484 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d9b544d35ea48e89753059c1dc219f3 [sys.catalog]: This master's current role is: LEADER
I20260812 00:05:54.759591 16503 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:05:54.759950 16485 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d9b544d35ea48e89753059c1dc219f3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3d9b544d35ea48e89753059c1dc219f3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d9b544d35ea48e89753059c1dc219f3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33001 } } }
I20260812 00:05:54.760082 16485 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d9b544d35ea48e89753059c1dc219f3 [sys.catalog]: This master's current role is: LEADER
I20260812 00:05:54.760212 16503 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:05:54.761830 16503 catalog_manager.cc:1347] Generated new cluster ID: 258faad8b3e84c249a3434bf6aa1c485
I20260812 00:05:54.761884 16503 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 00:05:54 dist-test-slave-f0tn krb5kdc[16340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493154, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260812 00:05:54.769801 16491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:54.758652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34203 (local address 127.0.0.1:33001)
0812 00:05:54.758827 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:54.758837 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:54.759055 (+ 218us) server_negotiation.cc:407] Connection header received
0812 00:05:54.759185 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:54.759193 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:54.759245 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:54.759368 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:54.760121 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:54.761438 (+ 1317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:54.762533 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:54.763138 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:54.763229 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:54.766080 (+ 2851us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:54.766085 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:54.766086 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:54.766100 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:54.768079 (+ 1979us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:54.768457 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:54.768461 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:54.768461 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:54.768598 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:54.768782 (+ 184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:54.768783 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:54.768783 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:54.769130 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:54.769291 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:54.769412 (+ 121us) server_negotiation.cc:299] Negotiation successful
0812 00:05:54.769563 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":77,"threads_started":1}
I20260812 00:05:54.770975 12089 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:05:54.779145 16491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:54.772409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40769 (local address 127.0.0.1:33001)
0812 00:05:54.772444 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:54.772445 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:54.772547 (+ 102us) server_negotiation.cc:407] Connection header received
0812 00:05:54.772588 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:54.772589 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:54.772599 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:54.772658 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:54.773230 (+ 572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:54.774049 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:54.775024 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:54.775338 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:54.775405 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:54.776620 (+ 1215us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:54.776622 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:54.776622 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:54.776629 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:54.778134 (+ 1505us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:54.778467 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:54.778468 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:54.778468 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:54.778522 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:54.778675 (+ 153us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:54.778676 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:54.778676 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:54.778803 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:54.778889 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:54.778979 (+ 90us) server_negotiation.cc:299] Negotiation successful
0812 00:05:54.779054 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260812 00:05:54.780781 16503 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:05:54.781529 16503 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:05:54.788939 16503 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3d9b544d35ea48e89753059c1dc219f3: Generated new TSK 0
I20260812 00:05:54.789173 16503 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:05:54.798286 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 16362
2026-08-12T00:05:54Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1524 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786492899949492-12089-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:05:54 dist-test-slave-f0tn krb5kdc[16525](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:05:54 dist-test-slave-f0tn krb5kdc[16525](info): set up 2 sockets
Aug 12 00:05:54 dist-test-slave-f0tn krb5kdc[16525](info): commencing operation
krb5kdc: starting...
W20260812 00:05:55.975106 12089 mini_kdc.cc:121] Time spent starting KDC: real 1.152s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786492899949492-12089-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786492899949492-12089-0/krb5kdc/test-user.keytab.
Aug 12 00:05:56 dist-test-slave-f0tn krb5kdc[16525](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493156, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:05:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:05:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786492899949492-12089-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786492899949492-12089-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 00:05:56.089143 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786492899949492-12089-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786492899949492-12089-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786492899949492-12089-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39303
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786492899949492-12089-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34671
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39303
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:05:56.171808 16546 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:56.172032 16546 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:56.172065 16546 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:56.173207 16546 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:05:56.173257 16546 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:56.173276 16546 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:56.173292 16546 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:05:56.173309 16546 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:05:56.174823 16546 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34671
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786492899949492-12089-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786492899949492-12089-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39303
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786492899949492-12089-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39303
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16546
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786492899949492-12089-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:05:56.175071 16546 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:56.175288 16546 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 00:05:56.180037 16546 server_base.cc:1034] running on GCE node
W20260812 00:05:56.179993 16554 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:56.179993 16552 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:56.180004 16557 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:56.180481 16546 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:56.180757 16546 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:56.181890 16546 hybrid_clock.cc:648] HybridClock initialized: now 1786493156181877 us; error 28 us; skew 500 ppm
Aug 12 00:05:56 dist-test-slave-f0tn krb5kdc[16525](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493156, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:56.187508 16546 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 00:05:56.187987 16546 webserver.cc:460] Webserver started at http://127.0.0.1:42541/ using document root <none> and password file <none>
I20260812 00:05:56.188199 16546 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:56.188249 16546 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:56.188380 16546 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:56.189494 16546 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786492899949492-12089-0/minicluster-data/master-0/data/instance:
uuid: "ff9d631118c14d79b0cae5c501f895c5"
format_stamp: "Formatted at 2026-08-12 00:05:56 on dist-test-slave-f0tn"
server_key: "eba1ff8d2dced365adc6cb60b8ac56df"
server_key_iv: "7e5f6076cd6f82ee8927bbf0d367a680"
server_key_version: "encryptionkey@0"
I20260812 00:05:56.189848 16546 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786492899949492-12089-0/minicluster-data/master-0/wal/instance:
uuid: "ff9d631118c14d79b0cae5c501f895c5"
format_stamp: "Formatted at 2026-08-12 00:05:56 on dist-test-slave-f0tn"
server_key: "eba1ff8d2dced365adc6cb60b8ac56df"
server_key_iv: "7e5f6076cd6f82ee8927bbf0d367a680"
server_key_version: "encryptionkey@0"
I20260812 00:05:56.191087 16546 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:05:56.191759 16568 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:56.191910 16546 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:05:56.192001 16546 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786492899949492-12089-0/minicluster-data/master-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786492899949492-12089-0/minicluster-data/master-0/wal
uuid: "ff9d631118c14d79b0cae5c501f895c5"
format_stamp: "Formatted at 2026-08-12 00:05:56 on dist-test-slave-f0tn"
server_key: "eba1ff8d2dced365adc6cb60b8ac56df"
server_key_iv: "7e5f6076cd6f82ee8927bbf0d367a680"
server_key_version: "encryptionkey@0"
I20260812 00:05:56.192067 16546 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786492899949492-12089-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786492899949492-12089-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786492899949492-12089-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:56.202497 16546 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:56.204211 16546 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:56.204346 16546 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:56.208221 16546 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39303
I20260812 00:05:56.208292 16651 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39303 every 8 connection(s)
I20260812 00:05:56.208616 16546 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
I20260812 00:05:56.209512 16652 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:56.211863 16652 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ff9d631118c14d79b0cae5c501f895c5: Bootstrap starting.
I20260812 00:05:56.212440 16652 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ff9d631118c14d79b0cae5c501f895c5: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:56.212679 16652 log.cc:824] T 00000000000000000000000000000000 P ff9d631118c14d79b0cae5c501f895c5: Log is configured to *not* fsync() on all Append() calls
I20260812 00:05:56.213358 16652 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ff9d631118c14d79b0cae5c501f895c5: No bootstrap required, opened a new log
I20260812 00:05:56.214167 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 16546
I20260812 00:05:56.214296 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786492899949492-12089-0/minicluster-data/master-0/wal/instance
I20260812 00:05:56.214515 12089 external_mini_cluster.cc:1428] Setting key c18bd5a707e4f94f87ece14a92867cf5
I20260812 00:05:56.215525 16652 raft_consensus.cc:348] T 00000000000000000000000000000000 P ff9d631118c14d79b0cae5c501f895c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff9d631118c14d79b0cae5c501f895c5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39303 } }
I20260812 00:05:56.215745 16652 raft_consensus.cc:374] T 00000000000000000000000000000000 P ff9d631118c14d79b0cae5c501f895c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:56.215785 16652 raft_consensus.cc:729] T 00000000000000000000000000000000 P ff9d631118c14d79b0cae5c501f895c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff9d631118c14d79b0cae5c501f895c5, State: Initialized, Role: FOLLOWER
I20260812 00:05:56.215973 16652 consensus_queue.cc:260] T 00000000000000000000000000000000 P ff9d631118c14d79b0cae5c501f895c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff9d631118c14d79b0cae5c501f895c5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39303 } }
I20260812 00:05:56.216071 16652 raft_consensus.cc:388] T 00000000000000000000000000000000 P ff9d631118c14d79b0cae5c501f895c5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:05:56.216130 16652 raft_consensus.cc:482] T 00000000000000000000000000000000 P ff9d631118c14d79b0cae5c501f895c5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:05:56.216182 16652 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ff9d631118c14d79b0cae5c501f895c5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:56.216949 16652 raft_consensus.cc:504] T 00000000000000000000000000000000 P ff9d631118c14d79b0cae5c501f895c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff9d631118c14d79b0cae5c501f895c5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39303 } }
I20260812 00:05:56.217128 16652 leader_election.cc:302] T 00000000000000000000000000000000 P ff9d631118c14d79b0cae5c501f895c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ff9d631118c14d79b0cae5c501f895c5; no voters:
I20260812 00:05:56.217351 16652 leader_election.cc:288] T 00000000000000000000000000000000 P ff9d631118c14d79b0cae5c501f895c5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:05:56.217631 16661 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ff9d631118c14d79b0cae5c501f895c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:05:56.217700 16652 sys_catalog.cc:564] T 00000000000000000000000000000000 P ff9d631118c14d79b0cae5c501f895c5 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:05:56.218453 16661 raft_consensus.cc:686] T 00000000000000000000000000000000 P ff9d631118c14d79b0cae5c501f895c5 [term 1 LEADER]: Becoming Leader. State: Replica: ff9d631118c14d79b0cae5c501f895c5, State: Running, Role: LEADER
I20260812 00:05:56.218582 16661 consensus_queue.cc:237] T 00000000000000000000000000000000 P ff9d631118c14d79b0cae5c501f895c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff9d631118c14d79b0cae5c501f895c5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39303 } }
I20260812 00:05:56.219030 16661 sys_catalog.cc:455] T 00000000000000000000000000000000 P ff9d631118c14d79b0cae5c501f895c5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ff9d631118c14d79b0cae5c501f895c5. Latest consensus state: current_term: 1 leader_uuid: "ff9d631118c14d79b0cae5c501f895c5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff9d631118c14d79b0cae5c501f895c5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39303 } } }
I20260812 00:05:56.219110 16661 sys_catalog.cc:458] T 00000000000000000000000000000000 P ff9d631118c14d79b0cae5c501f895c5 [sys.catalog]: This master's current role is: LEADER
I20260812 00:05:56.219332 16660 sys_catalog.cc:455] T 00000000000000000000000000000000 P ff9d631118c14d79b0cae5c501f895c5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ff9d631118c14d79b0cae5c501f895c5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff9d631118c14d79b0cae5c501f895c5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39303 } } }
I20260812 00:05:56.219415 16660 sys_catalog.cc:458] T 00000000000000000000000000000000 P ff9d631118c14d79b0cae5c501f895c5 [sys.catalog]: This master's current role is: LEADER
I20260812 00:05:56.219882 16690 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:05:56.220362 16690 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:05:56.221273 16659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:56.215358 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58291 (local address 127.0.0.1:39303)
0812 00:05:56.215999 (+ 641us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:56.216009 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:56.216049 (+ 40us) server_negotiation.cc:407] Connection header received
0812 00:05:56.216186 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:56.216195 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:56.216268 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:56.216428 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:56.216719 (+ 291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:56.218033 (+ 1314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:56.219104 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:56.219725 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:56.219829 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:56.220631 (+ 802us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:56.220635 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:56.220636 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:05:56.220805 (+ 169us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:56.220836 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:05:56.220848 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:56.220906 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:56.220983 (+ 77us) server_negotiation.cc:299] Negotiation successful
0812 00:05:56.221051 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":570,"thread_start_us":467,"threads_started":1}
I20260812 00:05:56.222113 16690 catalog_manager.cc:1347] Generated new cluster ID: 49f275e38ad043ea8c9d6c6596ce6f8f
I20260812 00:05:56.222165 16690 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:05:56.222270 12089 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:05:56.232152 16659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:56.223519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53069 (local address 127.0.0.1:39303)
0812 00:05:56.223552 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:56.223554 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:56.229607 (+ 6053us) server_negotiation.cc:407] Connection header received
0812 00:05:56.229668 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:56.229669 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:56.229681 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:56.229731 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:56.229864 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:56.230354 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:56.231046 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:56.231251 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:56.231310 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:56.231919 (+ 609us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:56.231920 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:56.231920 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:05:56.231926 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:56.231940 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:05:56.231944 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:56.231990 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:56.232049 (+ 59us) server_negotiation.cc:299] Negotiation successful
0812 00:05:56.232074 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260812 00:05:56.249291 16690 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:05:56.249846 16690 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:05:56.257987 16690 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ff9d631118c14d79b0cae5c501f895c5: Generated new TSK 0
I20260812 00:05:56.258180 16690 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:05:56.263393 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 16546
2026-08-12T00:05:56Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1472 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786492899949492-12089-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:05:56 dist-test-slave-f0tn krb5kdc[16707](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:05:56 dist-test-slave-f0tn krb5kdc[16707](info): set up 2 sockets
Aug 12 00:05:56 dist-test-slave-f0tn krb5kdc[16707](info): commencing operation
krb5kdc: starting...
W20260812 00:05:57.465097 12089 mini_kdc.cc:121] Time spent starting KDC: real 1.169s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786492899949492-12089-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786492899949492-12089-0/krb5kdc/test-user.keytab.
Aug 12 00:05:57 dist-test-slave-f0tn krb5kdc[16707](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493157, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:05:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:05:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786492899949492-12089-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786492899949492-12089-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 00:05:57.578042 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786492899949492-12089-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786492899949492-12089-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786492899949492-12089-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:32961
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786492899949492-12089-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38339
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:32961
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:05:57.661011 16726 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:57.661245 16726 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:57.661269 16726 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:57.662463 16726 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:05:57.662509 16726 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:57.662528 16726 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:57.662550 16726 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:05:57.662569 16726 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:05:57.664058 16726 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38339
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786492899949492-12089-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786492899949492-12089-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:32961
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786492899949492-12089-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:32961
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16726
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786492899949492-12089-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:05:57.664266 16726 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:57.664461 16726 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:57.669196 16749 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:57.669214 16744 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:57.669216 16747 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:57.669528 16726 server_base.cc:1034] running on GCE node
I20260812 00:05:57.669757 16726 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:57.670048 16726 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:57.671192 16726 hybrid_clock.cc:648] HybridClock initialized: now 1786493157671163 us; error 44 us; skew 500 ppm
Aug 12 00:05:57 dist-test-slave-f0tn krb5kdc[16707](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493157, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:57.673692 16726 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 00:05:57.674129 16726 webserver.cc:460] Webserver started at http://127.0.0.1:36877/ using document root <none> and password file <none>
I20260812 00:05:57.674353 16726 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:57.674402 16726 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:57.674525 16726 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:57.675577 16726 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786492899949492-12089-0/minicluster-data/master-0/data/instance:
uuid: "e8053024e7334c0bad1b176432276484"
format_stamp: "Formatted at 2026-08-12 00:05:57 on dist-test-slave-f0tn"
server_key: "c32fe59f0f296476f8031bb5a0375aee"
server_key_iv: "18e81decd873cbfbe5f9c78de4e6dd5a"
server_key_version: "encryptionkey@0"
I20260812 00:05:57.675921 16726 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786492899949492-12089-0/minicluster-data/master-0/wal/instance:
uuid: "e8053024e7334c0bad1b176432276484"
format_stamp: "Formatted at 2026-08-12 00:05:57 on dist-test-slave-f0tn"
server_key: "c32fe59f0f296476f8031bb5a0375aee"
server_key_iv: "18e81decd873cbfbe5f9c78de4e6dd5a"
server_key_version: "encryptionkey@0"
I20260812 00:05:57.677163 16726 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 00:05:57.677901 16760 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:57.678049 16726 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:57.678134 16726 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786492899949492-12089-0/minicluster-data/master-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786492899949492-12089-0/minicluster-data/master-0/wal
uuid: "e8053024e7334c0bad1b176432276484"
format_stamp: "Formatted at 2026-08-12 00:05:57 on dist-test-slave-f0tn"
server_key: "c32fe59f0f296476f8031bb5a0375aee"
server_key_iv: "18e81decd873cbfbe5f9c78de4e6dd5a"
server_key_version: "encryptionkey@0"
I20260812 00:05:57.678200 16726 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786492899949492-12089-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786492899949492-12089-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786492899949492-12089-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:57.681427 16726 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:57.683234 16726 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:57.683372 16726 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:57.687167 16726 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:32961
I20260812 00:05:57.687222 16848 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:32961 every 8 connection(s)
I20260812 00:05:57.687599 16726 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
I20260812 00:05:57.688566 16849 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:57.690838 16849 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e8053024e7334c0bad1b176432276484: Bootstrap starting.
I20260812 00:05:57.691388 16849 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e8053024e7334c0bad1b176432276484: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:57.691633 16849 log.cc:824] T 00000000000000000000000000000000 P e8053024e7334c0bad1b176432276484: Log is configured to *not* fsync() on all Append() calls
I20260812 00:05:57.692276 16849 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e8053024e7334c0bad1b176432276484: No bootstrap required, opened a new log
I20260812 00:05:57.692792 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 16726
I20260812 00:05:57.692903 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786492899949492-12089-0/minicluster-data/master-0/wal/instance
I20260812 00:05:57.693074 12089 external_mini_cluster.cc:1428] Setting key e905cfb525034e5cd229319f8a1d70c4
I20260812 00:05:57.694190 16849 raft_consensus.cc:348] T 00000000000000000000000000000000 P e8053024e7334c0bad1b176432276484 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8053024e7334c0bad1b176432276484" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32961 } }
I20260812 00:05:57.694373 16849 raft_consensus.cc:374] T 00000000000000000000000000000000 P e8053024e7334c0bad1b176432276484 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:57.694448 16849 raft_consensus.cc:729] T 00000000000000000000000000000000 P e8053024e7334c0bad1b176432276484 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8053024e7334c0bad1b176432276484, State: Initialized, Role: FOLLOWER
I20260812 00:05:57.694581 16849 consensus_queue.cc:260] T 00000000000000000000000000000000 P e8053024e7334c0bad1b176432276484 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8053024e7334c0bad1b176432276484" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32961 } }
I20260812 00:05:57.694661 16849 raft_consensus.cc:388] T 00000000000000000000000000000000 P e8053024e7334c0bad1b176432276484 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:05:57.694737 16849 raft_consensus.cc:482] T 00000000000000000000000000000000 P e8053024e7334c0bad1b176432276484 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:05:57.694794 16849 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e8053024e7334c0bad1b176432276484 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:57.695423 16855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:57.693587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58681 (local address 127.0.0.1:32961)
0812 00:05:57.693793 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:57.693803 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:57.693838 (+ 35us) server_negotiation.cc:407] Connection header received
0812 00:05:57.694156 (+ 318us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:57.694164 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:57.694197 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:57.694345 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:57.694996 (+ 651us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:57.695000 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:57.695000 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:05:57.695004 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:57.695043 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:05:57.695058 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:57.695117 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:57.695174 (+ 57us) server_negotiation.cc:299] Negotiation successful
0812 00:05:57.695216 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":73,"threads_started":1}
I20260812 00:05:57.695787 16849 raft_consensus.cc:504] T 00000000000000000000000000000000 P e8053024e7334c0bad1b176432276484 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8053024e7334c0bad1b176432276484" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32961 } }
I20260812 00:05:57.695885 16849 leader_election.cc:302] T 00000000000000000000000000000000 P e8053024e7334c0bad1b176432276484 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e8053024e7334c0bad1b176432276484; no voters:
I20260812 00:05:57.696033 16849 leader_election.cc:288] T 00000000000000000000000000000000 P e8053024e7334c0bad1b176432276484 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:05:57.696058 16856 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e8053024e7334c0bad1b176432276484 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:05:57.696249 16856 raft_consensus.cc:686] T 00000000000000000000000000000000 P e8053024e7334c0bad1b176432276484 [term 1 LEADER]: Becoming Leader. State: Replica: e8053024e7334c0bad1b176432276484, State: Running, Role: LEADER
I20260812 00:05:57.696295 16849 sys_catalog.cc:564] T 00000000000000000000000000000000 P e8053024e7334c0bad1b176432276484 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:05:57.696352 12089 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:05:57.696414 16856 consensus_queue.cc:237] T 00000000000000000000000000000000 P e8053024e7334c0bad1b176432276484 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8053024e7334c0bad1b176432276484" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32961 } }
I20260812 00:05:57.696765 16859 sys_catalog.cc:455] T 00000000000000000000000000000000 P e8053024e7334c0bad1b176432276484 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e8053024e7334c0bad1b176432276484. Latest consensus state: current_term: 1 leader_uuid: "e8053024e7334c0bad1b176432276484" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8053024e7334c0bad1b176432276484" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32961 } } }
I20260812 00:05:57.696849 16859 sys_catalog.cc:458] T 00000000000000000000000000000000 P e8053024e7334c0bad1b176432276484 [sys.catalog]: This master's current role is: LEADER
I20260812 00:05:57.697047 16858 sys_catalog.cc:455] T 00000000000000000000000000000000 P e8053024e7334c0bad1b176432276484 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e8053024e7334c0bad1b176432276484" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8053024e7334c0bad1b176432276484" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32961 } } }
I20260812 00:05:57.697363 16858 sys_catalog.cc:458] T 00000000000000000000000000000000 P e8053024e7334c0bad1b176432276484 [sys.catalog]: This master's current role is: LEADER
I20260812 00:05:57.697535 16869 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:05:57.698031 16869 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:05:57.699270 16855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:57.698084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59389 (local address 127.0.0.1:32961)
0812 00:05:57.698120 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:57.698122 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:57.698341 (+ 219us) server_negotiation.cc:407] Connection header received
0812 00:05:57.698385 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:57.698386 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:57.698391 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:57.698446 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:57.699013 (+ 567us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:57.699014 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:57.699014 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:05:57.699018 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:57.699034 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:05:57.699037 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:57.699088 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:57.699186 (+ 98us) server_negotiation.cc:299] Negotiation successful
0812 00:05:57.699200 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 00:05:57.699644 16869 catalog_manager.cc:1347] Generated new cluster ID: 24571bdb56074eb98d7b5d2aa8cac96d
I20260812 00:05:57.699728 16869 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:05:57.710439 16869 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:05:57.710601 16869 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:05:57.717648 16869 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e8053024e7334c0bad1b176432276484: Generated new TSK 0
I20260812 00:05:57.717816 16869 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:05:57.724978 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 16726
2026-08-12T00:05:57Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1462 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786492899949492-12089-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:05:57 dist-test-slave-f0tn krb5kdc[16899](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:05:57 dist-test-slave-f0tn krb5kdc[16899](info): set up 2 sockets
Aug 12 00:05:57 dist-test-slave-f0tn krb5kdc[16899](info): commencing operation
krb5kdc: starting...
W20260812 00:05:58.922863 12089 mini_kdc.cc:121] Time spent starting KDC: real 1.164s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786492899949492-12089-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786492899949492-12089-0/krb5kdc/test-user.keytab.
Aug 12 00:05:58 dist-test-slave-f0tn krb5kdc[16899](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493158, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:05:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:05:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786492899949492-12089-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786492899949492-12089-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 00:05:59.034036 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786492899949492-12089-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786492899949492-12089-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786492899949492-12089-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40395
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786492899949492-12089-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37241
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40395
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:05:59.117578 16933 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:05:59.117794 16933 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:05:59.117820 16933 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:05:59.118978 16933 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:05:59.119024 16933 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:05:59.119040 16933 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:05:59.119050 16933 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:05:59.119060 16933 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:05:59.120550 16933 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37241
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786492899949492-12089-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786492899949492-12089-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40395
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786492899949492-12089-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40395
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16933
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786492899949492-12089-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:05:59.120766 16933 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:05:59.120952 16933 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:05:59.125977 16939 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:59.126021 16943 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:05:59.126019 16940 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:05:59.126008 16933 server_base.cc:1034] running on GCE node
I20260812 00:05:59.126471 16933 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:05:59.126773 16933 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:05:59.127938 16933 hybrid_clock.cc:648] HybridClock initialized: now 1786493159127922 us; error 28 us; skew 500 ppm
Aug 12 00:05:59 dist-test-slave-f0tn krb5kdc[16899](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493159, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:05:59.130527 16933 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 00:05:59.130971 16933 webserver.cc:460] Webserver started at http://127.0.0.1:46157/ using document root <none> and password file <none>
I20260812 00:05:59.131219 16933 fs_manager.cc:359] Metadata directory not provided
I20260812 00:05:59.131273 16933 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:05:59.131403 16933 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:05:59.132464 16933 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786492899949492-12089-0/minicluster-data/master-0/data/instance:
uuid: "abbae5ee86c44bad96a63fc5532387b5"
format_stamp: "Formatted at 2026-08-12 00:05:59 on dist-test-slave-f0tn"
server_key: "3289f8573e2703482c6520375a3f04e4"
server_key_iv: "9eeb38cb61ef251332bb2cfe9b9b8304"
server_key_version: "encryptionkey@0"
I20260812 00:05:59.132820 16933 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786492899949492-12089-0/minicluster-data/master-0/wal/instance:
uuid: "abbae5ee86c44bad96a63fc5532387b5"
format_stamp: "Formatted at 2026-08-12 00:05:59 on dist-test-slave-f0tn"
server_key: "3289f8573e2703482c6520375a3f04e4"
server_key_iv: "9eeb38cb61ef251332bb2cfe9b9b8304"
server_key_version: "encryptionkey@0"
I20260812 00:05:59.134251 16933 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 00:05:59.134981 16955 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:05:59.135143 16933 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:05:59.135226 16933 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786492899949492-12089-0/minicluster-data/master-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786492899949492-12089-0/minicluster-data/master-0/wal
uuid: "abbae5ee86c44bad96a63fc5532387b5"
format_stamp: "Formatted at 2026-08-12 00:05:59 on dist-test-slave-f0tn"
server_key: "3289f8573e2703482c6520375a3f04e4"
server_key_iv: "9eeb38cb61ef251332bb2cfe9b9b8304"
server_key_version: "encryptionkey@0"
I20260812 00:05:59.135290 16933 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786492899949492-12089-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786492899949492-12089-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786492899949492-12089-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:05:59.152726 16933 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:05:59.154732 16933 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:05:59.154887 16933 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:05:59.158825 16933 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40395
I20260812 00:05:59.158864 17040 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40395 every 8 connection(s)
I20260812 00:05:59.159198 16933 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
I20260812 00:05:59.160141 17041 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:05:59.162609 17041 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P abbae5ee86c44bad96a63fc5532387b5: Bootstrap starting.
I20260812 00:05:59.163161 17041 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P abbae5ee86c44bad96a63fc5532387b5: Neither blocks nor log segments found. Creating new log.
I20260812 00:05:59.163393 17041 log.cc:824] T 00000000000000000000000000000000 P abbae5ee86c44bad96a63fc5532387b5: Log is configured to *not* fsync() on all Append() calls
I20260812 00:05:59.164041 17041 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P abbae5ee86c44bad96a63fc5532387b5: No bootstrap required, opened a new log
I20260812 00:05:59.165618 17041 raft_consensus.cc:348] T 00000000000000000000000000000000 P abbae5ee86c44bad96a63fc5532387b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abbae5ee86c44bad96a63fc5532387b5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40395 } }
I20260812 00:05:59.165781 17041 raft_consensus.cc:374] T 00000000000000000000000000000000 P abbae5ee86c44bad96a63fc5532387b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:05:59.165803 17041 raft_consensus.cc:729] T 00000000000000000000000000000000 P abbae5ee86c44bad96a63fc5532387b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abbae5ee86c44bad96a63fc5532387b5, State: Initialized, Role: FOLLOWER
I20260812 00:05:59.165915 17041 consensus_queue.cc:260] T 00000000000000000000000000000000 P abbae5ee86c44bad96a63fc5532387b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abbae5ee86c44bad96a63fc5532387b5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40395 } }
I20260812 00:05:59.165966 17041 raft_consensus.cc:388] T 00000000000000000000000000000000 P abbae5ee86c44bad96a63fc5532387b5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:05:59.165987 17041 raft_consensus.cc:482] T 00000000000000000000000000000000 P abbae5ee86c44bad96a63fc5532387b5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:05:59.166018 17041 raft_consensus.cc:3037] T 00000000000000000000000000000000 P abbae5ee86c44bad96a63fc5532387b5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:05:59.166487 17041 raft_consensus.cc:504] T 00000000000000000000000000000000 P abbae5ee86c44bad96a63fc5532387b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abbae5ee86c44bad96a63fc5532387b5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40395 } }
I20260812 00:05:59.166577 17041 leader_election.cc:302] T 00000000000000000000000000000000 P abbae5ee86c44bad96a63fc5532387b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: abbae5ee86c44bad96a63fc5532387b5; no voters:
I20260812 00:05:59.166702 17041 leader_election.cc:288] T 00000000000000000000000000000000 P abbae5ee86c44bad96a63fc5532387b5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:05:59.166754 17050 raft_consensus.cc:2781] T 00000000000000000000000000000000 P abbae5ee86c44bad96a63fc5532387b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:05:59.166921 17050 raft_consensus.cc:686] T 00000000000000000000000000000000 P abbae5ee86c44bad96a63fc5532387b5 [term 1 LEADER]: Becoming Leader. State: Replica: abbae5ee86c44bad96a63fc5532387b5, State: Running, Role: LEADER
I20260812 00:05:59.166944 17041 sys_catalog.cc:564] T 00000000000000000000000000000000 P abbae5ee86c44bad96a63fc5532387b5 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:05:59.167065 17050 consensus_queue.cc:237] T 00000000000000000000000000000000 P abbae5ee86c44bad96a63fc5532387b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abbae5ee86c44bad96a63fc5532387b5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40395 } }
I20260812 00:05:59.167446 17054 sys_catalog.cc:455] T 00000000000000000000000000000000 P abbae5ee86c44bad96a63fc5532387b5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader abbae5ee86c44bad96a63fc5532387b5. Latest consensus state: current_term: 1 leader_uuid: "abbae5ee86c44bad96a63fc5532387b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abbae5ee86c44bad96a63fc5532387b5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40395 } } }
I20260812 00:05:59.167464 17051 sys_catalog.cc:455] T 00000000000000000000000000000000 P abbae5ee86c44bad96a63fc5532387b5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "abbae5ee86c44bad96a63fc5532387b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abbae5ee86c44bad96a63fc5532387b5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40395 } } }
I20260812 00:05:59.167593 17054 sys_catalog.cc:458] T 00000000000000000000000000000000 P abbae5ee86c44bad96a63fc5532387b5 [sys.catalog]: This master's current role is: LEADER
I20260812 00:05:59.167673 17051 sys_catalog.cc:458] T 00000000000000000000000000000000 P abbae5ee86c44bad96a63fc5532387b5 [sys.catalog]: This master's current role is: LEADER
I20260812 00:05:59.168025 17058 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:05:59.168586 17058 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:05:59.168812 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 16933
I20260812 00:05:59.168936 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786492899949492-12089-0/minicluster-data/master-0/wal/instance
I20260812 00:05:59.169118 12089 external_mini_cluster.cc:1428] Setting key 18a3d27d140d2962064f0a1d70152ece
I20260812 00:05:59.170351 17058 catalog_manager.cc:1347] Generated new cluster ID: 25ec047c5b0545e48dfdf6052c8bb9d9
I20260812 00:05:59.170403 17058 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 00:05:59 dist-test-slave-f0tn krb5kdc[16899](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493158, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260812 00:05:59.178314 17058 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:05:59.178992 17058 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:05:59.180459 17077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:59.169798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.119:52095 (local address 127.0.0.1:40395)
0812 00:05:59.169953 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:59.169962 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:59.170031 (+ 69us) server_negotiation.cc:407] Connection header received
0812 00:05:59.170184 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:59.170191 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:59.170251 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:59.170402 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:59.171130 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:59.172618 (+ 1488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:59.173663 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:59.174295 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:59.174401 (+ 106us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:59.177218 (+ 2817us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:59.177223 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:59.177223 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:59.177235 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:59.178930 (+ 1695us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:59.179356 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:59.179359 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:59.179360 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:59.179449 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:59.179654 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:59.179655 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:59.179655 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:59.179873 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:59.180046 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:59.180131 (+ 85us) server_negotiation.cc:299] Negotiation successful
0812 00:05:59.180246 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107,"thread_start_us":82,"threads_started":1}
I20260812 00:05:59.181324 12089 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:05:59.188060 17077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:05:59.182567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.119:45585 (local address 127.0.0.1:40395)
0812 00:05:59.182602 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0812 00:05:59.182603 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:05:59.182701 (+ 98us) server_negotiation.cc:407] Connection header received
0812 00:05:59.182757 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:05:59.182758 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:05:59.182767 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:05:59.182811 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:05:59.183281 (+ 470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:59.183787 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:59.184460 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:05:59.184680 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:05:59.184741 (+ 61us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:05:59.185846 (+ 1105us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:05:59.185848 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:05:59.185848 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:05:59.185855 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:05:59.187046 (+ 1191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:59.187379 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:59.187380 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:59.187380 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:59.187432 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:05:59.187614 (+ 182us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:05:59.187615 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:05:59.187615 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:05:59.187721 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:05:59.187807 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0812 00:05:59.187923 (+ 116us) server_negotiation.cc:299] Negotiation successful
0812 00:05:59.187980 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260812 00:05:59.203325 17058 catalog_manager.cc:5868] T 00000000000000000000000000000000 P abbae5ee86c44bad96a63fc5532387b5: Generated new TSK 0
I20260812 00:05:59.203533 17058 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:05:59.207933 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 16933
W20260812 00:05:59.217653 16897 connection.cc:535] client connection to 127.0.0.1:40395 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:40395): Connection reset by peer (error 104)
2026-08-12T00:05:59Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1472 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786492899949492-12089-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:05:59 dist-test-slave-f0tn krb5kdc[17092](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:05:59 dist-test-slave-f0tn krb5kdc[17092](info): set up 2 sockets
Aug 12 00:05:59 dist-test-slave-f0tn krb5kdc[17092](info): commencing operation
krb5kdc: starting...
W20260812 00:06:00.401729 12089 mini_kdc.cc:121] Time spent starting KDC: real 1.171s user 0.003s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786492899949492-12089-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786492899949492-12089-0/krb5kdc/test-user.keytab.
Aug 12 00:06:00 dist-test-slave-f0tn krb5kdc[17092](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493160, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:06:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:06:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786492899949492-12089-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786492899949492-12089-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 00:06:00.516232 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786492899949492-12089-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786492899949492-12089-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786492899949492-12089-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36495
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786492899949492-12089-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41769
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36495
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:06:00.603621 17113 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:06:00.603855 17113 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:06:00.603878 17113 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:06:00.604986 17113 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:06:00.605027 17113 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:06:00.605041 17113 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:06:00.605051 17113 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:06:00.605062 17113 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:06:00.606635 17113 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41769
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786492899949492-12089-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786492899949492-12089-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36495
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786492899949492-12089-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36495
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17113
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786492899949492-12089-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:06:00.606868 17113 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:06:00.607057 17113 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 00:06:00.612263 17113 server_base.cc:1034] running on GCE node
W20260812 00:06:00.612210 17126 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:06:00.612265 17122 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:06:00.612234 17123 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:06:00.612635 17113 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:06:00.612927 17113 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:06:00.614063 17113 hybrid_clock.cc:648] HybridClock initialized: now 1786493160614046 us; error 36 us; skew 500 ppm
Aug 12 00:06:00 dist-test-slave-f0tn krb5kdc[17092](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493160, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:06:00.616523 17113 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 00:06:00.616968 17113 webserver.cc:460] Webserver started at http://127.0.0.1:45939/ using document root <none> and password file <none>
I20260812 00:06:00.617197 17113 fs_manager.cc:359] Metadata directory not provided
I20260812 00:06:00.617246 17113 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:06:00.617394 17113 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:06:00.618440 17113 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786492899949492-12089-0/minicluster-data/master-0/data/instance:
uuid: "be55d74f60bc4f629aa80387290050f6"
format_stamp: "Formatted at 2026-08-12 00:06:00 on dist-test-slave-f0tn"
server_key: "ff25e0a3f2de1abf927fda5704c9b9cd"
server_key_iv: "b90f29bd70ea94ebeb74d9b292ab8a23"
server_key_version: "encryptionkey@0"
I20260812 00:06:00.618777 17113 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786492899949492-12089-0/minicluster-data/master-0/wal/instance:
uuid: "be55d74f60bc4f629aa80387290050f6"
format_stamp: "Formatted at 2026-08-12 00:06:00 on dist-test-slave-f0tn"
server_key: "ff25e0a3f2de1abf927fda5704c9b9cd"
server_key_iv: "b90f29bd70ea94ebeb74d9b292ab8a23"
server_key_version: "encryptionkey@0"
I20260812 00:06:00.620010 17113 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 00:06:00.620769 17143 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:06:00.620924 17113 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:06:00.621008 17113 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786492899949492-12089-0/minicluster-data/master-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786492899949492-12089-0/minicluster-data/master-0/wal
uuid: "be55d74f60bc4f629aa80387290050f6"
format_stamp: "Formatted at 2026-08-12 00:06:00 on dist-test-slave-f0tn"
server_key: "ff25e0a3f2de1abf927fda5704c9b9cd"
server_key_iv: "b90f29bd70ea94ebeb74d9b292ab8a23"
server_key_version: "encryptionkey@0"
I20260812 00:06:00.621076 17113 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786492899949492-12089-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786492899949492-12089-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786492899949492-12089-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:06:00.648772 17113 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:06:00.650702 17113 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:06:00.650861 17113 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:06:00.655066 17113 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36495
I20260812 00:06:00.655109 17229 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36495 every 8 connection(s)
I20260812 00:06:00.655462 17113 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
I20260812 00:06:00.656134 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 17113
I20260812 00:06:00.656267 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786492899949492-12089-0/minicluster-data/master-0/wal/instance
I20260812 00:06:00.656394 17230 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:06:00.656473 12089 external_mini_cluster.cc:1428] Setting key d50fca89d8f43095b855f07d2ee393e7
I20260812 00:06:00.659830 17230 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P be55d74f60bc4f629aa80387290050f6: Bootstrap starting.
I20260812 00:06:00.660431 17230 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P be55d74f60bc4f629aa80387290050f6: Neither blocks nor log segments found. Creating new log.
I20260812 00:06:00.660723 17230 log.cc:824] T 00000000000000000000000000000000 P be55d74f60bc4f629aa80387290050f6: Log is configured to *not* fsync() on all Append() calls
I20260812 00:06:00.661458 17230 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P be55d74f60bc4f629aa80387290050f6: No bootstrap required, opened a new log
I20260812 00:06:00.662475 17233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:00.657020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.119:58613 (local address 127.0.0.1:36495)
0812 00:06:00.657288 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:00.657298 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:00.657339 (+ 41us) server_negotiation.cc:407] Connection header received
0812 00:06:00.657911 (+ 572us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:00.657921 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:00.657990 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:00.658139 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:00.658347 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:00.659693 (+ 1346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:00.660501 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:00.661061 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:00.661165 (+ 104us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:00.661891 (+ 726us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:06:00.661896 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:06:00.661896 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:06:00.662059 (+ 163us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:06:00.662093 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:06:00.662104 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:06:00.662173 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:00.662286 (+ 113us) server_negotiation.cc:299] Negotiation successful
0812 00:06:00.662314 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":98,"threads_started":1}
I20260812 00:06:00.662951 17230 raft_consensus.cc:348] T 00000000000000000000000000000000 P be55d74f60bc4f629aa80387290050f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be55d74f60bc4f629aa80387290050f6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36495 } }
I20260812 00:06:00.663085 17230 raft_consensus.cc:374] T 00000000000000000000000000000000 P be55d74f60bc4f629aa80387290050f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:06:00.663117 17230 raft_consensus.cc:729] T 00000000000000000000000000000000 P be55d74f60bc4f629aa80387290050f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be55d74f60bc4f629aa80387290050f6, State: Initialized, Role: FOLLOWER
I20260812 00:06:00.663249 17230 consensus_queue.cc:260] T 00000000000000000000000000000000 P be55d74f60bc4f629aa80387290050f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be55d74f60bc4f629aa80387290050f6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36495 } }
I20260812 00:06:00.663331 17230 raft_consensus.cc:388] T 00000000000000000000000000000000 P be55d74f60bc4f629aa80387290050f6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:06:00.663362 17230 raft_consensus.cc:482] T 00000000000000000000000000000000 P be55d74f60bc4f629aa80387290050f6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:06:00.663410 17230 raft_consensus.cc:3037] T 00000000000000000000000000000000 P be55d74f60bc4f629aa80387290050f6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:06:00.663627 12089 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:06:00.663946 17230 raft_consensus.cc:504] T 00000000000000000000000000000000 P be55d74f60bc4f629aa80387290050f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be55d74f60bc4f629aa80387290050f6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36495 } }
I20260812 00:06:00.664047 17230 leader_election.cc:302] T 00000000000000000000000000000000 P be55d74f60bc4f629aa80387290050f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: be55d74f60bc4f629aa80387290050f6; no voters:
I20260812 00:06:00.664197 17230 leader_election.cc:288] T 00000000000000000000000000000000 P be55d74f60bc4f629aa80387290050f6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:06:00.664237 17235 raft_consensus.cc:2781] T 00000000000000000000000000000000 P be55d74f60bc4f629aa80387290050f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:06:00.664347 17235 raft_consensus.cc:686] T 00000000000000000000000000000000 P be55d74f60bc4f629aa80387290050f6 [term 1 LEADER]: Becoming Leader. State: Replica: be55d74f60bc4f629aa80387290050f6, State: Running, Role: LEADER
I20260812 00:06:00.664472 17230 sys_catalog.cc:564] T 00000000000000000000000000000000 P be55d74f60bc4f629aa80387290050f6 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:06:00.664482 17235 consensus_queue.cc:237] T 00000000000000000000000000000000 P be55d74f60bc4f629aa80387290050f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be55d74f60bc4f629aa80387290050f6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36495 } }
I20260812 00:06:00.664955 17238 sys_catalog.cc:455] T 00000000000000000000000000000000 P be55d74f60bc4f629aa80387290050f6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader be55d74f60bc4f629aa80387290050f6. Latest consensus state: current_term: 1 leader_uuid: "be55d74f60bc4f629aa80387290050f6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be55d74f60bc4f629aa80387290050f6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36495 } } }
I20260812 00:06:00.665076 17238 sys_catalog.cc:458] T 00000000000000000000000000000000 P be55d74f60bc4f629aa80387290050f6 [sys.catalog]: This master's current role is: LEADER
I20260812 00:06:00.664955 17237 sys_catalog.cc:455] T 00000000000000000000000000000000 P be55d74f60bc4f629aa80387290050f6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "be55d74f60bc4f629aa80387290050f6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be55d74f60bc4f629aa80387290050f6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36495 } } }
I20260812 00:06:00.665287 17237 sys_catalog.cc:458] T 00000000000000000000000000000000 P be55d74f60bc4f629aa80387290050f6 [sys.catalog]: This master's current role is: LEADER
I20260812 00:06:00.665293 17253 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:06:00.665967 17253 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:06:00.667411 17253 catalog_manager.cc:1347] Generated new cluster ID: 25de56dfbbcc4d15a4bf7656c81f2818
I20260812 00:06:00.667465 17253 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:06:00.669313 17233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:00.665110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.119:34695 (local address 127.0.0.1:36495)
0812 00:06:00.665143 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:00.665144 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:00.666681 (+ 1537us) server_negotiation.cc:407] Connection header received
0812 00:06:00.666745 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:00.666746 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:00.666757 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:00.666810 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:00.666985 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:00.667554 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:00.668232 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:00.668447 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:00.668501 (+ 54us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:00.669089 (+ 588us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:06:00.669090 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:06:00.669091 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:06:00.669095 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:06:00.669108 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:06:00.669113 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:06:00.669161 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:00.669228 (+ 67us) server_negotiation.cc:299] Negotiation successful
0812 00:06:00.669244 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260812 00:06:00.684034 17253 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:06:00.684528 17253 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:06:00.697083 17253 catalog_manager.cc:5868] T 00000000000000000000000000000000 P be55d74f60bc4f629aa80387290050f6: Generated new TSK 0
I20260812 00:06:00.697268 17253 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:06:00.705068 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 17113
W20260812 00:06:00.716123 17090 connection.cc:535] client connection to 127.0.0.1:36495 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36495): Connection reset by peer (error 104)
2026-08-12T00:06:00Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1498 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786492899949492-12089-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:06:00 dist-test-slave-f0tn krb5kdc[17272](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:06:00 dist-test-slave-f0tn krb5kdc[17272](info): set up 2 sockets
Aug 12 00:06:00 dist-test-slave-f0tn krb5kdc[17272](info): commencing operation
krb5kdc: starting...
W20260812 00:06:01.914337 12089 mini_kdc.cc:121] Time spent starting KDC: real 1.185s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786492899949492-12089-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786492899949492-12089-0/krb5kdc/test-user.keytab.
Aug 12 00:06:01 dist-test-slave-f0tn krb5kdc[17272](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493161, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:06:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:06:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786492899949492-12089-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786492899949492-12089-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 00:06:02.026362 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786492899949492-12089-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786492899949492-12089-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786492899949492-12089-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35121
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786492899949492-12089-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43989
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35121
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:06:02.108016 17296 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:06:02.108237 17296 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:06:02.108258 17296 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:06:02.109364 17296 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:06:02.109413 17296 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:06:02.109426 17296 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:06:02.109437 17296 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:06:02.109453 17296 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:06:02.110865 17296 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43989
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786492899949492-12089-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786492899949492-12089-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35121
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786492899949492-12089-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35121
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17296
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786492899949492-12089-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:06:02.111058 17296 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:06:02.111233 17296 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:06:02.115865 17310 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:06:02.115993 17296 server_base.cc:1034] running on GCE node
W20260812 00:06:02.115965 17314 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:06:02.115908 17319 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:06:02.116346 17296 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:06:02.116629 17296 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:06:02.117766 17296 hybrid_clock.cc:648] HybridClock initialized: now 1786493162117750 us; error 29 us; skew 500 ppm
Aug 12 00:06:02 dist-test-slave-f0tn krb5kdc[17272](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493162, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:06:02.124455 17296 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 00:06:02.124868 17296 webserver.cc:460] Webserver started at http://127.0.0.1:45187/ using document root <none> and password file <none>
I20260812 00:06:02.125061 17296 fs_manager.cc:359] Metadata directory not provided
I20260812 00:06:02.125109 17296 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:06:02.125242 17296 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:06:02.126322 17296 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786492899949492-12089-0/minicluster-data/master-0/data/instance:
uuid: "eb0bc373d17b42029c6adc11f1fcac34"
format_stamp: "Formatted at 2026-08-12 00:06:02 on dist-test-slave-f0tn"
server_key: "5ec66b8cead28b444d1dba9e21d8da2b"
server_key_iv: "e88e72ba49783a16dda289087de49a17"
server_key_version: "encryptionkey@0"
I20260812 00:06:02.126655 17296 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786492899949492-12089-0/minicluster-data/master-0/wal/instance:
uuid: "eb0bc373d17b42029c6adc11f1fcac34"
format_stamp: "Formatted at 2026-08-12 00:06:02 on dist-test-slave-f0tn"
server_key: "5ec66b8cead28b444d1dba9e21d8da2b"
server_key_iv: "e88e72ba49783a16dda289087de49a17"
server_key_version: "encryptionkey@0"
I20260812 00:06:02.127926 17296 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 00:06:02.128645 17336 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:06:02.128798 17296 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:06:02.128878 17296 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786492899949492-12089-0/minicluster-data/master-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786492899949492-12089-0/minicluster-data/master-0/wal
uuid: "eb0bc373d17b42029c6adc11f1fcac34"
format_stamp: "Formatted at 2026-08-12 00:06:02 on dist-test-slave-f0tn"
server_key: "5ec66b8cead28b444d1dba9e21d8da2b"
server_key_iv: "e88e72ba49783a16dda289087de49a17"
server_key_version: "encryptionkey@0"
I20260812 00:06:02.128933 17296 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786492899949492-12089-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786492899949492-12089-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786492899949492-12089-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:06:02.132123 17296 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:06:02.134181 17296 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:06:02.134290 17296 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:06:02.138012 17296 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35121
I20260812 00:06:02.138043 17441 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35121 every 8 connection(s)
I20260812 00:06:02.138348 17296 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
I20260812 00:06:02.139477 17442 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:06:02.140830 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 17296
I20260812 00:06:02.140964 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786492899949492-12089-0/minicluster-data/master-0/wal/instance
I20260812 00:06:02.141155 12089 external_mini_cluster.cc:1428] Setting key 74ec41a6c0f8a16e673790b40bf2f001
I20260812 00:06:02.142354 17442 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eb0bc373d17b42029c6adc11f1fcac34: Bootstrap starting.
I20260812 00:06:02.143155 17442 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P eb0bc373d17b42029c6adc11f1fcac34: Neither blocks nor log segments found. Creating new log.
I20260812 00:06:02.143496 17442 log.cc:824] T 00000000000000000000000000000000 P eb0bc373d17b42029c6adc11f1fcac34: Log is configured to *not* fsync() on all Append() calls
I20260812 00:06:02.143692 17447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:02.141770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.119:32935 (local address 127.0.0.1:35121)
0812 00:06:02.141957 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:02.141965 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:02.141991 (+ 26us) server_negotiation.cc:407] Connection header received
0812 00:06:02.142406 (+ 415us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:02.142415 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:02.142452 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:02.142588 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:02.143256 (+ 668us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:06:02.143260 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:06:02.143261 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:06:02.143268 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:06:02.143315 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:06:02.143325 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:06:02.143391 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:02.143471 (+ 80us) server_negotiation.cc:299] Negotiation successful
0812 00:06:02.143507 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":63,"threads_started":1}
I20260812 00:06:02.144408 17442 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eb0bc373d17b42029c6adc11f1fcac34: No bootstrap required, opened a new log
I20260812 00:06:02.144874 12089 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:06:02.146961 17442 raft_consensus.cc:348] T 00000000000000000000000000000000 P eb0bc373d17b42029c6adc11f1fcac34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb0bc373d17b42029c6adc11f1fcac34" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35121 } }
I20260812 00:06:02.147128 17442 raft_consensus.cc:374] T 00000000000000000000000000000000 P eb0bc373d17b42029c6adc11f1fcac34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:06:02.147164 17442 raft_consensus.cc:729] T 00000000000000000000000000000000 P eb0bc373d17b42029c6adc11f1fcac34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb0bc373d17b42029c6adc11f1fcac34, State: Initialized, Role: FOLLOWER
I20260812 00:06:02.147284 17442 consensus_queue.cc:260] T 00000000000000000000000000000000 P eb0bc373d17b42029c6adc11f1fcac34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb0bc373d17b42029c6adc11f1fcac34" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35121 } }
I20260812 00:06:02.147392 17442 raft_consensus.cc:388] T 00000000000000000000000000000000 P eb0bc373d17b42029c6adc11f1fcac34 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:06:02.147437 17442 raft_consensus.cc:482] T 00000000000000000000000000000000 P eb0bc373d17b42029c6adc11f1fcac34 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:06:02.147490 17442 raft_consensus.cc:3037] T 00000000000000000000000000000000 P eb0bc373d17b42029c6adc11f1fcac34 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:06:02.147569 17447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:02.146500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.119:59205 (local address 127.0.0.1:35121)
0812 00:06:02.146542 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:02.146544 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:02.146629 (+ 85us) server_negotiation.cc:407] Connection header received
0812 00:06:02.146688 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:02.146689 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:02.146694 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:02.146739 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:02.147281 (+ 542us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:06:02.147283 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:06:02.147283 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:06:02.147287 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:06:02.147301 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:06:02.147305 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:06:02.147335 (+ 30us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:02.147468 (+ 133us) server_negotiation.cc:299] Negotiation successful
0812 00:06:02.147486 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 00:06:02.148236 17442 raft_consensus.cc:504] T 00000000000000000000000000000000 P eb0bc373d17b42029c6adc11f1fcac34 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb0bc373d17b42029c6adc11f1fcac34" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35121 } }
I20260812 00:06:02.148347 17442 leader_election.cc:302] T 00000000000000000000000000000000 P eb0bc373d17b42029c6adc11f1fcac34 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: eb0bc373d17b42029c6adc11f1fcac34; no voters:
I20260812 00:06:02.148507 17442 leader_election.cc:288] T 00000000000000000000000000000000 P eb0bc373d17b42029c6adc11f1fcac34 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:06:02.148554 17465 raft_consensus.cc:2781] T 00000000000000000000000000000000 P eb0bc373d17b42029c6adc11f1fcac34 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:06:02.148686 17465 raft_consensus.cc:686] T 00000000000000000000000000000000 P eb0bc373d17b42029c6adc11f1fcac34 [term 1 LEADER]: Becoming Leader. State: Replica: eb0bc373d17b42029c6adc11f1fcac34, State: Running, Role: LEADER
I20260812 00:06:02.148761 17442 sys_catalog.cc:564] T 00000000000000000000000000000000 P eb0bc373d17b42029c6adc11f1fcac34 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:06:02.148823 17465 consensus_queue.cc:237] T 00000000000000000000000000000000 P eb0bc373d17b42029c6adc11f1fcac34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb0bc373d17b42029c6adc11f1fcac34" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35121 } }
I20260812 00:06:02.149163 17467 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb0bc373d17b42029c6adc11f1fcac34 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "eb0bc373d17b42029c6adc11f1fcac34" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb0bc373d17b42029c6adc11f1fcac34" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35121 } } }
I20260812 00:06:02.149336 17468 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb0bc373d17b42029c6adc11f1fcac34 [sys.catalog]: SysCatalogTable state changed. Reason: New leader eb0bc373d17b42029c6adc11f1fcac34. Latest consensus state: current_term: 1 leader_uuid: "eb0bc373d17b42029c6adc11f1fcac34" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb0bc373d17b42029c6adc11f1fcac34" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35121 } } }
I20260812 00:06:02.149446 17467 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb0bc373d17b42029c6adc11f1fcac34 [sys.catalog]: This master's current role is: LEADER
I20260812 00:06:02.149518 17468 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb0bc373d17b42029c6adc11f1fcac34 [sys.catalog]: This master's current role is: LEADER
I20260812 00:06:02.149865 17478 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:06:02.150311 17478 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:06:02.151870 17478 catalog_manager.cc:1347] Generated new cluster ID: a25045b72d0b4996a3c00dcd2302c993
I20260812 00:06:02.151916 17478 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:06:02.163892 17478 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:06:02.164096 17478 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:06:02.170104 17478 catalog_manager.cc:5868] T 00000000000000000000000000000000 P eb0bc373d17b42029c6adc11f1fcac34: Generated new TSK 0
I20260812 00:06:02.170329 17478 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:06:02.172755 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 17296
2026-08-12T00:06:02Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1479 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786492899949492-12089-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:06:02 dist-test-slave-f0tn krb5kdc[17499](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:06:02 dist-test-slave-f0tn krb5kdc[17499](info): set up 2 sockets
Aug 12 00:06:02 dist-test-slave-f0tn krb5kdc[17499](info): commencing operation
krb5kdc: starting...
W20260812 00:06:03.370980 12089 mini_kdc.cc:121] Time spent starting KDC: real 1.162s user 0.006s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786492899949492-12089-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786492899949492-12089-0/krb5kdc/test-user.keytab.
Aug 12 00:06:03 dist-test-slave-f0tn krb5kdc[17499](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493163, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:06:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:06:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786492899949492-12089-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786492899949492-12089-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 00:06:03.486004 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786492899949492-12089-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786492899949492-12089-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786492899949492-12089-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35961
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786492899949492-12089-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37027
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35961
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:06:03.579443 17515 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:06:03.579653 17515 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:06:03.579674 17515 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:06:03.580744 17515 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:06:03.580780 17515 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:06:03.580793 17515 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:06:03.580804 17515 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:06:03.580816 17515 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:06:03.582290 17515 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37027
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786492899949492-12089-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786492899949492-12089-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35961
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786492899949492-12089-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35961
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17515
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786492899949492-12089-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:06:03.582501 17515 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:06:03.582719 17515 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:06:03.587448 17527 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:06:03.587489 17533 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:06:03.587565 17515 server_base.cc:1034] running on GCE node
W20260812 00:06:03.587455 17528 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:06:03.588016 17515 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:06:03.588290 17515 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:06:03.589428 17515 hybrid_clock.cc:648] HybridClock initialized: now 1786493163589408 us; error 34 us; skew 500 ppm
Aug 12 00:06:03 dist-test-slave-f0tn krb5kdc[17499](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493163, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:06:03.591792 17515 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 00:06:03.592217 17515 webserver.cc:460] Webserver started at http://127.0.0.1:33331/ using document root <none> and password file <none>
I20260812 00:06:03.592414 17515 fs_manager.cc:359] Metadata directory not provided
I20260812 00:06:03.592456 17515 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:06:03.592578 17515 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:06:03.593703 17515 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786492899949492-12089-0/minicluster-data/master-0/data/instance:
uuid: "ba0854204ce0409fa782efb6cae693b4"
format_stamp: "Formatted at 2026-08-12 00:06:03 on dist-test-slave-f0tn"
server_key: "733eb77552123c91b3de84c683ce8737"
server_key_iv: "1ada535136d1c14c0a3bd6069f4f5978"
server_key_version: "encryptionkey@0"
I20260812 00:06:03.594041 17515 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786492899949492-12089-0/minicluster-data/master-0/wal/instance:
uuid: "ba0854204ce0409fa782efb6cae693b4"
format_stamp: "Formatted at 2026-08-12 00:06:03 on dist-test-slave-f0tn"
server_key: "733eb77552123c91b3de84c683ce8737"
server_key_iv: "1ada535136d1c14c0a3bd6069f4f5978"
server_key_version: "encryptionkey@0"
I20260812 00:06:03.595278 17515 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 00:06:03.595912 17550 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:06:03.596077 17515 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:06:03.596165 17515 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786492899949492-12089-0/minicluster-data/master-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786492899949492-12089-0/minicluster-data/master-0/wal
uuid: "ba0854204ce0409fa782efb6cae693b4"
format_stamp: "Formatted at 2026-08-12 00:06:03 on dist-test-slave-f0tn"
server_key: "733eb77552123c91b3de84c683ce8737"
server_key_iv: "1ada535136d1c14c0a3bd6069f4f5978"
server_key_version: "encryptionkey@0"
I20260812 00:06:03.596220 17515 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786492899949492-12089-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786492899949492-12089-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786492899949492-12089-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:06:03.610737 17515 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:06:03.612447 17515 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:06:03.612561 17515 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:06:03.616274 17515 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35961
I20260812 00:06:03.616312 17631 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35961 every 8 connection(s)
I20260812 00:06:03.616619 17515 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
I20260812 00:06:03.617486 17632 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:06:03.619686 17632 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba0854204ce0409fa782efb6cae693b4: Bootstrap starting.
I20260812 00:06:03.620208 17632 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ba0854204ce0409fa782efb6cae693b4: Neither blocks nor log segments found. Creating new log.
I20260812 00:06:03.620426 17632 log.cc:824] T 00000000000000000000000000000000 P ba0854204ce0409fa782efb6cae693b4: Log is configured to *not* fsync() on all Append() calls
I20260812 00:06:03.621037 17632 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba0854204ce0409fa782efb6cae693b4: No bootstrap required, opened a new log
I20260812 00:06:03.622576 17632 raft_consensus.cc:348] T 00000000000000000000000000000000 P ba0854204ce0409fa782efb6cae693b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba0854204ce0409fa782efb6cae693b4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35961 } }
I20260812 00:06:03.622712 17632 raft_consensus.cc:374] T 00000000000000000000000000000000 P ba0854204ce0409fa782efb6cae693b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:06:03.622752 17632 raft_consensus.cc:729] T 00000000000000000000000000000000 P ba0854204ce0409fa782efb6cae693b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba0854204ce0409fa782efb6cae693b4, State: Initialized, Role: FOLLOWER
I20260812 00:06:03.622851 17632 consensus_queue.cc:260] T 00000000000000000000000000000000 P ba0854204ce0409fa782efb6cae693b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba0854204ce0409fa782efb6cae693b4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35961 } }
I20260812 00:06:03.622903 17632 raft_consensus.cc:388] T 00000000000000000000000000000000 P ba0854204ce0409fa782efb6cae693b4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:06:03.622932 17632 raft_consensus.cc:482] T 00000000000000000000000000000000 P ba0854204ce0409fa782efb6cae693b4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:06:03.622972 17632 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ba0854204ce0409fa782efb6cae693b4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:06:03.623170 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 17515
I20260812 00:06:03.623303 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786492899949492-12089-0/minicluster-data/master-0/wal/instance
I20260812 00:06:03.623466 12089 external_mini_cluster.cc:1428] Setting key 59149d5f783816bb99f4aeeca9e4ad1d
I20260812 00:06:03.623615 17632 raft_consensus.cc:504] T 00000000000000000000000000000000 P ba0854204ce0409fa782efb6cae693b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba0854204ce0409fa782efb6cae693b4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35961 } }
I20260812 00:06:03.623713 17632 leader_election.cc:302] T 00000000000000000000000000000000 P ba0854204ce0409fa782efb6cae693b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ba0854204ce0409fa782efb6cae693b4; no voters:
I20260812 00:06:03.623878 17632 leader_election.cc:288] T 00000000000000000000000000000000 P ba0854204ce0409fa782efb6cae693b4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:06:03.623893 17637 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ba0854204ce0409fa782efb6cae693b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:06:03.624212 17632 sys_catalog.cc:564] T 00000000000000000000000000000000 P ba0854204ce0409fa782efb6cae693b4 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:06:03.624290 17637 raft_consensus.cc:686] T 00000000000000000000000000000000 P ba0854204ce0409fa782efb6cae693b4 [term 1 LEADER]: Becoming Leader. State: Replica: ba0854204ce0409fa782efb6cae693b4, State: Running, Role: LEADER
I20260812 00:06:03.624439 17637 consensus_queue.cc:237] T 00000000000000000000000000000000 P ba0854204ce0409fa782efb6cae693b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba0854204ce0409fa782efb6cae693b4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35961 } }
I20260812 00:06:03.624819 17637 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba0854204ce0409fa782efb6cae693b4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ba0854204ce0409fa782efb6cae693b4. Latest consensus state: current_term: 1 leader_uuid: "ba0854204ce0409fa782efb6cae693b4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba0854204ce0409fa782efb6cae693b4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35961 } } }
I20260812 00:06:03.625039 17637 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba0854204ce0409fa782efb6cae693b4 [sys.catalog]: This master's current role is: LEADER
I20260812 00:06:03.624974 17640 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba0854204ce0409fa782efb6cae693b4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ba0854204ce0409fa782efb6cae693b4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba0854204ce0409fa782efb6cae693b4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35961 } } }
I20260812 00:06:03.625398 17640 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba0854204ce0409fa782efb6cae693b4 [sys.catalog]: This master's current role is: LEADER
I20260812 00:06:03.625648 17658 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:06:03.626381 17658 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:06:03.628310 17658 catalog_manager.cc:1347] Generated new cluster ID: aea74025e9cf4a44a84661bab04294ab
I20260812 00:06:03.628360 17658 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 00:06:03 dist-test-slave-f0tn krb5kdc[17499](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493163, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260812 00:06:03.634409 17639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:03.623927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.119:58597 (local address 127.0.0.1:35961)
0812 00:06:03.624085 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:03.624095 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:03.624129 (+ 34us) server_negotiation.cc:407] Connection header received
0812 00:06:03.624278 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:03.624286 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:03.624344 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:03.624478 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:03.625288 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:03.626614 (+ 1326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:03.627493 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:03.628038 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:03.628135 (+ 97us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:03.630805 (+ 2670us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:06:03.630809 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:06:03.630809 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:06:03.630821 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:06:03.632575 (+ 1754us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:03.632976 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:03.632979 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:03.632979 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:03.633097 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:03.633302 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:03.633302 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:03.633303 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:03.633597 (+ 294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:06:03.633732 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:03.634119 (+ 387us) server_negotiation.cc:299] Negotiation successful
0812 00:06:03.634210 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108,"thread_start_us":78,"threads_started":1}
I20260812 00:06:03.635481 12089 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:06:03.640018 17658 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:06:03.640590 17658 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:06:03.644683 17658 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ba0854204ce0409fa782efb6cae693b4: Generated new TSK 0
I20260812 00:06:03.644855 17658 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:06:03.645412 17639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:03.637644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.119:58841 (local address 127.0.0.1:35961)
0812 00:06:03.637700 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:03.637702 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:03.637859 (+ 157us) server_negotiation.cc:407] Connection header received
0812 00:06:03.637911 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:03.637911 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:03.637922 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:03.637985 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:03.638586 (+ 601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:03.639308 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:03.640424 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:03.640742 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:03.640817 (+ 75us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:03.642204 (+ 1387us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:06:03.642205 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:06:03.642205 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:06:03.642212 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:06:03.643723 (+ 1511us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:03.644253 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:03.644254 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:03.644255 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:03.644320 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:03.644575 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:03.644577 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:03.644577 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:03.644728 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:06:03.644831 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:03.645224 (+ 393us) server_negotiation.cc:299] Negotiation successful
0812 00:06:03.645292 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 00:06:03.647136 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 17515
W20260812 00:06:03.665864 17496 connection.cc:535] client connection to 127.0.0.1:35961 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:35961): Connection reset by peer (error 104)
2026-08-12T00:06:03Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1470 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786492899949492-12089-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:06:03 dist-test-slave-f0tn krb5kdc[17687](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:06:03 dist-test-slave-f0tn krb5kdc[17687](info): set up 2 sockets
Aug 12 00:06:03 dist-test-slave-f0tn krb5kdc[17687](info): commencing operation
krb5kdc: starting...
W20260812 00:06:04.831941 12089 mini_kdc.cc:121] Time spent starting KDC: real 1.153s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786492899949492-12089-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786492899949492-12089-0/krb5kdc/test-user.keytab.
Aug 12 00:06:04 dist-test-slave-f0tn krb5kdc[17687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493164, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:06:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:06:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786492899949492-12089-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786492899949492-12089-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 00:06:04.949749 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786492899949492-12089-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786492899949492-12089-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786492899949492-12089-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46837
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786492899949492-12089-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41247
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46837
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:06:05.031730 17704 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:06:05.031953 17704 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:06:05.031986 17704 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:06:05.033154 17704 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:06:05.033198 17704 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:06:05.033218 17704 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:06:05.033234 17704 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:06:05.033250 17704 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:06:05.034811 17704 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41247
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786492899949492-12089-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786492899949492-12089-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46837
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786492899949492-12089-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46837
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17704
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786492899949492-12089-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:06:05.035079 17704 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:06:05.035307 17704 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:06:05.040200 17716 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:06:05.040191 17711 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:06:05.040191 17722 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:06:05.040347 17704 server_base.cc:1034] running on GCE node
I20260812 00:06:05.040643 17704 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:06:05.040917 17704 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:06:05.042059 17704 hybrid_clock.cc:648] HybridClock initialized: now 1786493165042043 us; error 29 us; skew 500 ppm
Aug 12 00:06:05 dist-test-slave-f0tn krb5kdc[17687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493165, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:06:05.044481 17704 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 00:06:05.044917 17704 webserver.cc:460] Webserver started at http://127.0.0.1:38755/ using document root <none> and password file <none>
I20260812 00:06:05.045116 17704 fs_manager.cc:359] Metadata directory not provided
I20260812 00:06:05.045166 17704 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:06:05.045298 17704 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:06:05.046373 17704 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786492899949492-12089-0/minicluster-data/master-0/data/instance:
uuid: "80eb90041e604b4bb5d38a69f219fa68"
format_stamp: "Formatted at 2026-08-12 00:06:05 on dist-test-slave-f0tn"
server_key: "6c731c60949b5062e6c10f5c435891a0"
server_key_iv: "3c4223479cb40d81518e28e0f1529217"
server_key_version: "encryptionkey@0"
I20260812 00:06:05.046707 17704 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786492899949492-12089-0/minicluster-data/master-0/wal/instance:
uuid: "80eb90041e604b4bb5d38a69f219fa68"
format_stamp: "Formatted at 2026-08-12 00:06:05 on dist-test-slave-f0tn"
server_key: "6c731c60949b5062e6c10f5c435891a0"
server_key_iv: "3c4223479cb40d81518e28e0f1529217"
server_key_version: "encryptionkey@0"
I20260812 00:06:05.047950 17704 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 00:06:05.048619 17738 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:06:05.048771 17704 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:06:05.048856 17704 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786492899949492-12089-0/minicluster-data/master-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786492899949492-12089-0/minicluster-data/master-0/wal
uuid: "80eb90041e604b4bb5d38a69f219fa68"
format_stamp: "Formatted at 2026-08-12 00:06:05 on dist-test-slave-f0tn"
server_key: "6c731c60949b5062e6c10f5c435891a0"
server_key_iv: "3c4223479cb40d81518e28e0f1529217"
server_key_version: "encryptionkey@0"
I20260812 00:06:05.048918 17704 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786492899949492-12089-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786492899949492-12089-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786492899949492-12089-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:06:05.060856 17704 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:06:05.062790 17704 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:06:05.062928 17704 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:06:05.066857 17704 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46837
I20260812 00:06:05.066891 17826 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46837 every 8 connection(s)
I20260812 00:06:05.067212 17704 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
I20260812 00:06:05.068064 17827 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:06:05.070400 17827 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 80eb90041e604b4bb5d38a69f219fa68: Bootstrap starting.
I20260812 00:06:05.070941 17827 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 80eb90041e604b4bb5d38a69f219fa68: Neither blocks nor log segments found. Creating new log.
I20260812 00:06:05.071188 17827 log.cc:824] T 00000000000000000000000000000000 P 80eb90041e604b4bb5d38a69f219fa68: Log is configured to *not* fsync() on all Append() calls
I20260812 00:06:05.071868 17827 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 80eb90041e604b4bb5d38a69f219fa68: No bootstrap required, opened a new log
I20260812 00:06:05.073470 17827 raft_consensus.cc:348] T 00000000000000000000000000000000 P 80eb90041e604b4bb5d38a69f219fa68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80eb90041e604b4bb5d38a69f219fa68" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46837 } }
I20260812 00:06:05.073614 17827 raft_consensus.cc:374] T 00000000000000000000000000000000 P 80eb90041e604b4bb5d38a69f219fa68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:06:05.073637 17827 raft_consensus.cc:729] T 00000000000000000000000000000000 P 80eb90041e604b4bb5d38a69f219fa68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80eb90041e604b4bb5d38a69f219fa68, State: Initialized, Role: FOLLOWER
I20260812 00:06:05.073742 17827 consensus_queue.cc:260] T 00000000000000000000000000000000 P 80eb90041e604b4bb5d38a69f219fa68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80eb90041e604b4bb5d38a69f219fa68" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46837 } }
I20260812 00:06:05.073791 17827 raft_consensus.cc:388] T 00000000000000000000000000000000 P 80eb90041e604b4bb5d38a69f219fa68 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:06:05.073812 17827 raft_consensus.cc:482] T 00000000000000000000000000000000 P 80eb90041e604b4bb5d38a69f219fa68 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:06:05.073841 17827 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 80eb90041e604b4bb5d38a69f219fa68 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:06:05.074318 17827 raft_consensus.cc:504] T 00000000000000000000000000000000 P 80eb90041e604b4bb5d38a69f219fa68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80eb90041e604b4bb5d38a69f219fa68" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46837 } }
I20260812 00:06:05.074406 17827 leader_election.cc:302] T 00000000000000000000000000000000 P 80eb90041e604b4bb5d38a69f219fa68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 80eb90041e604b4bb5d38a69f219fa68; no voters:
I20260812 00:06:05.074548 17827 leader_election.cc:288] T 00000000000000000000000000000000 P 80eb90041e604b4bb5d38a69f219fa68 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:06:05.074586 17832 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 80eb90041e604b4bb5d38a69f219fa68 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:06:05.074663 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 17704
I20260812 00:06:05.074731 17832 raft_consensus.cc:686] T 00000000000000000000000000000000 P 80eb90041e604b4bb5d38a69f219fa68 [term 1 LEADER]: Becoming Leader. State: Replica: 80eb90041e604b4bb5d38a69f219fa68, State: Running, Role: LEADER
I20260812 00:06:05.074795 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786492899949492-12089-0/minicluster-data/master-0/wal/instance
I20260812 00:06:05.074816 17827 sys_catalog.cc:564] T 00000000000000000000000000000000 P 80eb90041e604b4bb5d38a69f219fa68 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:06:05.074856 17832 consensus_queue.cc:237] T 00000000000000000000000000000000 P 80eb90041e604b4bb5d38a69f219fa68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80eb90041e604b4bb5d38a69f219fa68" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46837 } }
I20260812 00:06:05.075028 12089 external_mini_cluster.cc:1428] Setting key 4659364abeb17a48cceb25766972bb8a
I20260812 00:06:05.075178 17832 sys_catalog.cc:455] T 00000000000000000000000000000000 P 80eb90041e604b4bb5d38a69f219fa68 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 80eb90041e604b4bb5d38a69f219fa68. Latest consensus state: current_term: 1 leader_uuid: "80eb90041e604b4bb5d38a69f219fa68" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80eb90041e604b4bb5d38a69f219fa68" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46837 } } }
I20260812 00:06:05.075265 17832 sys_catalog.cc:458] T 00000000000000000000000000000000 P 80eb90041e604b4bb5d38a69f219fa68 [sys.catalog]: This master's current role is: LEADER
I20260812 00:06:05.075325 17834 sys_catalog.cc:455] T 00000000000000000000000000000000 P 80eb90041e604b4bb5d38a69f219fa68 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "80eb90041e604b4bb5d38a69f219fa68" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80eb90041e604b4bb5d38a69f219fa68" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46837 } } }
I20260812 00:06:05.075378 17834 sys_catalog.cc:458] T 00000000000000000000000000000000 P 80eb90041e604b4bb5d38a69f219fa68 [sys.catalog]: This master's current role is: LEADER
I20260812 00:06:05.075482 17839 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:06:05.076001 17839 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:06:05.077601 17839 catalog_manager.cc:1347] Generated new cluster ID: 49f7de84f19248598fc0020307de6ec6
I20260812 00:06:05.077656 17839 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:06:05.081970 17854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:05.075784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.119:32777 (local address 127.0.0.1:46837)
0812 00:06:05.076403 (+ 619us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:05.076412 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:05.076445 (+ 33us) server_negotiation.cc:407] Connection header received
0812 00:06:05.076637 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:05.076648 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:05.076714 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:05.077099 (+ 385us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:05.077197 (+ 98us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:05.078561 (+ 1364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:05.079661 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:05.080291 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:05.080688 (+ 397us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:05.081110 (+ 422us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:06:05.081113 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:06:05.081114 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:06:05.081298 (+ 184us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:06:05.081333 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:06:05.081346 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:06:05.081563 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:05.081603 (+ 40us) server_negotiation.cc:299] Negotiation successful
0812 00:06:05.081629 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":555,"thread_start_us":59,"threads_started":1}
I20260812 00:06:05.082903 12089 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:06:05.088742 17854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:05.084272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.119:48631 (local address 127.0.0.1:46837)
0812 00:06:05.084317 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:05.084319 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:05.085549 (+ 1230us) server_negotiation.cc:407] Connection header received
0812 00:06:05.085594 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:05.085595 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:05.085606 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:05.085673 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:05.085799 (+ 126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:05.086549 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:05.087472 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:05.087802 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:05.087869 (+ 67us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:05.088516 (+ 647us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:06:05.088518 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:06:05.088518 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:06:05.088523 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:06:05.088539 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:06:05.088543 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:06:05.088602 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:05.088653 (+ 51us) server_negotiation.cc:299] Negotiation successful
0812 00:06:05.088665 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260812 00:06:05.111128 17839 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:06:05.111707 17839 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:06:05.120345 17839 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 80eb90041e604b4bb5d38a69f219fa68: Generated new TSK 0
I20260812 00:06:05.120563 17839 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:06:05.129817 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 17704
W20260812 00:06:05.145412 17685 connection.cc:535] client connection to 127.0.0.1:46837 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:46837): Connection reset by peer (error 104)
2026-08-12T00:06:05Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1479 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786492899949492-12089-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:06:05 dist-test-slave-f0tn krb5kdc[17886](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:06:05 dist-test-slave-f0tn krb5kdc[17886](info): set up 2 sockets
Aug 12 00:06:05 dist-test-slave-f0tn krb5kdc[17886](info): commencing operation
krb5kdc: starting...
W20260812 00:06:06.328846 12089 mini_kdc.cc:121] Time spent starting KDC: real 1.170s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786492899949492-12089-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786492899949492-12089-0/krb5kdc/test-user.keytab.
Aug 12 00:06:06 dist-test-slave-f0tn krb5kdc[17886](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493166, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:06:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:06:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786492899949492-12089-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786492899949492-12089-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 00:06:06.449847 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786492899949492-12089-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786492899949492-12089-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786492899949492-12089-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37585
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786492899949492-12089-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36021
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37585
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:06:06.532819 17909 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:06:06.533032 17909 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:06:06.533053 17909 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:06:06.534219 17909 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:06:06.534272 17909 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:06:06.534286 17909 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:06:06.534298 17909 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:06:06.534309 17909 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:06:06.535794 17909 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36021
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786492899949492-12089-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786492899949492-12089-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37585
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786492899949492-12089-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37585
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17909
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786492899949492-12089-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:06:06.536031 17909 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:06:06.536238 17909 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:06:06.540959 17920 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:06:06.540964 17917 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:06:06.540987 17915 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:06:06.541204 17909 server_base.cc:1034] running on GCE node
I20260812 00:06:06.541483 17909 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:06:06.541749 17909 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:06:06.542908 17909 hybrid_clock.cc:648] HybridClock initialized: now 1786493166542891 us; error 33 us; skew 500 ppm
Aug 12 00:06:06 dist-test-slave-f0tn krb5kdc[17886](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493166, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:06:06.545449 17909 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 00:06:06.545885 17909 webserver.cc:460] Webserver started at http://127.0.0.1:33993/ using document root <none> and password file <none>
I20260812 00:06:06.546087 17909 fs_manager.cc:359] Metadata directory not provided
I20260812 00:06:06.546132 17909 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:06:06.546259 17909 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:06:06.547310 17909 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786492899949492-12089-0/minicluster-data/master-0/data/instance:
uuid: "b2dc92db7eff49519af3af2a36d21574"
format_stamp: "Formatted at 2026-08-12 00:06:06 on dist-test-slave-f0tn"
server_key: "1e875d59d7216c70a7451ed05141dfb0"
server_key_iv: "d303649d7997cb73170da62d5dedeb39"
server_key_version: "encryptionkey@0"
I20260812 00:06:06.547652 17909 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786492899949492-12089-0/minicluster-data/master-0/wal/instance:
uuid: "b2dc92db7eff49519af3af2a36d21574"
format_stamp: "Formatted at 2026-08-12 00:06:06 on dist-test-slave-f0tn"
server_key: "1e875d59d7216c70a7451ed05141dfb0"
server_key_iv: "d303649d7997cb73170da62d5dedeb39"
server_key_version: "encryptionkey@0"
I20260812 00:06:06.548902 17909 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 00:06:06.549598 17931 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:06:06.549738 17909 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 00:06:06.549826 17909 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786492899949492-12089-0/minicluster-data/master-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786492899949492-12089-0/minicluster-data/master-0/wal
uuid: "b2dc92db7eff49519af3af2a36d21574"
format_stamp: "Formatted at 2026-08-12 00:06:06 on dist-test-slave-f0tn"
server_key: "1e875d59d7216c70a7451ed05141dfb0"
server_key_iv: "d303649d7997cb73170da62d5dedeb39"
server_key_version: "encryptionkey@0"
I20260812 00:06:06.549887 17909 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786492899949492-12089-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786492899949492-12089-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786492899949492-12089-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:06:06.553045 17909 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:06:06.554845 17909 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:06:06.554976 17909 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:06:06.558753 17909 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37585
I20260812 00:06:06.558792 18010 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37585 every 8 connection(s)
I20260812 00:06:06.559080 17909 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
I20260812 00:06:06.560058 18015 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:06:06.562319 18015 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b2dc92db7eff49519af3af2a36d21574: Bootstrap starting.
I20260812 00:06:06.562855 18015 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b2dc92db7eff49519af3af2a36d21574: Neither blocks nor log segments found. Creating new log.
I20260812 00:06:06.563079 18015 log.cc:824] T 00000000000000000000000000000000 P b2dc92db7eff49519af3af2a36d21574: Log is configured to *not* fsync() on all Append() calls
I20260812 00:06:06.563695 18015 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b2dc92db7eff49519af3af2a36d21574: No bootstrap required, opened a new log
I20260812 00:06:06.564250 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 17909
I20260812 00:06:06.564363 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786492899949492-12089-0/minicluster-data/master-0/wal/instance
I20260812 00:06:06.564519 12089 external_mini_cluster.cc:1428] Setting key 34ad7773fd0b465a8d6f34fa7b6bf59a
I20260812 00:06:06.565637 18015 raft_consensus.cc:348] T 00000000000000000000000000000000 P b2dc92db7eff49519af3af2a36d21574 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2dc92db7eff49519af3af2a36d21574" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37585 } }
I20260812 00:06:06.565820 18015 raft_consensus.cc:374] T 00000000000000000000000000000000 P b2dc92db7eff49519af3af2a36d21574 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:06:06.565896 18015 raft_consensus.cc:729] T 00000000000000000000000000000000 P b2dc92db7eff49519af3af2a36d21574 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2dc92db7eff49519af3af2a36d21574, State: Initialized, Role: FOLLOWER
I20260812 00:06:06.566038 18015 consensus_queue.cc:260] T 00000000000000000000000000000000 P b2dc92db7eff49519af3af2a36d21574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2dc92db7eff49519af3af2a36d21574" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37585 } }
I20260812 00:06:06.566141 18015 raft_consensus.cc:388] T 00000000000000000000000000000000 P b2dc92db7eff49519af3af2a36d21574 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:06:06.566179 18015 raft_consensus.cc:482] T 00000000000000000000000000000000 P b2dc92db7eff49519af3af2a36d21574 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:06:06.566226 18015 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b2dc92db7eff49519af3af2a36d21574 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:06:06.566936 18024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:06.565011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.119:40817 (local address 127.0.0.1:37585)
0812 00:06:06.565226 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:06.565236 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:06.565279 (+ 43us) server_negotiation.cc:407] Connection header received
0812 00:06:06.565603 (+ 324us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:06.565611 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:06.565647 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:06.565795 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:06.566493 (+ 698us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:06:06.566497 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:06:06.566497 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:06:06.566502 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:06:06.566556 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:06:06.566570 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:06:06.566644 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:06.566680 (+ 36us) server_negotiation.cc:299] Negotiation successful
0812 00:06:06.566726 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":83,"threads_started":1}
I20260812 00:06:06.567339 18015 raft_consensus.cc:504] T 00000000000000000000000000000000 P b2dc92db7eff49519af3af2a36d21574 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2dc92db7eff49519af3af2a36d21574" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37585 } }
I20260812 00:06:06.567445 18015 leader_election.cc:302] T 00000000000000000000000000000000 P b2dc92db7eff49519af3af2a36d21574 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b2dc92db7eff49519af3af2a36d21574; no voters:
I20260812 00:06:06.567601 18015 leader_election.cc:288] T 00000000000000000000000000000000 P b2dc92db7eff49519af3af2a36d21574 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:06:06.567641 18025 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b2dc92db7eff49519af3af2a36d21574 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:06:06.567814 18025 raft_consensus.cc:686] T 00000000000000000000000000000000 P b2dc92db7eff49519af3af2a36d21574 [term 1 LEADER]: Becoming Leader. State: Replica: b2dc92db7eff49519af3af2a36d21574, State: Running, Role: LEADER
I20260812 00:06:06.567878 12089 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:06:06.567900 18015 sys_catalog.cc:564] T 00000000000000000000000000000000 P b2dc92db7eff49519af3af2a36d21574 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:06:06.567945 18025 consensus_queue.cc:237] T 00000000000000000000000000000000 P b2dc92db7eff49519af3af2a36d21574 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2dc92db7eff49519af3af2a36d21574" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37585 } }
I20260812 00:06:06.568279 18025 sys_catalog.cc:455] T 00000000000000000000000000000000 P b2dc92db7eff49519af3af2a36d21574 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b2dc92db7eff49519af3af2a36d21574. Latest consensus state: current_term: 1 leader_uuid: "b2dc92db7eff49519af3af2a36d21574" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2dc92db7eff49519af3af2a36d21574" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37585 } } }
I20260812 00:06:06.568495 18025 sys_catalog.cc:458] T 00000000000000000000000000000000 P b2dc92db7eff49519af3af2a36d21574 [sys.catalog]: This master's current role is: LEADER
I20260812 00:06:06.568426 18027 sys_catalog.cc:455] T 00000000000000000000000000000000 P b2dc92db7eff49519af3af2a36d21574 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b2dc92db7eff49519af3af2a36d21574" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2dc92db7eff49519af3af2a36d21574" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37585 } } }
I20260812 00:06:06.568933 18027 sys_catalog.cc:458] T 00000000000000000000000000000000 P b2dc92db7eff49519af3af2a36d21574 [sys.catalog]: This master's current role is: LEADER
I20260812 00:06:06.569133 18037 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:06:06.569720 18037 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:06:06.570650 18024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:06.569369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.119:51679 (local address 127.0.0.1:37585)
0812 00:06:06.569420 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:06.569422 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:06.569572 (+ 150us) server_negotiation.cc:407] Connection header received
0812 00:06:06.569753 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:06.569754 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:06.569760 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:06.569820 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:06.570460 (+ 640us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:06:06.570462 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:06:06.570462 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:06:06.570466 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:06:06.570480 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:06:06.570484 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:06:06.570530 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:06.570578 (+ 48us) server_negotiation.cc:299] Negotiation successful
0812 00:06:06.570592 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260812 00:06:06.571424 18037 catalog_manager.cc:1347] Generated new cluster ID: 73e2a31a42454459afb285e39b6e9f94
I20260812 00:06:06.571475 18037 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:06:06.579857 18037 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:06:06.580037 18037 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:06:06.592659 18037 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b2dc92db7eff49519af3af2a36d21574: Generated new TSK 0
I20260812 00:06:06.592918 18037 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:06:06.596028 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 17909
2026-08-12T00:06:06Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1497 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786492899949492-12089-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:06:06 dist-test-slave-f0tn krb5kdc[18060](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:06:06 dist-test-slave-f0tn krb5kdc[18060](info): set up 2 sockets
Aug 12 00:06:06 dist-test-slave-f0tn krb5kdc[18060](info): commencing operation
krb5kdc: starting...
W20260812 00:06:07.821202 12089 mini_kdc.cc:121] Time spent starting KDC: real 1.165s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786492899949492-12089-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786492899949492-12089-0/krb5kdc/test-user.keytab.
Aug 12 00:06:07 dist-test-slave-f0tn krb5kdc[18060](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493167, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:06:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:06:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.206.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab.
Entry for principal kudu/127.11.206.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab.
I20260812 00:06:07.933845 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786492899949492-12089-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786492899949492-12089-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786492899949492-12089-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:35787
--webserver_interface=127.11.206.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab
--principal=kudu/127.11.206.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:45531
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.206.126:35787
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:06:08.014114 18079 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:06:08.014321 18079 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:06:08.014353 18079 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:06:08.015486 18079 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:06:08.015528 18079 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:06:08.015547 18079 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:06:08.015563 18079 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:06:08.015578 18079 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:06:08.017041 18079 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:45531
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786492899949492-12089-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786492899949492-12089-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.206.126:35787
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab
--principal=kudu/127.11.206.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:35787
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.206.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18079
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786492899949492-12089-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:06:08.017288 18079 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:06:08.017526 18079 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:06:08.022379 18092 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:06:08.022449 18079 server_base.cc:1034] running on GCE node
W20260812 00:06:08.022365 18094 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:06:08.022365 18091 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:06:08.022869 18079 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:06:08.023170 18079 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:06:08.024317 18079 hybrid_clock.cc:648] HybridClock initialized: now 1786493168024303 us; error 29 us; skew 500 ppm
Aug 12 00:06:08 dist-test-slave-f0tn krb5kdc[18060](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493168, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:06:08.029838 18079 init.cc:377] Logged in from keytab as kudu/127.11.206.126@KRBTEST.COM (short username kudu)
I20260812 00:06:08.030333 18079 webserver.cc:460] Webserver started at http://127.11.206.126:43467/ using document root <none> and password file <none>
I20260812 00:06:08.030555 18079 fs_manager.cc:359] Metadata directory not provided
I20260812 00:06:08.030606 18079 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:06:08.030741 18079 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:06:08.031885 18079 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786492899949492-12089-0/minicluster-data/master-0/data/instance:
uuid: "803ba8e4de6b4594a69bc8c5002e7e77"
format_stamp: "Formatted at 2026-08-12 00:06:08 on dist-test-slave-f0tn"
server_key: "3ab9313579726b0637f48c9af1a5b185"
server_key_iv: "45673181d8d6e8a94abc8ec0751b4cf9"
server_key_version: "encryptionkey@0"
I20260812 00:06:08.032266 18079 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786492899949492-12089-0/minicluster-data/master-0/wal/instance:
uuid: "803ba8e4de6b4594a69bc8c5002e7e77"
format_stamp: "Formatted at 2026-08-12 00:06:08 on dist-test-slave-f0tn"
server_key: "3ab9313579726b0637f48c9af1a5b185"
server_key_iv: "45673181d8d6e8a94abc8ec0751b4cf9"
server_key_version: "encryptionkey@0"
I20260812 00:06:08.033654 18079 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 00:06:08.034368 18103 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:06:08.034518 18079 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:06:08.034622 18079 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786492899949492-12089-0/minicluster-data/master-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786492899949492-12089-0/minicluster-data/master-0/wal
uuid: "803ba8e4de6b4594a69bc8c5002e7e77"
format_stamp: "Formatted at 2026-08-12 00:06:08 on dist-test-slave-f0tn"
server_key: "3ab9313579726b0637f48c9af1a5b185"
server_key_iv: "45673181d8d6e8a94abc8ec0751b4cf9"
server_key_version: "encryptionkey@0"
I20260812 00:06:08.034693 18079 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786492899949492-12089-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786492899949492-12089-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786492899949492-12089-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:06:08.042371 18079 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:06:08.044207 18079 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:06:08.044353 18079 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:06:08.048301 18079 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.126:35787
I20260812 00:06:08.048357 18192 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.126:35787 every 8 connection(s)
I20260812 00:06:08.048692 18079 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
I20260812 00:06:08.049604 18193 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:06:08.051952 18193 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 803ba8e4de6b4594a69bc8c5002e7e77: Bootstrap starting.
I20260812 00:06:08.052541 18193 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 803ba8e4de6b4594a69bc8c5002e7e77: Neither blocks nor log segments found. Creating new log.
I20260812 00:06:08.052805 18193 log.cc:824] T 00000000000000000000000000000000 P 803ba8e4de6b4594a69bc8c5002e7e77: Log is configured to *not* fsync() on all Append() calls
I20260812 00:06:08.053544 18193 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 803ba8e4de6b4594a69bc8c5002e7e77: No bootstrap required, opened a new log
I20260812 00:06:08.055101 18193 raft_consensus.cc:348] T 00000000000000000000000000000000 P 803ba8e4de6b4594a69bc8c5002e7e77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "803ba8e4de6b4594a69bc8c5002e7e77" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 35787 } }
I20260812 00:06:08.055246 18193 raft_consensus.cc:374] T 00000000000000000000000000000000 P 803ba8e4de6b4594a69bc8c5002e7e77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:06:08.055289 18193 raft_consensus.cc:729] T 00000000000000000000000000000000 P 803ba8e4de6b4594a69bc8c5002e7e77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 803ba8e4de6b4594a69bc8c5002e7e77, State: Initialized, Role: FOLLOWER
I20260812 00:06:08.055433 18193 consensus_queue.cc:260] T 00000000000000000000000000000000 P 803ba8e4de6b4594a69bc8c5002e7e77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "803ba8e4de6b4594a69bc8c5002e7e77" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 35787 } }
I20260812 00:06:08.055495 18193 raft_consensus.cc:388] T 00000000000000000000000000000000 P 803ba8e4de6b4594a69bc8c5002e7e77 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:06:08.055517 18193 raft_consensus.cc:482] T 00000000000000000000000000000000 P 803ba8e4de6b4594a69bc8c5002e7e77 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:06:08.055562 18193 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 803ba8e4de6b4594a69bc8c5002e7e77 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:06:08.056406 18193 raft_consensus.cc:504] T 00000000000000000000000000000000 P 803ba8e4de6b4594a69bc8c5002e7e77 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "803ba8e4de6b4594a69bc8c5002e7e77" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 35787 } }
I20260812 00:06:08.056499 18193 leader_election.cc:302] T 00000000000000000000000000000000 P 803ba8e4de6b4594a69bc8c5002e7e77 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 803ba8e4de6b4594a69bc8c5002e7e77; no voters:
I20260812 00:06:08.056660 18193 leader_election.cc:288] T 00000000000000000000000000000000 P 803ba8e4de6b4594a69bc8c5002e7e77 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:06:08.056687 18199 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 803ba8e4de6b4594a69bc8c5002e7e77 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:06:08.056824 18199 raft_consensus.cc:686] T 00000000000000000000000000000000 P 803ba8e4de6b4594a69bc8c5002e7e77 [term 1 LEADER]: Becoming Leader. State: Replica: 803ba8e4de6b4594a69bc8c5002e7e77, State: Running, Role: LEADER
I20260812 00:06:08.056919 18193 sys_catalog.cc:564] T 00000000000000000000000000000000 P 803ba8e4de6b4594a69bc8c5002e7e77 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:06:08.056973 18199 consensus_queue.cc:237] T 00000000000000000000000000000000 P 803ba8e4de6b4594a69bc8c5002e7e77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "803ba8e4de6b4594a69bc8c5002e7e77" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 35787 } }
I20260812 00:06:08.057354 18201 sys_catalog.cc:455] T 00000000000000000000000000000000 P 803ba8e4de6b4594a69bc8c5002e7e77 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 803ba8e4de6b4594a69bc8c5002e7e77. Latest consensus state: current_term: 1 leader_uuid: "803ba8e4de6b4594a69bc8c5002e7e77" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "803ba8e4de6b4594a69bc8c5002e7e77" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 35787 } } }
I20260812 00:06:08.057345 18200 sys_catalog.cc:455] T 00000000000000000000000000000000 P 803ba8e4de6b4594a69bc8c5002e7e77 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "803ba8e4de6b4594a69bc8c5002e7e77" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "803ba8e4de6b4594a69bc8c5002e7e77" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 35787 } } }
I20260812 00:06:08.057487 18201 sys_catalog.cc:458] T 00000000000000000000000000000000 P 803ba8e4de6b4594a69bc8c5002e7e77 [sys.catalog]: This master's current role is: LEADER
I20260812 00:06:08.057500 18200 sys_catalog.cc:458] T 00000000000000000000000000000000 P 803ba8e4de6b4594a69bc8c5002e7e77 [sys.catalog]: This master's current role is: LEADER
I20260812 00:06:08.057898 18215 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:06:08.058378 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 18079
I20260812 00:06:08.058401 18215 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:06:08.058498 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786492899949492-12089-0/minicluster-data/master-0/wal/instance
I20260812 00:06:08.058691 12089 external_mini_cluster.cc:1428] Setting key 10931b1f5358412c1ddea6b0db8f9baf
I20260812 00:06:08.059973 18215 catalog_manager.cc:1347] Generated new cluster ID: 673a0e615d454839b19cecd4e17db7ef
I20260812 00:06:08.060029 18215 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:06:08.064548 18215 catalog_manager.cc:1370] Generated new certificate authority record
Aug 12 00:06:08 dist-test-slave-f0tn krb5kdc[18060](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493167, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:06:08.065249 18215 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:06:08.068624 18234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:08.059203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60577 (local address 127.11.206.126:35787)
0812 00:06:08.059605 (+ 402us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:08.059615 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:08.059649 (+ 34us) server_negotiation.cc:407] Connection header received
0812 00:06:08.059764 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:08.059771 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:08.059846 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:08.060631 (+ 785us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:08.060708 (+ 77us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:08.061682 (+ 974us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:08.062434 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:08.062861 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:08.062956 (+ 95us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:08.065589 (+ 2633us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:06:08.065593 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:06:08.065593 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:06:08.065604 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:06:08.067145 (+ 1541us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:08.067521 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:08.067524 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:08.067524 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:08.067611 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:08.067816 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:08.067817 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:08.067817 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:08.068032 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:06:08.068184 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:08.068312 (+ 128us) server_negotiation.cc:299] Negotiation successful
0812 00:06:08.068417 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":358,"thread_start_us":85,"threads_started":1}
I20260812 00:06:08.069603 12089 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:06:08.070326 18215 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 803ba8e4de6b4594a69bc8c5002e7e77: Generated new TSK 0
I20260812 00:06:08.070484 18215 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:06:08.076752 18234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:08.071083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34201 (local address 127.11.206.126:35787)
0812 00:06:08.071125 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:08.071127 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:08.071224 (+ 97us) server_negotiation.cc:407] Connection header received
0812 00:06:08.071277 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:08.071278 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:08.071287 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:08.071339 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:08.071858 (+ 519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:08.072376 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:08.073098 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:08.073309 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:08.073363 (+ 54us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:08.074510 (+ 1147us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:06:08.074511 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:06:08.074512 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:06:08.074518 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:06:08.075717 (+ 1199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:08.076043 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:08.076044 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:08.076045 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:08.076100 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:08.076286 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:08.076287 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:08.076287 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:08.076389 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:06:08.076476 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:08.076603 (+ 127us) server_negotiation.cc:299] Negotiation successful
0812 00:06:08.076665 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 00:06:08.078840 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 18079
W20260812 00:06:08.096163 18057 connection.cc:535] client connection to 127.11.206.126:35787 recv error: Network error: failed to read from TLS socket (remote: 127.11.206.126:35787): Connection reset by peer (error 104)
2026-08-12T00:06:08Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1453 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786492899949492-12089-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:06:08 dist-test-slave-f0tn krb5kdc[18249](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:06:08 dist-test-slave-f0tn krb5kdc[18249](info): set up 2 sockets
Aug 12 00:06:08 dist-test-slave-f0tn krb5kdc[18249](info): commencing operation
krb5kdc: starting...
W20260812 00:06:09.287545 12089 mini_kdc.cc:121] Time spent starting KDC: real 1.178s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786492899949492-12089-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786492899949492-12089-0/krb5kdc/test-user.keytab.
Aug 12 00:06:09 dist-test-slave-f0tn krb5kdc[18249](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493169, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:06:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:06:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.206.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab.
Entry for principal kudu/127.11.206.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab.
I20260812 00:06:09.402454 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786492899949492-12089-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786492899949492-12089-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786492899949492-12089-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:39679
--webserver_interface=127.11.206.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab
--principal=kudu/127.11.206.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:34385
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.206.126:39679
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:06:09.483143 18265 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:06:09.483359 18265 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:06:09.483381 18265 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:06:09.484480 18265 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:06:09.484519 18265 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:06:09.484531 18265 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:06:09.484542 18265 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:06:09.484557 18265 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:06:09.486096 18265 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:34385
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786492899949492-12089-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786492899949492-12089-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.206.126:39679
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab
--principal=kudu/127.11.206.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:39679
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.206.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18265
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786492899949492-12089-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:06:09.486315 18265 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:06:09.486505 18265 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:06:09.491431 18272 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:06:09.491389 18275 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:06:09.491412 18273 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:06:09.491511 18265 server_base.cc:1034] running on GCE node
I20260812 00:06:09.491910 18265 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:06:09.492182 18265 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:06:09.493312 18265 hybrid_clock.cc:648] HybridClock initialized: now 1786493169493296 us; error 48 us; skew 500 ppm
Aug 12 00:06:09 dist-test-slave-f0tn krb5kdc[18249](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493169, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:06:09.495877 18265 init.cc:377] Logged in from keytab as kudu/127.11.206.126@KRBTEST.COM (short username kudu)
I20260812 00:06:09.496337 18265 webserver.cc:460] Webserver started at http://127.11.206.126:43353/ using document root <none> and password file <none>
I20260812 00:06:09.496549 18265 fs_manager.cc:359] Metadata directory not provided
I20260812 00:06:09.496599 18265 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:06:09.496733 18265 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:06:09.497913 18265 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786492899949492-12089-0/minicluster-data/master-0/data/instance:
uuid: "bc3705af045140e5846f235bff7c4484"
format_stamp: "Formatted at 2026-08-12 00:06:09 on dist-test-slave-f0tn"
server_key: "79bdd83ef31e1f2adb451191fd2b9489"
server_key_iv: "7b81dea89724d475bb9eac47610def2f"
server_key_version: "encryptionkey@0"
I20260812 00:06:09.498270 18265 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786492899949492-12089-0/minicluster-data/master-0/wal/instance:
uuid: "bc3705af045140e5846f235bff7c4484"
format_stamp: "Formatted at 2026-08-12 00:06:09 on dist-test-slave-f0tn"
server_key: "79bdd83ef31e1f2adb451191fd2b9489"
server_key_iv: "7b81dea89724d475bb9eac47610def2f"
server_key_version: "encryptionkey@0"
I20260812 00:06:09.499583 18265 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 00:06:09.500280 18287 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:06:09.500450 18265 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:06:09.500538 18265 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786492899949492-12089-0/minicluster-data/master-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786492899949492-12089-0/minicluster-data/master-0/wal
uuid: "bc3705af045140e5846f235bff7c4484"
format_stamp: "Formatted at 2026-08-12 00:06:09 on dist-test-slave-f0tn"
server_key: "79bdd83ef31e1f2adb451191fd2b9489"
server_key_iv: "7b81dea89724d475bb9eac47610def2f"
server_key_version: "encryptionkey@0"
I20260812 00:06:09.500615 18265 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786492899949492-12089-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786492899949492-12089-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786492899949492-12089-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:06:09.515795 18265 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:06:09.518039 18265 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:06:09.518180 18265 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:06:09.522056 18265 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.126:39679
I20260812 00:06:09.522105 18373 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.126:39679 every 8 connection(s)
I20260812 00:06:09.522433 18265 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
I20260812 00:06:09.523316 18375 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:06:09.525588 18375 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bc3705af045140e5846f235bff7c4484: Bootstrap starting.
I20260812 00:06:09.526134 18375 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bc3705af045140e5846f235bff7c4484: Neither blocks nor log segments found. Creating new log.
I20260812 00:06:09.526397 18375 log.cc:824] T 00000000000000000000000000000000 P bc3705af045140e5846f235bff7c4484: Log is configured to *not* fsync() on all Append() calls
I20260812 00:06:09.527064 18375 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bc3705af045140e5846f235bff7c4484: No bootstrap required, opened a new log
I20260812 00:06:09.527052 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 18265
I20260812 00:06:09.527160 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786492899949492-12089-0/minicluster-data/master-0/wal/instance
I20260812 00:06:09.527320 12089 external_mini_cluster.cc:1428] Setting key 5397f214d9343500f16f3bbbd701bea3
I20260812 00:06:09.528769 18375 raft_consensus.cc:348] T 00000000000000000000000000000000 P bc3705af045140e5846f235bff7c4484 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc3705af045140e5846f235bff7c4484" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 39679 } }
I20260812 00:06:09.528906 18375 raft_consensus.cc:374] T 00000000000000000000000000000000 P bc3705af045140e5846f235bff7c4484 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:06:09.528939 18375 raft_consensus.cc:729] T 00000000000000000000000000000000 P bc3705af045140e5846f235bff7c4484 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc3705af045140e5846f235bff7c4484, State: Initialized, Role: FOLLOWER
I20260812 00:06:09.529076 18375 consensus_queue.cc:260] T 00000000000000000000000000000000 P bc3705af045140e5846f235bff7c4484 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc3705af045140e5846f235bff7c4484" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 39679 } }
I20260812 00:06:09.529162 18375 raft_consensus.cc:388] T 00000000000000000000000000000000 P bc3705af045140e5846f235bff7c4484 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:06:09.529201 18375 raft_consensus.cc:482] T 00000000000000000000000000000000 P bc3705af045140e5846f235bff7c4484 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:06:09.529258 18375 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bc3705af045140e5846f235bff7c4484 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:06:09.529923 18375 raft_consensus.cc:504] T 00000000000000000000000000000000 P bc3705af045140e5846f235bff7c4484 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc3705af045140e5846f235bff7c4484" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 39679 } }
I20260812 00:06:09.530033 18375 leader_election.cc:302] T 00000000000000000000000000000000 P bc3705af045140e5846f235bff7c4484 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bc3705af045140e5846f235bff7c4484; no voters:
I20260812 00:06:09.530186 18375 leader_election.cc:288] T 00000000000000000000000000000000 P bc3705af045140e5846f235bff7c4484 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:06:09.530216 18382 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bc3705af045140e5846f235bff7c4484 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:06:09.530369 18382 raft_consensus.cc:686] T 00000000000000000000000000000000 P bc3705af045140e5846f235bff7c4484 [term 1 LEADER]: Becoming Leader. State: Replica: bc3705af045140e5846f235bff7c4484, State: Running, Role: LEADER
I20260812 00:06:09.530422 18375 sys_catalog.cc:564] T 00000000000000000000000000000000 P bc3705af045140e5846f235bff7c4484 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:06:09.530510 18382 consensus_queue.cc:237] T 00000000000000000000000000000000 P bc3705af045140e5846f235bff7c4484 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc3705af045140e5846f235bff7c4484" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 39679 } }
I20260812 00:06:09.530831 18382 sys_catalog.cc:455] T 00000000000000000000000000000000 P bc3705af045140e5846f235bff7c4484 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bc3705af045140e5846f235bff7c4484. Latest consensus state: current_term: 1 leader_uuid: "bc3705af045140e5846f235bff7c4484" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc3705af045140e5846f235bff7c4484" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 39679 } } }
I20260812 00:06:09.530903 18386 sys_catalog.cc:455] T 00000000000000000000000000000000 P bc3705af045140e5846f235bff7c4484 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bc3705af045140e5846f235bff7c4484" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc3705af045140e5846f235bff7c4484" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 39679 } } }
I20260812 00:06:09.530931 18382 sys_catalog.cc:458] T 00000000000000000000000000000000 P bc3705af045140e5846f235bff7c4484 [sys.catalog]: This master's current role is: LEADER
I20260812 00:06:09.530962 18386 sys_catalog.cc:458] T 00000000000000000000000000000000 P bc3705af045140e5846f235bff7c4484 [sys.catalog]: This master's current role is: LEADER
I20260812 00:06:09.531126 18394 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:06:09.531711 18394 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:06:09.533526 18394 catalog_manager.cc:1347] Generated new cluster ID: 994f9eeb352e438388dcf95101001d2e
I20260812 00:06:09.533579 18394 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:06:09.534114 18381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:09.527800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56427 (local address 127.11.206.126:39679)
0812 00:06:09.527999 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:09.528009 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:09.528037 (+ 28us) server_negotiation.cc:407] Connection header received
0812 00:06:09.528739 (+ 702us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:09.528745 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:09.528791 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:09.528909 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:09.529152 (+ 243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:09.530816 (+ 1664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:09.531963 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:09.532589 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:09.532687 (+ 98us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:09.533407 (+ 720us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:06:09.533411 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:06:09.533411 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:06:09.533614 (+ 203us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:06:09.533651 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:06:09.533667 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:06:09.533767 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:09.533875 (+ 108us) server_negotiation.cc:299] Negotiation successful
0812 00:06:09.533908 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":82,"threads_started":1}
I20260812 00:06:09.535029 12089 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:06:09.539754 18381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:09.536386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57543 (local address 127.11.206.126:39679)
0812 00:06:09.536417 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:09.536419 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:09.536542 (+ 123us) server_negotiation.cc:407] Connection header received
0812 00:06:09.536596 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:09.536596 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:09.536604 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:09.536658 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:09.536789 (+ 131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:09.537519 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:09.538499 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:09.538803 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:09.538854 (+ 51us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:09.539526 (+ 672us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:06:09.539528 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:06:09.539528 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:06:09.539532 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:06:09.539547 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:06:09.539551 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:06:09.539596 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:09.539672 (+ 76us) server_negotiation.cc:299] Negotiation successful
0812 00:06:09.539684 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260812 00:06:09.551656 18394 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:06:09.552243 18394 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:06:09.562588 18394 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bc3705af045140e5846f235bff7c4484: Generated new TSK 0
I20260812 00:06:09.562796 18394 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:06:09.565486 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 18265
W20260812 00:06:09.584910 18245 connection.cc:535] client connection to 127.11.206.126:39679 recv error: Network error: failed to read from TLS socket (remote: 127.11.206.126:39679): Connection reset by peer (error 104)
2026-08-12T00:06:09Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1488 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786492899949492-12089-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:06:09 dist-test-slave-f0tn krb5kdc[18428](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:06:09 dist-test-slave-f0tn krb5kdc[18428](info): set up 2 sockets
Aug 12 00:06:09 dist-test-slave-f0tn krb5kdc[18428](info): commencing operation
krb5kdc: starting...
W20260812 00:06:10.790743 12089 mini_kdc.cc:121] Time spent starting KDC: real 1.192s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786492899949492-12089-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786492899949492-12089-0/krb5kdc/test-user.keytab.
Aug 12 00:06:10 dist-test-slave-f0tn krb5kdc[18428](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493170, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:06:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:06:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.206.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab.
Entry for principal kudu/127.11.206.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab.
I20260812 00:06:10.904233 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786492899949492-12089-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786492899949492-12089-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786492899949492-12089-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:35793
--webserver_interface=127.11.206.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab
--principal=kudu/127.11.206.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:45611
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.206.126:35793
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:06:10.985927 18453 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:06:10.986145 18453 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:06:10.986174 18453 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:06:10.987309 18453 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:06:10.987352 18453 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:06:10.987371 18453 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:06:10.987387 18453 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:06:10.987403 18453 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:06:10.988855 18453 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:45611
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786492899949492-12089-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786492899949492-12089-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.206.126:35793
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab
--principal=kudu/127.11.206.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:35793
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.206.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18453
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786492899949492-12089-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:06:10.989109 18453 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:06:10.989321 18453 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:06:10.994127 18462 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:06:10.994138 18465 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:06:10.994179 18453 server_base.cc:1034] running on GCE node
W20260812 00:06:10.994234 18461 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:06:10.994632 18453 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:06:10.994935 18453 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:06:10.996078 18453 hybrid_clock.cc:648] HybridClock initialized: now 1786493170996068 us; error 29 us; skew 500 ppm
Aug 12 00:06:10 dist-test-slave-f0tn krb5kdc[18428](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493170, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:06:10.998634 18453 init.cc:377] Logged in from keytab as kudu/127.11.206.126@KRBTEST.COM (short username kudu)
I20260812 00:06:10.999091 18453 webserver.cc:460] Webserver started at http://127.11.206.126:35055/ using document root <none> and password file <none>
I20260812 00:06:10.999305 18453 fs_manager.cc:359] Metadata directory not provided
I20260812 00:06:10.999356 18453 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:06:10.999487 18453 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:06:11.000574 18453 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786492899949492-12089-0/minicluster-data/master-0/data/instance:
uuid: "eca2b74b28a04a08980d160fa0ff688f"
format_stamp: "Formatted at 2026-08-12 00:06:10 on dist-test-slave-f0tn"
server_key: "ce94ece89acf72d8ca4696b316045ff5"
server_key_iv: "6eed6b1b6a2bf86d8bba26e9486fd1d0"
server_key_version: "encryptionkey@0"
I20260812 00:06:11.000921 18453 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786492899949492-12089-0/minicluster-data/master-0/wal/instance:
uuid: "eca2b74b28a04a08980d160fa0ff688f"
format_stamp: "Formatted at 2026-08-12 00:06:10 on dist-test-slave-f0tn"
server_key: "ce94ece89acf72d8ca4696b316045ff5"
server_key_iv: "6eed6b1b6a2bf86d8bba26e9486fd1d0"
server_key_version: "encryptionkey@0"
I20260812 00:06:11.002381 18453 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 00:06:11.003084 18473 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:06:11.003243 18453 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 00:06:11.003336 18453 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786492899949492-12089-0/minicluster-data/master-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786492899949492-12089-0/minicluster-data/master-0/wal
uuid: "eca2b74b28a04a08980d160fa0ff688f"
format_stamp: "Formatted at 2026-08-12 00:06:10 on dist-test-slave-f0tn"
server_key: "ce94ece89acf72d8ca4696b316045ff5"
server_key_iv: "6eed6b1b6a2bf86d8bba26e9486fd1d0"
server_key_version: "encryptionkey@0"
I20260812 00:06:11.003400 18453 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786492899949492-12089-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786492899949492-12089-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786492899949492-12089-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:06:11.006752 18453 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:06:11.008920 18453 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:06:11.009054 18453 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:06:11.012982 18453 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.126:35793
I20260812 00:06:11.013015 18552 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.126:35793 every 8 connection(s)
I20260812 00:06:11.013331 18453 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
I20260812 00:06:11.014410 18553 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:06:11.016688 18553 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eca2b74b28a04a08980d160fa0ff688f: Bootstrap starting.
I20260812 00:06:11.017257 18553 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P eca2b74b28a04a08980d160fa0ff688f: Neither blocks nor log segments found. Creating new log.
I20260812 00:06:11.017551 18553 log.cc:824] T 00000000000000000000000000000000 P eca2b74b28a04a08980d160fa0ff688f: Log is configured to *not* fsync() on all Append() calls
I20260812 00:06:11.018232 18553 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eca2b74b28a04a08980d160fa0ff688f: No bootstrap required, opened a new log
I20260812 00:06:11.018839 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 18453
I20260812 00:06:11.018939 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786492899949492-12089-0/minicluster-data/master-0/wal/instance
I20260812 00:06:11.019100 12089 external_mini_cluster.cc:1428] Setting key e4bec6c2b0e558f2e06cbc993c2e75df
I20260812 00:06:11.020185 18553 raft_consensus.cc:348] T 00000000000000000000000000000000 P eca2b74b28a04a08980d160fa0ff688f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eca2b74b28a04a08980d160fa0ff688f" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 35793 } }
I20260812 00:06:11.020360 18553 raft_consensus.cc:374] T 00000000000000000000000000000000 P eca2b74b28a04a08980d160fa0ff688f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:06:11.020397 18553 raft_consensus.cc:729] T 00000000000000000000000000000000 P eca2b74b28a04a08980d160fa0ff688f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eca2b74b28a04a08980d160fa0ff688f, State: Initialized, Role: FOLLOWER
I20260812 00:06:11.020562 18553 consensus_queue.cc:260] T 00000000000000000000000000000000 P eca2b74b28a04a08980d160fa0ff688f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eca2b74b28a04a08980d160fa0ff688f" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 35793 } }
I20260812 00:06:11.020671 18553 raft_consensus.cc:388] T 00000000000000000000000000000000 P eca2b74b28a04a08980d160fa0ff688f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:06:11.020709 18553 raft_consensus.cc:482] T 00000000000000000000000000000000 P eca2b74b28a04a08980d160fa0ff688f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:06:11.020756 18553 raft_consensus.cc:3037] T 00000000000000000000000000000000 P eca2b74b28a04a08980d160fa0ff688f [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:06:11.021360 18561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:11.019587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60785 (local address 127.11.206.126:35793)
0812 00:06:11.019769 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:11.019779 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:11.019816 (+ 37us) server_negotiation.cc:407] Connection header received
0812 00:06:11.020151 (+ 335us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:11.020160 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:11.020195 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:11.020343 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:11.020917 (+ 574us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:06:11.020921 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:06:11.020921 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:06:11.020926 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:06:11.020975 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:06:11.020990 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:06:11.021065 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:11.021102 (+ 37us) server_negotiation.cc:299] Negotiation successful
0812 00:06:11.021144 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":77,"threads_started":1}
I20260812 00:06:11.021791 18553 raft_consensus.cc:504] T 00000000000000000000000000000000 P eca2b74b28a04a08980d160fa0ff688f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eca2b74b28a04a08980d160fa0ff688f" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 35793 } }
I20260812 00:06:11.021888 18553 leader_election.cc:302] T 00000000000000000000000000000000 P eca2b74b28a04a08980d160fa0ff688f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: eca2b74b28a04a08980d160fa0ff688f; no voters:
I20260812 00:06:11.022045 18553 leader_election.cc:288] T 00000000000000000000000000000000 P eca2b74b28a04a08980d160fa0ff688f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:06:11.022086 18562 raft_consensus.cc:2781] T 00000000000000000000000000000000 P eca2b74b28a04a08980d160fa0ff688f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:06:11.022310 18553 sys_catalog.cc:564] T 00000000000000000000000000000000 P eca2b74b28a04a08980d160fa0ff688f [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:06:11.022305 12089 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:06:11.022356 18562 raft_consensus.cc:686] T 00000000000000000000000000000000 P eca2b74b28a04a08980d160fa0ff688f [term 1 LEADER]: Becoming Leader. State: Replica: eca2b74b28a04a08980d160fa0ff688f, State: Running, Role: LEADER
I20260812 00:06:11.022447 18562 consensus_queue.cc:237] T 00000000000000000000000000000000 P eca2b74b28a04a08980d160fa0ff688f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eca2b74b28a04a08980d160fa0ff688f" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 35793 } }
I20260812 00:06:11.022784 18562 sys_catalog.cc:455] T 00000000000000000000000000000000 P eca2b74b28a04a08980d160fa0ff688f [sys.catalog]: SysCatalogTable state changed. Reason: New leader eca2b74b28a04a08980d160fa0ff688f. Latest consensus state: current_term: 1 leader_uuid: "eca2b74b28a04a08980d160fa0ff688f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eca2b74b28a04a08980d160fa0ff688f" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 35793 } } }
I20260812 00:06:11.022858 18562 sys_catalog.cc:458] T 00000000000000000000000000000000 P eca2b74b28a04a08980d160fa0ff688f [sys.catalog]: This master's current role is: LEADER
I20260812 00:06:11.022928 18564 sys_catalog.cc:455] T 00000000000000000000000000000000 P eca2b74b28a04a08980d160fa0ff688f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "eca2b74b28a04a08980d160fa0ff688f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eca2b74b28a04a08980d160fa0ff688f" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 35793 } } }
I20260812 00:06:11.023053 18564 sys_catalog.cc:458] T 00000000000000000000000000000000 P eca2b74b28a04a08980d160fa0ff688f [sys.catalog]: This master's current role is: LEADER
W20260812 00:06:11.024267 18593 catalog_manager.cc:1558] T 00000000000000000000000000000000 P eca2b74b28a04a08980d160fa0ff688f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 00:06:11.024324 18593 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 00:06:11.024485 18574 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:06:11.024639 18574 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:06:11.024905 18561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:11.023749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52987 (local address 127.11.206.126:35793)
0812 00:06:11.023781 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:11.023783 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:11.023968 (+ 185us) server_negotiation.cc:407] Connection header received
0812 00:06:11.024042 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:11.024042 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:11.024047 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:11.024095 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:11.024700 (+ 605us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:06:11.024701 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:06:11.024701 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:06:11.024705 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:06:11.024719 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:06:11.024723 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:06:11.024769 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:11.024825 (+ 56us) server_negotiation.cc:299] Negotiation successful
0812 00:06:11.024838 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260812 00:06:11.026165 18574 catalog_manager.cc:1347] Generated new cluster ID: 496af8578d304ef7a84f47d83a475eae
I20260812 00:06:11.026219 18574 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:06:11.046974 18574 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:06:11.047181 18574 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:06:11.057045 18574 catalog_manager.cc:5868] T 00000000000000000000000000000000 P eca2b74b28a04a08980d160fa0ff688f: Generated new TSK 0
I20260812 00:06:11.057267 18574 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:06:11.064200 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 18453
2026-08-12T00:06:11Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1492 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786492899949492-12089-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:06:11 dist-test-slave-f0tn krb5kdc[18606](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:06:11 dist-test-slave-f0tn krb5kdc[18606](info): set up 2 sockets
Aug 12 00:06:11 dist-test-slave-f0tn krb5kdc[18606](info): commencing operation
krb5kdc: starting...
W20260812 00:06:12.243513 12089 mini_kdc.cc:121] Time spent starting KDC: real 1.153s user 0.003s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786492899949492-12089-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786492899949492-12089-0/krb5kdc/test-user.keytab.
Aug 12 00:06:12 dist-test-slave-f0tn krb5kdc[18606](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493172, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:06:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:06:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.206.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab.
Entry for principal kudu/127.11.206.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab.
I20260812 00:06:12.359925 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786492899949492-12089-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786492899949492-12089-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786492899949492-12089-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:33723
--webserver_interface=127.11.206.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab
--principal=kudu/127.11.206.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:36811
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.206.126:33723
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:06:12.441476 18622 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:06:12.441689 18622 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:06:12.441725 18622 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:06:12.442873 18622 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:06:12.442915 18622 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:06:12.442934 18622 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:06:12.442950 18622 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:06:12.442965 18622 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:06:12.444509 18622 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:36811
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786492899949492-12089-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786492899949492-12089-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.206.126:33723
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab
--principal=kudu/127.11.206.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:33723
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.206.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18622
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786492899949492-12089-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:06:12.444752 18622 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:06:12.444962 18622 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:06:12.449609 18636 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:06:12.449723 18622 server_base.cc:1034] running on GCE node
W20260812 00:06:12.449627 18639 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:06:12.449829 18637 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:06:12.450064 18622 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:06:12.450373 18622 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:06:12.451514 18622 hybrid_clock.cc:648] HybridClock initialized: now 1786493172451490 us; error 38 us; skew 500 ppm
Aug 12 00:06:12 dist-test-slave-f0tn krb5kdc[18606](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493172, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:06:12.453917 18622 init.cc:377] Logged in from keytab as kudu/127.11.206.126@KRBTEST.COM (short username kudu)
I20260812 00:06:12.454393 18622 webserver.cc:460] Webserver started at http://127.11.206.126:32813/ using document root <none> and password file <none>
I20260812 00:06:12.454594 18622 fs_manager.cc:359] Metadata directory not provided
I20260812 00:06:12.454641 18622 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:06:12.454769 18622 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:06:12.455808 18622 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786492899949492-12089-0/minicluster-data/master-0/data/instance:
uuid: "0a6650e9f7b74a77ad4b577c7fd8652d"
format_stamp: "Formatted at 2026-08-12 00:06:12 on dist-test-slave-f0tn"
server_key: "5469540708411ff11ac117b269ca7be4"
server_key_iv: "e716bd9336c58504f12a8a7bb5f2975c"
server_key_version: "encryptionkey@0"
I20260812 00:06:12.456146 18622 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786492899949492-12089-0/minicluster-data/master-0/wal/instance:
uuid: "0a6650e9f7b74a77ad4b577c7fd8652d"
format_stamp: "Formatted at 2026-08-12 00:06:12 on dist-test-slave-f0tn"
server_key: "5469540708411ff11ac117b269ca7be4"
server_key_iv: "e716bd9336c58504f12a8a7bb5f2975c"
server_key_version: "encryptionkey@0"
I20260812 00:06:12.457432 18622 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 00:06:12.458146 18647 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:06:12.458338 18622 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:06:12.458421 18622 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786492899949492-12089-0/minicluster-data/master-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786492899949492-12089-0/minicluster-data/master-0/wal
uuid: "0a6650e9f7b74a77ad4b577c7fd8652d"
format_stamp: "Formatted at 2026-08-12 00:06:12 on dist-test-slave-f0tn"
server_key: "5469540708411ff11ac117b269ca7be4"
server_key_iv: "e716bd9336c58504f12a8a7bb5f2975c"
server_key_version: "encryptionkey@0"
I20260812 00:06:12.458489 18622 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786492899949492-12089-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786492899949492-12089-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786492899949492-12089-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:06:12.471312 18622 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:06:12.473443 18622 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:06:12.473578 18622 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:06:12.477442 18622 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.126:33723
I20260812 00:06:12.477476 18731 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.126:33723 every 8 connection(s)
I20260812 00:06:12.477797 18622 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
I20260812 00:06:12.478636 18733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:06:12.480906 18733 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0a6650e9f7b74a77ad4b577c7fd8652d: Bootstrap starting.
I20260812 00:06:12.481468 18733 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0a6650e9f7b74a77ad4b577c7fd8652d: Neither blocks nor log segments found. Creating new log.
I20260812 00:06:12.481721 18733 log.cc:824] T 00000000000000000000000000000000 P 0a6650e9f7b74a77ad4b577c7fd8652d: Log is configured to *not* fsync() on all Append() calls
I20260812 00:06:12.482378 18733 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0a6650e9f7b74a77ad4b577c7fd8652d: No bootstrap required, opened a new log
I20260812 00:06:12.483899 18733 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0a6650e9f7b74a77ad4b577c7fd8652d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a6650e9f7b74a77ad4b577c7fd8652d" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 33723 } }
I20260812 00:06:12.484031 18733 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0a6650e9f7b74a77ad4b577c7fd8652d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:06:12.484102 18733 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0a6650e9f7b74a77ad4b577c7fd8652d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a6650e9f7b74a77ad4b577c7fd8652d, State: Initialized, Role: FOLLOWER
I20260812 00:06:12.484247 18733 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0a6650e9f7b74a77ad4b577c7fd8652d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a6650e9f7b74a77ad4b577c7fd8652d" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 33723 } }
I20260812 00:06:12.484313 18733 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0a6650e9f7b74a77ad4b577c7fd8652d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:06:12.484346 18733 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0a6650e9f7b74a77ad4b577c7fd8652d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:06:12.484391 18733 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0a6650e9f7b74a77ad4b577c7fd8652d [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:06:12.484822 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 18622
I20260812 00:06:12.484911 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786492899949492-12089-0/minicluster-data/master-0/wal/instance
I20260812 00:06:12.485072 12089 external_mini_cluster.cc:1428] Setting key 7e437e2d226b35db30eb3d9843e051ce
I20260812 00:06:12.485301 18733 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0a6650e9f7b74a77ad4b577c7fd8652d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a6650e9f7b74a77ad4b577c7fd8652d" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 33723 } }
I20260812 00:06:12.485431 18733 leader_election.cc:302] T 00000000000000000000000000000000 P 0a6650e9f7b74a77ad4b577c7fd8652d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0a6650e9f7b74a77ad4b577c7fd8652d; no voters:
I20260812 00:06:12.485606 18733 leader_election.cc:288] T 00000000000000000000000000000000 P 0a6650e9f7b74a77ad4b577c7fd8652d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:06:12.485641 18737 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0a6650e9f7b74a77ad4b577c7fd8652d [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:06:12.485909 18737 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0a6650e9f7b74a77ad4b577c7fd8652d [term 1 LEADER]: Becoming Leader. State: Replica: 0a6650e9f7b74a77ad4b577c7fd8652d, State: Running, Role: LEADER
I20260812 00:06:12.485934 18733 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0a6650e9f7b74a77ad4b577c7fd8652d [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:06:12.486011 18737 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0a6650e9f7b74a77ad4b577c7fd8652d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a6650e9f7b74a77ad4b577c7fd8652d" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 33723 } }
I20260812 00:06:12.486313 18737 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0a6650e9f7b74a77ad4b577c7fd8652d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0a6650e9f7b74a77ad4b577c7fd8652d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a6650e9f7b74a77ad4b577c7fd8652d" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 33723 } } }
I20260812 00:06:12.486441 18737 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0a6650e9f7b74a77ad4b577c7fd8652d [sys.catalog]: This master's current role is: LEADER
I20260812 00:06:12.486620 18737 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0a6650e9f7b74a77ad4b577c7fd8652d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0a6650e9f7b74a77ad4b577c7fd8652d. Latest consensus state: current_term: 1 leader_uuid: "0a6650e9f7b74a77ad4b577c7fd8652d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a6650e9f7b74a77ad4b577c7fd8652d" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 33723 } } }
I20260812 00:06:12.486737 18737 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0a6650e9f7b74a77ad4b577c7fd8652d [sys.catalog]: This master's current role is: LEADER
I20260812 00:06:12.487116 18754 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:06:12.487653 18754 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:06:12.489208 18754 catalog_manager.cc:1347] Generated new cluster ID: 9ec26853b3974cb8bb15772d90629176
I20260812 00:06:12.489257 18754 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 00:06:12 dist-test-slave-f0tn krb5kdc[18606](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493172, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:06:12.496866 18743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:12.485765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48639 (local address 127.11.206.126:33723)
0812 00:06:12.485927 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:12.485937 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:12.485976 (+ 39us) server_negotiation.cc:407] Connection header received
0812 00:06:12.486090 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:12.486096 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:12.486150 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:12.487125 (+ 975us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:12.487333 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:12.488587 (+ 1254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:12.489696 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:12.490329 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:12.490437 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:12.493256 (+ 2819us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:06:12.493261 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:06:12.493262 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:06:12.493275 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:06:12.495254 (+ 1979us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:12.495617 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:12.495621 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:12.495621 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:12.495751 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:12.495929 (+ 178us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:12.495929 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:12.495930 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:12.496254 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:06:12.496411 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:12.496482 (+ 71us) server_negotiation.cc:299] Negotiation successful
0812 00:06:12.496641 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108,"thread_start_us":69,"threads_started":1}
I20260812 00:06:12.497846 12089 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:06:12.505678 18754 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:06:12.506345 18743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:12.499256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47089 (local address 127.11.206.126:33723)
0812 00:06:12.499296 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:12.499298 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:12.499341 (+ 43us) server_negotiation.cc:407] Connection header received
0812 00:06:12.499417 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:12.499418 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:12.499427 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:12.499476 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:12.500080 (+ 604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:12.500809 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:12.501843 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:12.502138 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:12.502194 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:12.503511 (+ 1317us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:06:12.503512 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:06:12.503513 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:06:12.503520 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:06:12.505046 (+ 1526us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:12.505455 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:12.505457 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:12.505457 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:12.505523 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:12.505749 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:12.505750 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:12.505751 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:12.505868 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:06:12.505950 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:12.506148 (+ 198us) server_negotiation.cc:299] Negotiation successful
0812 00:06:12.506242 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 00:06:12.506405 18754 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:06:12.515344 18754 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0a6650e9f7b74a77ad4b577c7fd8652d: Generated new TSK 0
I20260812 00:06:12.515614 18754 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:06:12.519069 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 18622
2026-08-12T00:06:12Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1452 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786492899949492-12089-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:06:12 dist-test-slave-f0tn krb5kdc[18779](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:06:12 dist-test-slave-f0tn krb5kdc[18779](info): set up 2 sockets
Aug 12 00:06:12 dist-test-slave-f0tn krb5kdc[18779](info): commencing operation
krb5kdc: starting...
W20260812 00:06:13.700767 12089 mini_kdc.cc:121] Time spent starting KDC: real 1.158s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786492899949492-12089-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786492899949492-12089-0/krb5kdc/test-user.keytab.
Aug 12 00:06:13 dist-test-slave-f0tn krb5kdc[18779](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493173, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:06:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:06:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.206.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab.
Entry for principal kudu/127.11.206.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab.
I20260812 00:06:13.815816 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786492899949492-12089-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786492899949492-12089-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786492899949492-12089-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:41135
--webserver_interface=127.11.206.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab
--principal=kudu/127.11.206.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:42163
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.206.126:41135
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:06:13.896823 18801 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:06:13.897038 18801 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:06:13.897059 18801 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:06:13.898231 18801 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:06:13.898275 18801 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:06:13.898288 18801 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:06:13.898300 18801 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:06:13.898311 18801 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:06:13.899780 18801 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:42163
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786492899949492-12089-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786492899949492-12089-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.206.126:41135
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab
--principal=kudu/127.11.206.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:41135
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.206.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18801
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786492899949492-12089-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:06:13.900007 18801 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:06:13.900234 18801 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:06:13.905028 18809 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:06:13.905062 18816 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:06:13.905179 18801 server_base.cc:1034] running on GCE node
W20260812 00:06:13.905062 18807 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:06:13.905511 18801 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:06:13.905813 18801 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:06:13.906952 18801 hybrid_clock.cc:648] HybridClock initialized: now 1786493173906946 us; error 30 us; skew 500 ppm
Aug 12 00:06:13 dist-test-slave-f0tn krb5kdc[18779](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493173, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:06:13.912916 18801 init.cc:377] Logged in from keytab as kudu/127.11.206.126@KRBTEST.COM (short username kudu)
I20260812 00:06:13.913431 18801 webserver.cc:460] Webserver started at http://127.11.206.126:41193/ using document root <none> and password file <none>
I20260812 00:06:13.913655 18801 fs_manager.cc:359] Metadata directory not provided
I20260812 00:06:13.913705 18801 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:06:13.913830 18801 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:06:13.914878 18801 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786492899949492-12089-0/minicluster-data/master-0/data/instance:
uuid: "53ef0209b0f34d84acede8a063fe7fb9"
format_stamp: "Formatted at 2026-08-12 00:06:13 on dist-test-slave-f0tn"
server_key: "229b0890a2fe495ca29065afa3778cfe"
server_key_iv: "e88d98b8981bcbc7ebe8de4ba7ca2d60"
server_key_version: "encryptionkey@0"
I20260812 00:06:13.915210 18801 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786492899949492-12089-0/minicluster-data/master-0/wal/instance:
uuid: "53ef0209b0f34d84acede8a063fe7fb9"
format_stamp: "Formatted at 2026-08-12 00:06:13 on dist-test-slave-f0tn"
server_key: "229b0890a2fe495ca29065afa3778cfe"
server_key_iv: "e88d98b8981bcbc7ebe8de4ba7ca2d60"
server_key_version: "encryptionkey@0"
I20260812 00:06:13.916437 18801 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 00:06:13.917074 18829 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:06:13.917224 18801 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 00:06:13.917320 18801 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786492899949492-12089-0/minicluster-data/master-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786492899949492-12089-0/minicluster-data/master-0/wal
uuid: "53ef0209b0f34d84acede8a063fe7fb9"
format_stamp: "Formatted at 2026-08-12 00:06:13 on dist-test-slave-f0tn"
server_key: "229b0890a2fe495ca29065afa3778cfe"
server_key_iv: "e88d98b8981bcbc7ebe8de4ba7ca2d60"
server_key_version: "encryptionkey@0"
I20260812 00:06:13.917402 18801 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786492899949492-12089-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786492899949492-12089-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786492899949492-12089-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:06:13.930183 18801 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:06:13.932253 18801 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:06:13.932390 18801 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:06:13.936168 18801 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.126:41135
I20260812 00:06:13.936209 18920 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.126:41135 every 8 connection(s)
I20260812 00:06:13.936545 18801 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
I20260812 00:06:13.937495 18921 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:06:13.939903 18921 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 53ef0209b0f34d84acede8a063fe7fb9: Bootstrap starting.
I20260812 00:06:13.940433 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 18801
I20260812 00:06:13.940568 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786492899949492-12089-0/minicluster-data/master-0/wal/instance
I20260812 00:06:13.940656 18921 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 53ef0209b0f34d84acede8a063fe7fb9: Neither blocks nor log segments found. Creating new log.
I20260812 00:06:13.940801 12089 external_mini_cluster.cc:1428] Setting key 08b122ba88d4637688ba4f85895da6d4
I20260812 00:06:13.940984 18921 log.cc:824] T 00000000000000000000000000000000 P 53ef0209b0f34d84acede8a063fe7fb9: Log is configured to *not* fsync() on all Append() calls
I20260812 00:06:13.941850 18921 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 53ef0209b0f34d84acede8a063fe7fb9: No bootstrap required, opened a new log
I20260812 00:06:13.944253 18921 raft_consensus.cc:348] T 00000000000000000000000000000000 P 53ef0209b0f34d84acede8a063fe7fb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "53ef0209b0f34d84acede8a063fe7fb9" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 41135 } }
I20260812 00:06:13.944393 18921 raft_consensus.cc:374] T 00000000000000000000000000000000 P 53ef0209b0f34d84acede8a063fe7fb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:06:13.944424 18921 raft_consensus.cc:729] T 00000000000000000000000000000000 P 53ef0209b0f34d84acede8a063fe7fb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53ef0209b0f34d84acede8a063fe7fb9, State: Initialized, Role: FOLLOWER
I20260812 00:06:13.944556 18921 consensus_queue.cc:260] T 00000000000000000000000000000000 P 53ef0209b0f34d84acede8a063fe7fb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "53ef0209b0f34d84acede8a063fe7fb9" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 41135 } }
I20260812 00:06:13.944628 18921 raft_consensus.cc:388] T 00000000000000000000000000000000 P 53ef0209b0f34d84acede8a063fe7fb9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:06:13.944657 18921 raft_consensus.cc:482] T 00000000000000000000000000000000 P 53ef0209b0f34d84acede8a063fe7fb9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:06:13.944705 18921 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 53ef0209b0f34d84acede8a063fe7fb9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:06:13.945415 18921 raft_consensus.cc:504] T 00000000000000000000000000000000 P 53ef0209b0f34d84acede8a063fe7fb9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "53ef0209b0f34d84acede8a063fe7fb9" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 41135 } }
I20260812 00:06:13.945528 18921 leader_election.cc:302] T 00000000000000000000000000000000 P 53ef0209b0f34d84acede8a063fe7fb9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 53ef0209b0f34d84acede8a063fe7fb9; no voters:
I20260812 00:06:13.945686 18921 leader_election.cc:288] T 00000000000000000000000000000000 P 53ef0209b0f34d84acede8a063fe7fb9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:06:13.945737 18931 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 53ef0209b0f34d84acede8a063fe7fb9 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:06:13.945923 18931 raft_consensus.cc:686] T 00000000000000000000000000000000 P 53ef0209b0f34d84acede8a063fe7fb9 [term 1 LEADER]: Becoming Leader. State: Replica: 53ef0209b0f34d84acede8a063fe7fb9, State: Running, Role: LEADER
I20260812 00:06:13.946020 18931 consensus_queue.cc:237] T 00000000000000000000000000000000 P 53ef0209b0f34d84acede8a063fe7fb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "53ef0209b0f34d84acede8a063fe7fb9" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 41135 } }
I20260812 00:06:13.946257 18921 sys_catalog.cc:564] T 00000000000000000000000000000000 P 53ef0209b0f34d84acede8a063fe7fb9 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:06:13.946861 18936 sys_catalog.cc:455] T 00000000000000000000000000000000 P 53ef0209b0f34d84acede8a063fe7fb9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 53ef0209b0f34d84acede8a063fe7fb9. Latest consensus state: current_term: 1 leader_uuid: "53ef0209b0f34d84acede8a063fe7fb9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "53ef0209b0f34d84acede8a063fe7fb9" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 41135 } } }
I20260812 00:06:13.946929 18936 sys_catalog.cc:458] T 00000000000000000000000000000000 P 53ef0209b0f34d84acede8a063fe7fb9 [sys.catalog]: This master's current role is: LEADER
I20260812 00:06:13.946671 18935 sys_catalog.cc:455] T 00000000000000000000000000000000 P 53ef0209b0f34d84acede8a063fe7fb9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "53ef0209b0f34d84acede8a063fe7fb9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "53ef0209b0f34d84acede8a063fe7fb9" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 41135 } } }
I20260812 00:06:13.947170 18929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:13.941286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35671 (local address 127.11.206.126:41135)
0812 00:06:13.941451 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:13.941460 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:13.941519 (+ 59us) server_negotiation.cc:407] Connection header received
0812 00:06:13.942145 (+ 626us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:13.942155 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:13.942230 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:13.942376 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:13.942598 (+ 222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:13.943975 (+ 1377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:13.944840 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:13.945477 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:13.945588 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:13.946282 (+ 694us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:06:13.946286 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:06:13.946286 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:06:13.946485 (+ 199us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:06:13.946525 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:06:13.946541 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:06:13.946607 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:13.946877 (+ 270us) server_negotiation.cc:299] Negotiation successful
0812 00:06:13.946948 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":67,"threads_started":1}
I20260812 00:06:13.947180 18935 sys_catalog.cc:458] T 00000000000000000000000000000000 P 53ef0209b0f34d84acede8a063fe7fb9 [sys.catalog]: This master's current role is: LEADER
I20260812 00:06:13.947180 18948 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:06:13.947754 18948 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:06:13.948102 12089 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:06:13.949576 18948 catalog_manager.cc:1347] Generated new cluster ID: e34f323740d5417b910481debdb58d2d
I20260812 00:06:13.949834 18948 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:06:13.952082 18929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:13.949635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58795 (local address 127.11.206.126:41135)
0812 00:06:13.949687 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:13.949689 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:13.949698 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:06:13.949716 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:13.949717 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:13.949727 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:13.949796 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:13.949940 (+ 144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:13.950395 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:13.951058 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:13.951268 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:13.951320 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:13.951879 (+ 559us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:06:13.951881 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:06:13.951881 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:06:13.951885 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:06:13.951899 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:06:13.951902 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:06:13.951945 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:13.951996 (+ 51us) server_negotiation.cc:299] Negotiation successful
0812 00:06:13.952015 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260812 00:06:13.967607 18948 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:06:13.968125 18948 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:06:13.971897 18948 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 53ef0209b0f34d84acede8a063fe7fb9: Generated new TSK 0
I20260812 00:06:13.972062 18948 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:06:13.978273 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 18801
2026-08-12T00:06:13Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1461 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786492899949492-12089-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:06:14 dist-test-slave-f0tn krb5kdc[18982](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:06:14 dist-test-slave-f0tn krb5kdc[18982](info): set up 2 sockets
Aug 12 00:06:14 dist-test-slave-f0tn krb5kdc[18982](info): commencing operation
krb5kdc: starting...
W20260812 00:06:15.160789 12089 mini_kdc.cc:121] Time spent starting KDC: real 1.156s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786492899949492-12089-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786492899949492-12089-0/krb5kdc/test-user.keytab.
Aug 12 00:06:15 dist-test-slave-f0tn krb5kdc[18982](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493175, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:06:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:06:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.206.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab.
Entry for principal kudu/127.11.206.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab.
I20260812 00:06:15.275527 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786492899949492-12089-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786492899949492-12089-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786492899949492-12089-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:40215
--webserver_interface=127.11.206.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab
--principal=kudu/127.11.206.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:33483
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.206.126:40215
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:06:15.358256 19010 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:06:15.358489 19010 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:06:15.358512 19010 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:06:15.359699 19010 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:06:15.359750 19010 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:06:15.359764 19010 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:06:15.359778 19010 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:06:15.359802 19010 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:06:15.361330 19010 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:33483
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786492899949492-12089-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786492899949492-12089-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.206.126:40215
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab
--principal=kudu/127.11.206.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:40215
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.206.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19010
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786492899949492-12089-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:06:15.361594 19010 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:06:15.361843 19010 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:06:15.366772 19022 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:06:15.366812 19027 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:06:15.366935 19010 server_base.cc:1034] running on GCE node
W20260812 00:06:15.366777 19021 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:06:15.367321 19010 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:06:15.367604 19010 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:06:15.368743 19010 hybrid_clock.cc:648] HybridClock initialized: now 1786493175368734 us; error 29 us; skew 500 ppm
Aug 12 00:06:15 dist-test-slave-f0tn krb5kdc[18982](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493175, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:06:15.371318 19010 init.cc:377] Logged in from keytab as kudu/127.11.206.126@KRBTEST.COM (short username kudu)
I20260812 00:06:15.371800 19010 webserver.cc:460] Webserver started at http://127.11.206.126:44175/ using document root <none> and password file <none>
I20260812 00:06:15.372030 19010 fs_manager.cc:359] Metadata directory not provided
I20260812 00:06:15.372079 19010 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:06:15.372211 19010 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:06:15.373291 19010 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786492899949492-12089-0/minicluster-data/master-0/data/instance:
uuid: "25777fab501747d9bd51e321fe53fdc9"
format_stamp: "Formatted at 2026-08-12 00:06:15 on dist-test-slave-f0tn"
server_key: "967f100d05adc27b9a20663c3b8e6657"
server_key_iv: "0cf5023691b979d5c9049cf8304c0719"
server_key_version: "encryptionkey@0"
I20260812 00:06:15.373705 19010 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786492899949492-12089-0/minicluster-data/master-0/wal/instance:
uuid: "25777fab501747d9bd51e321fe53fdc9"
format_stamp: "Formatted at 2026-08-12 00:06:15 on dist-test-slave-f0tn"
server_key: "967f100d05adc27b9a20663c3b8e6657"
server_key_iv: "0cf5023691b979d5c9049cf8304c0719"
server_key_version: "encryptionkey@0"
I20260812 00:06:15.375087 19010 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:06:15.375954 19039 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:06:15.376163 19010 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:06:15.376256 19010 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786492899949492-12089-0/minicluster-data/master-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786492899949492-12089-0/minicluster-data/master-0/wal
uuid: "25777fab501747d9bd51e321fe53fdc9"
format_stamp: "Formatted at 2026-08-12 00:06:15 on dist-test-slave-f0tn"
server_key: "967f100d05adc27b9a20663c3b8e6657"
server_key_iv: "0cf5023691b979d5c9049cf8304c0719"
server_key_version: "encryptionkey@0"
I20260812 00:06:15.376331 19010 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786492899949492-12089-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786492899949492-12089-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786492899949492-12089-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:06:15.379851 19010 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:06:15.382252 19010 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:06:15.382393 19010 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:06:15.386350 19010 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.126:40215
I20260812 00:06:15.386384 19128 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.126:40215 every 8 connection(s)
I20260812 00:06:15.386719 19010 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
I20260812 00:06:15.387707 19131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:06:15.390108 19131 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 25777fab501747d9bd51e321fe53fdc9: Bootstrap starting.
I20260812 00:06:15.390705 19131 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 25777fab501747d9bd51e321fe53fdc9: Neither blocks nor log segments found. Creating new log.
I20260812 00:06:15.390707 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 19010
I20260812 00:06:15.390784 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786492899949492-12089-0/minicluster-data/master-0/wal/instance
I20260812 00:06:15.390952 12089 external_mini_cluster.cc:1428] Setting key bc553a272f87e851b00a4c1611a44c7d
I20260812 00:06:15.390976 19131 log.cc:824] T 00000000000000000000000000000000 P 25777fab501747d9bd51e321fe53fdc9: Log is configured to *not* fsync() on all Append() calls
I20260812 00:06:15.391722 19131 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 25777fab501747d9bd51e321fe53fdc9: No bootstrap required, opened a new log
I20260812 00:06:15.393530 19137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:15.391465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58355 (local address 127.11.206.126:40215)
0812 00:06:15.391650 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:15.391661 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:15.391694 (+ 33us) server_negotiation.cc:407] Connection header received
0812 00:06:15.392206 (+ 512us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:15.392217 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:15.392254 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:15.392417 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:15.393041 (+ 624us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:06:15.393046 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:06:15.393046 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:06:15.393051 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:06:15.393097 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:06:15.393113 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:06:15.393219 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:15.393251 (+ 32us) server_negotiation.cc:299] Negotiation successful
0812 00:06:15.393293 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":80,"threads_started":1}
I20260812 00:06:15.394313 19131 raft_consensus.cc:348] T 00000000000000000000000000000000 P 25777fab501747d9bd51e321fe53fdc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25777fab501747d9bd51e321fe53fdc9" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 40215 } }
I20260812 00:06:15.394486 19131 raft_consensus.cc:374] T 00000000000000000000000000000000 P 25777fab501747d9bd51e321fe53fdc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:06:15.394536 19131 raft_consensus.cc:729] T 00000000000000000000000000000000 P 25777fab501747d9bd51e321fe53fdc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25777fab501747d9bd51e321fe53fdc9, State: Initialized, Role: FOLLOWER
I20260812 00:06:15.394599 12089 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:06:15.394659 19131 consensus_queue.cc:260] T 00000000000000000000000000000000 P 25777fab501747d9bd51e321fe53fdc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25777fab501747d9bd51e321fe53fdc9" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 40215 } }
I20260812 00:06:15.394749 19131 raft_consensus.cc:388] T 00000000000000000000000000000000 P 25777fab501747d9bd51e321fe53fdc9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:06:15.394784 19131 raft_consensus.cc:482] T 00000000000000000000000000000000 P 25777fab501747d9bd51e321fe53fdc9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:06:15.394829 19131 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 25777fab501747d9bd51e321fe53fdc9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:06:15.395558 19131 raft_consensus.cc:504] T 00000000000000000000000000000000 P 25777fab501747d9bd51e321fe53fdc9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25777fab501747d9bd51e321fe53fdc9" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 40215 } }
I20260812 00:06:15.395684 19131 leader_election.cc:302] T 00000000000000000000000000000000 P 25777fab501747d9bd51e321fe53fdc9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 25777fab501747d9bd51e321fe53fdc9; no voters:
I20260812 00:06:15.395856 19131 leader_election.cc:288] T 00000000000000000000000000000000 P 25777fab501747d9bd51e321fe53fdc9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:06:15.395885 19146 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 25777fab501747d9bd51e321fe53fdc9 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:06:15.396117 19146 raft_consensus.cc:686] T 00000000000000000000000000000000 P 25777fab501747d9bd51e321fe53fdc9 [term 1 LEADER]: Becoming Leader. State: Replica: 25777fab501747d9bd51e321fe53fdc9, State: Running, Role: LEADER
I20260812 00:06:15.396175 19131 sys_catalog.cc:564] T 00000000000000000000000000000000 P 25777fab501747d9bd51e321fe53fdc9 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:06:15.396250 19146 consensus_queue.cc:237] T 00000000000000000000000000000000 P 25777fab501747d9bd51e321fe53fdc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25777fab501747d9bd51e321fe53fdc9" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 40215 } }
I20260812 00:06:15.396662 19149 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25777fab501747d9bd51e321fe53fdc9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "25777fab501747d9bd51e321fe53fdc9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25777fab501747d9bd51e321fe53fdc9" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 40215 } } }
I20260812 00:06:15.396679 19150 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25777fab501747d9bd51e321fe53fdc9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 25777fab501747d9bd51e321fe53fdc9. Latest consensus state: current_term: 1 leader_uuid: "25777fab501747d9bd51e321fe53fdc9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25777fab501747d9bd51e321fe53fdc9" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 40215 } } }
I20260812 00:06:15.396791 19149 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25777fab501747d9bd51e321fe53fdc9 [sys.catalog]: This master's current role is: LEADER
I20260812 00:06:15.396801 19150 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25777fab501747d9bd51e321fe53fdc9 [sys.catalog]: This master's current role is: LEADER
I20260812 00:06:15.397013 19161 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:06:15.397656 19137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:15.396369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57291 (local address 127.11.206.126:40215)
0812 00:06:15.396403 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:15.396405 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:15.396556 (+ 151us) server_negotiation.cc:407] Connection header received
0812 00:06:15.396659 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:15.396661 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:15.396666 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:15.396695 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:15.397414 (+ 719us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:06:15.397415 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:06:15.397415 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:06:15.397420 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:06:15.397435 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:06:15.397439 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:06:15.397468 (+ 29us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:15.397585 (+ 117us) server_negotiation.cc:299] Negotiation successful
0812 00:06:15.397598 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260812 00:06:15.397712 19161 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:06:15.402992 19161 catalog_manager.cc:1347] Generated new cluster ID: 05ae6b19b4dc4748a3ed1e16d7cb4278
I20260812 00:06:15.403056 19161 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:06:15.415656 19161 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:06:15.415876 19161 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:06:15.422526 19161 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 25777fab501747d9bd51e321fe53fdc9: Generated new TSK 0
I20260812 00:06:15.422729 19161 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:06:15.429474 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 19010
2026-08-12T00:06:15Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1454 ms)
[----------] 18 tests from AuthTokenIssuingTest (26535 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492899949492-12089-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:06:15 dist-test-slave-f0tn krb5kdc[19188](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:06:15 dist-test-slave-f0tn krb5kdc[19188](info): set up 2 sockets
Aug 12 00:06:15 dist-test-slave-f0tn krb5kdc[19188](info): commencing operation
krb5kdc: starting...
W20260812 00:06:16.618058 12089 mini_kdc.cc:121] Time spent starting KDC: real 1.159s user 0.003s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492899949492-12089-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492899949492-12089-0/krb5kdc/test-user.keytab.
Aug 12 00:06:16 dist-test-slave-f0tn krb5kdc[19188](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493176, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:06:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:06:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.206.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab.
Entry for principal kudu/127.11.206.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab.
I20260812 00:06:16.736497 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492899949492-12089-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492899949492-12089-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492899949492-12089-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:46175
--webserver_interface=127.11.206.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab
--principal=kudu/127.11.206.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:43737
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.206.126:46175,127.11.206.125:37137,127.11.206.124:34403
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:06:16.820013 19216 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 00:06:16.820257 19216 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:06:16.820284 19216 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:06:16.820314 19216 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:06:16.821552 19216 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:06:16.821597 19216 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:06:16.821620 19216 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:06:16.821640 19216 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:06:16.821659 19216 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:06:16.823180 19216 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:43737
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492899949492-12089-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492899949492-12089-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.206.126:46175,127.11.206.125:37137,127.11.206.124:34403
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab
--principal=kudu/127.11.206.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:46175
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.206.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19216
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492899949492-12089-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:06:16.823431 19216 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:06:16.823661 19216 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:06:16.828454 19225 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:06:16.828501 19224 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:06:16.828492 19227 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:06:16.828622 19216 server_base.cc:1034] running on GCE node
I20260812 00:06:16.828852 19216 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:06:16.829128 19216 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:06:16.830258 19216 hybrid_clock.cc:648] HybridClock initialized: now 1786493176830245 us; error 30 us; skew 500 ppm
Aug 12 00:06:16 dist-test-slave-f0tn krb5kdc[19188](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493176, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:06:16.832661 19216 init.cc:377] Logged in from keytab as kudu/127.11.206.126@KRBTEST.COM (short username kudu)
I20260812 00:06:16.833106 19216 webserver.cc:460] Webserver started at http://127.11.206.126:42721/ using document root <none> and password file <none>
I20260812 00:06:16.833333 19216 fs_manager.cc:359] Metadata directory not provided
I20260812 00:06:16.833405 19216 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:06:16.833539 19216 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:06:16.834610 19216 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492899949492-12089-0/minicluster-data/master-0/data/instance:
uuid: "f5cae3bd41c644a28f0da59414acf756"
format_stamp: "Formatted at 2026-08-12 00:06:16 on dist-test-slave-f0tn"
server_key: "49fa3c02ef075586f847c4af4fcfed81"
server_key_iv: "2628a4b72d65850ed9cc3aa068e9d8b9"
server_key_version: "encryptionkey@0"
I20260812 00:06:16.834951 19216 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492899949492-12089-0/minicluster-data/master-0/wal/instance:
uuid: "f5cae3bd41c644a28f0da59414acf756"
format_stamp: "Formatted at 2026-08-12 00:06:16 on dist-test-slave-f0tn"
server_key: "49fa3c02ef075586f847c4af4fcfed81"
server_key_iv: "2628a4b72d65850ed9cc3aa068e9d8b9"
server_key_version: "encryptionkey@0"
I20260812 00:06:16.836294 19216 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:06:16.836939 19238 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:06:16.837090 19216 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:06:16.837177 19216 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492899949492-12089-0/minicluster-data/master-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492899949492-12089-0/minicluster-data/master-0/wal
uuid: "f5cae3bd41c644a28f0da59414acf756"
format_stamp: "Formatted at 2026-08-12 00:06:16 on dist-test-slave-f0tn"
server_key: "49fa3c02ef075586f847c4af4fcfed81"
server_key_iv: "2628a4b72d65850ed9cc3aa068e9d8b9"
server_key_version: "encryptionkey@0"
I20260812 00:06:16.837240 19216 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492899949492-12089-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492899949492-12089-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492899949492-12089-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:06:16.847883 19216 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:06:16.849710 19216 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:06:16.849844 19216 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:06:16.853701 19216 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.126:46175
I20260812 00:06:16.853734 19321 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.126:46175 every 8 connection(s)
I20260812 00:06:16.854061 19216 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
I20260812 00:06:16.854936 19322 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:06:16.856467 19322 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.206.126" port: 46175 } has no permanent_uuid. Determining permanent_uuid...
I20260812 00:06:16.861490 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 19216
I20260812 00:06:16.861580 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492899949492-12089-0/minicluster-data/master-0/wal/instance
I20260812 00:06:16.861763 12089 external_mini_cluster.cc:1428] Setting key 63d01628c52d7facd26dee8565e5c7ab
Aug 12 00:06:16 dist-test-slave-f0tn krb5kdc[19188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493176, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.126@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:06:16.866184 19327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:16.857134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59138 (local address 127.11.206.126:46175)
0812 00:06:16.857261 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:16.857271 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:16.857427 (+ 156us) server_negotiation.cc:407] Connection header received
0812 00:06:16.857971 (+ 544us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:16.857973 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:16.857990 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:16.858068 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:16.858674 (+ 606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:16.859496 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:16.860336 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:16.860638 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:16.860730 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:16.863016 (+ 2286us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:06:16.863024 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:06:16.863025 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:06:16.863032 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:06:16.864664 (+ 1632us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:16.865059 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:16.865062 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:16.865062 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:16.865135 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:16.865350 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:16.865350 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:16.865350 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:16.865576 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:06:16.865636 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:16.865864 (+ 228us) server_negotiation.cc:299] Negotiation successful
0812 00:06:16.865980 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99,"thread_start_us":70,"threads_started":1}
I20260812 00:06:16.866246 19326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:16.857078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:46175 (local address 127.0.0.1:59138)
0812 00:06:16.857246 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0812 00:06:16.857306 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0812 00:06:16.857814 (+ 508us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:06:16.858078 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:06:16.858080 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:06:16.858414 (+ 334us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:06:16.858577 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:06:16.858581 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:06:16.859581 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:06:16.859582 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:06:16.860247 (+ 665us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:06:16.860249 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:06:16.860708 (+ 459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:06:16.860709 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:06:16.860775 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:16.861252 (+ 477us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:06:16.861267 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:06:16.862909 (+ 1642us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:06:16.864740 (+ 1831us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:06:16.864747 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:06:16.864750 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:06:16.864990 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:06:16.865188 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:06:16.865188 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:06:16.865189 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:06:16.865294 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:06:16.865643 (+ 349us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:06:16.865651 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:06:16.865736 (+ 85us) client_negotiation.cc:769] Sending connection context
0812 00:06:16.865839 (+ 103us) client_negotiation.cc:240] Negotiation successful
0812 00:06:16.866050 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"mutex_wait_us":61,"thread_start_us":76,"threads_started":1}
I20260812 00:06:16.866937 19322 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.206.125" port: 37137 } has no permanent_uuid. Determining permanent_uuid...
I20260812 00:06:16.867261 19326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:16.867139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.125:37137 (local address 127.0.0.1:33466)
0812 00:06:16.867184 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0812 00:06:16.867236 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.125:37137: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260812 00:06:16.867398 19240 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.206.125:37137: connect: Connection refused (error 111)
I20260812 00:06:16.867789 19326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:16.867698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.125:37137 (local address 127.0.0.1:33478)
0812 00:06:16.867739 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0812 00:06:16.867767 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.125:37137: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260812 00:06:16.867884 19322 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.206.125:37137: Network error: Client connection negotiation failed: client connection to 127.11.206.125:37137: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.11.206.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.125@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.125.keytab.
Entry for principal kudu/127.11.206.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.125.keytab.
I20260812 00:06:16.885492 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492899949492-12089-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492899949492-12089-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492899949492-12089-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492899949492-12089-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.125:37137
--webserver_interface=127.11.206.125
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.125.keytab
--principal=kudu/127.11.206.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:43737
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.206.126:46175,127.11.206.125:37137,127.11.206.124:34403
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:06:16.917132 19322 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.206.125" port: 37137 } attempt: 1
I20260812 00:06:16.917701 19326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:16.917548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.125:37137 (local address 127.0.0.1:33486)
0812 00:06:16.917613 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0812 00:06:16.917663 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.125:37137: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260812 00:06:16.918100 19326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:16.917993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.125:37137 (local address 127.0.0.1:33500)
0812 00:06:16.918042 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0812 00:06:16.918071 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.125:37137: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260812 00:06:16.918202 19322 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.206.125:37137: Network error: Client connection negotiation failed: client connection to 127.11.206.125:37137: connect: Connection refused (error 111)
W20260812 00:06:16.968453 19332 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 00:06:16.968657 19332 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:06:16.968672 19332 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:06:16.968689 19332 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:06:16.969805 19332 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:06:16.969843 19332 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:06:16.969856 19332 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:06:16.969867 19332 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:06:16.969878 19332 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:06:16.971275 19332 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:43737
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492899949492-12089-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492899949492-12089-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.11.206.126:46175,127.11.206.125:37137,127.11.206.124:34403
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.125.keytab
--principal=kudu/127.11.206.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.125:37137
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492899949492-12089-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.11.206.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19332
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492899949492-12089-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:06:16.971462 19332 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:06:16.971629 19332 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:06:16.976435 19339 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:06:16.976475 19332 server_base.cc:1034] running on GCE node
W20260812 00:06:16.976408 19343 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:06:16.976421 19345 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:06:16.976864 19332 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:06:16.977124 19332 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:06:16.978272 19332 hybrid_clock.cc:648] HybridClock initialized: now 1786493176978247 us; error 32 us; skew 500 ppm
Aug 12 00:06:16 dist-test-slave-f0tn krb5kdc[19188](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493176, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:06:16.980557 19332 init.cc:377] Logged in from keytab as kudu/127.11.206.125@KRBTEST.COM (short username kudu)
I20260812 00:06:16.980952 19332 webserver.cc:460] Webserver started at http://127.11.206.125:37121/ using document root <none> and password file <none>
I20260812 00:06:16.981145 19332 fs_manager.cc:359] Metadata directory not provided
I20260812 00:06:16.981191 19332 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:06:16.981318 19332 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:06:16.982378 19332 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492899949492-12089-0/minicluster-data/master-1/data/instance:
uuid: "32c91eb7b663497bb5da7e65fb71ccad"
format_stamp: "Formatted at 2026-08-12 00:06:16 on dist-test-slave-f0tn"
server_key: "05447aadf18f6f3926361ceffa51720e"
server_key_iv: "8809eb753ad57877a1413e9fc4d93ab0"
server_key_version: "encryptionkey@0"
I20260812 00:06:16.982707 19332 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492899949492-12089-0/minicluster-data/master-1/wal/instance:
uuid: "32c91eb7b663497bb5da7e65fb71ccad"
format_stamp: "Formatted at 2026-08-12 00:06:16 on dist-test-slave-f0tn"
server_key: "05447aadf18f6f3926361ceffa51720e"
server_key_iv: "8809eb753ad57877a1413e9fc4d93ab0"
server_key_version: "encryptionkey@0"
I20260812 00:06:16.983914 19332 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 00:06:16.984571 19361 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:06:16.984719 19332 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:06:16.984802 19332 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492899949492-12089-0/minicluster-data/master-1/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492899949492-12089-0/minicluster-data/master-1/wal
uuid: "32c91eb7b663497bb5da7e65fb71ccad"
format_stamp: "Formatted at 2026-08-12 00:06:16 on dist-test-slave-f0tn"
server_key: "05447aadf18f6f3926361ceffa51720e"
server_key_iv: "8809eb753ad57877a1413e9fc4d93ab0"
server_key_version: "encryptionkey@0"
I20260812 00:06:16.984862 19332 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492899949492-12089-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492899949492-12089-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492899949492-12089-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:06:16.986341 19322 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.206.125" port: 37137 } attempt: 2
I20260812 00:06:16.986713 19326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:16.986573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.125:37137 (local address 127.0.0.1:33514)
0812 00:06:16.986636 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0812 00:06:16.986676 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.125:37137: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260812 00:06:16.987083 19326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:16.986989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.125:37137 (local address 127.0.0.1:33520)
0812 00:06:16.987028 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0812 00:06:16.987057 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.125:37137: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260812 00:06:16.987226 19322 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.206.125:37137: Network error: Client connection negotiation failed: client connection to 127.11.206.125:37137: connect: Connection refused (error 111)
I20260812 00:06:17.006618 19332 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:06:17.008412 19332 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:06:17.008544 19332 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:06:17.012360 19332 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.125:37137
I20260812 00:06:17.012408 19450 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.125:37137 every 8 connection(s)
I20260812 00:06:17.012727 19332 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492899949492-12089-0/minicluster-data/master-1/data/info.pb
I20260812 00:06:17.013612 19452 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:06:17.015131 19452 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.206.126" port: 46175 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 00:06:17 dist-test-slave-f0tn krb5kdc[19188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493176, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.125@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:06:17.020478 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 19332
I20260812 00:06:17.020566 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492899949492-12089-0/minicluster-data/master-1/wal/instance
I20260812 00:06:17.020789 12089 external_mini_cluster.cc:1428] Setting key 2f6e5087dba545130c1c36c5d07b5824
I20260812 00:06:17.023381 19327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:17.015783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59144 (local address 127.11.206.126:46175)
0812 00:06:17.015832 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:17.015834 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:17.016021 (+ 187us) server_negotiation.cc:407] Connection header received
0812 00:06:17.016470 (+ 449us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:17.016471 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:17.016480 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:17.016533 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:17.017077 (+ 544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:17.017605 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:17.018529 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:17.018712 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:17.018753 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:17.020808 (+ 2055us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:06:17.020809 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:06:17.020809 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:06:17.020816 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:06:17.022104 (+ 1288us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:17.022526 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:17.022527 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:17.022527 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:17.022593 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:17.022790 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:17.022791 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:17.022791 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:17.022924 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:06:17.022980 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:17.023199 (+ 219us) server_negotiation.cc:299] Negotiation successful
0812 00:06:17.023291 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260812 00:06:17.023458 19456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:17.015747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:46175 (local address 127.0.0.1:59144)
0812 00:06:17.015912 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0812 00:06:17.015954 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 00:06:17.016396 (+ 442us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:06:17.016590 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:06:17.016592 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:06:17.016827 (+ 235us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:06:17.017015 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:06:17.017019 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:06:17.017666 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:06:17.017668 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:06:17.018465 (+ 797us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:06:17.018468 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:06:17.018761 (+ 293us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:06:17.018762 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:06:17.018861 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:17.019284 (+ 423us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:06:17.019292 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:06:17.020695 (+ 1403us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:06:17.022192 (+ 1497us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:06:17.022201 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:06:17.022203 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:06:17.022458 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:06:17.022651 (+ 193us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:06:17.022652 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:06:17.022652 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:06:17.022743 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:06:17.022978 (+ 235us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:06:17.022981 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:06:17.023090 (+ 109us) client_negotiation.cc:769] Sending connection context
0812 00:06:17.023164 (+ 74us) client_negotiation.cc:240] Negotiation successful
0812 00:06:17.023292 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":60,"threads_started":1}
I20260812 00:06:17.023943 19452 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.206.125" port: 37137 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 00:06:17 dist-test-slave-f0tn krb5kdc[19188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493176, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.125@KRBTEST.COM for kudu/127.11.206.125@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.206.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.124@KRBTEST.COM" created.
I20260812 00:06:17.030691 19456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:17.024165 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.125:37137 (local address 127.0.0.1:33528)
0812 00:06:17.024202 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0812 00:06:17.024212 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:06:17.024249 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:06:17.024476 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:06:17.024477 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:06:17.024603 (+ 126us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:06:17.024644 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:06:17.024645 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:06:17.025538 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:06:17.025539 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:06:17.026030 (+ 491us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:06:17.026031 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:06:17.026471 (+ 440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:06:17.026472 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:06:17.026534 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:17.026886 (+ 352us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:06:17.026891 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:06:17.028000 (+ 1109us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:06:17.029652 (+ 1652us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:06:17.029653 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:06:17.029653 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:06:17.029815 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:06:17.029989 (+ 174us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:06:17.029990 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:06:17.029990 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:06:17.030062 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:06:17.030373 (+ 311us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:06:17.030374 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:06:17.030411 (+ 37us) client_negotiation.cc:769] Sending connection context
0812 00:06:17.030472 (+ 61us) client_negotiation.cc:240] Negotiation successful
0812 00:06:17.030574 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22}
I20260812 00:06:17.030718 19459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:17.024234 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33528 (local address 127.11.206.125:37137)
0812 00:06:17.024361 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:17.024365 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:17.024380 (+ 15us) server_negotiation.cc:407] Connection header received
0812 00:06:17.024396 (+ 16us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:17.024398 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:17.024407 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:17.024465 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:17.024706 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:17.025455 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:17.026096 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:17.026407 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:17.026466 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:17.028073 (+ 1607us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:06:17.028081 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:06:17.028081 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:06:17.028087 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:06:17.029577 (+ 1490us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:17.029882 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:17.029885 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:17.029885 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:17.029936 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:17.030139 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:17.030139 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:17.030140 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:17.030310 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:06:17.030381 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:17.030551 (+ 170us) server_negotiation.cc:299] Negotiation successful
0812 00:06:17.030624 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":7,"server-negotiator.queue_time_us":101,"thread_start_us":78,"threads_started":1}
I20260812 00:06:17.031333 19452 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.206.124" port: 34403 } has no permanent_uuid. Determining permanent_uuid...
I20260812 00:06:17.031659 19456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:17.031538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.124:34403 (local address 127.0.0.1:41964)
0812 00:06:17.031579 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0812 00:06:17.031632 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.124:34403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
W20260812 00:06:17.031803 19362 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.206.124:34403: connect: Connection refused (error 111)
I20260812 00:06:17.032231 19456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:17.032137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.124:34403 (local address 127.0.0.1:41974)
0812 00:06:17.032177 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0812 00:06:17.032208 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.124:34403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260812 00:06:17.032375 19452 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.206.124:34403: Network error: Client connection negotiation failed: client connection to 127.11.206.124:34403: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.124.keytab.
Entry for principal kudu/127.11.206.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.124.keytab.
I20260812 00:06:17.043648 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492899949492-12089-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492899949492-12089-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492899949492-12089-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492899949492-12089-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.124:34403
--webserver_interface=127.11.206.124
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.124.keytab
--principal=kudu/127.11.206.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:43737
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.206.126:46175,127.11.206.125:37137,127.11.206.124:34403
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:06:17.078387 19322 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.206.125" port: 37137 } attempt: 3
I20260812 00:06:17.081598 19452 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.206.124" port: 34403 } attempt: 1
I20260812 00:06:17.082049 19456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:17.081907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.124:34403 (local address 127.0.0.1:41990)
0812 00:06:17.081966 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0812 00:06:17.082007 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.124:34403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260812 00:06:17.082425 19456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:17.082325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.124:34403 (local address 127.0.0.1:41994)
0812 00:06:17.082367 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0812 00:06:17.082399 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.124:34403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
Aug 12 00:06:17 dist-test-slave-f0tn krb5kdc[19188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493176, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.126@KRBTEST.COM for kudu/127.11.206.125@KRBTEST.COM
W20260812 00:06:17.082509 19452 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.206.124:34403: Network error: Client connection negotiation failed: client connection to 127.11.206.124:34403: connect: Connection refused (error 111)
I20260812 00:06:17.085278 19459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:17.078874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33530 (local address 127.11.206.125:37137)
0812 00:06:17.078944 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:17.078946 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:17.078954 (+ 8us) server_negotiation.cc:407] Connection header received
0812 00:06:17.078979 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:17.078980 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:17.078990 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:17.079035 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:17.079376 (+ 341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:17.079871 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:17.080565 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:17.080791 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:17.080848 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:17.082857 (+ 2009us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:06:17.082858 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:06:17.082859 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:06:17.082866 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:06:17.084162 (+ 1296us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:17.084535 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:17.084536 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:17.084537 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:17.084596 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:17.084840 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:17.084840 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:17.084841 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:17.084951 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:06:17.084999 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:17.085150 (+ 151us) server_negotiation.cc:299] Negotiation successful
0812 00:06:17.085211 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 00:06:17.085333 19326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:17.078757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.125:37137 (local address 127.0.0.1:33530)
0812 00:06:17.078829 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0812 00:06:17.078841 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 00:06:17.078885 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:06:17.079049 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:06:17.079050 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:06:17.079213 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:06:17.079293 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:06:17.079296 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:06:17.079948 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:06:17.079950 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:06:17.080484 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:06:17.080486 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:06:17.080857 (+ 371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:06:17.080858 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:06:17.080930 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:17.081349 (+ 419us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:06:17.081354 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:06:17.082777 (+ 1423us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:06:17.084241 (+ 1464us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:06:17.084242 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:06:17.084243 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:06:17.084452 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:06:17.084669 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:06:17.084670 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:06:17.084671 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:06:17.084768 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:06:17.085004 (+ 236us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:06:17.085005 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:06:17.085062 (+ 57us) client_negotiation.cc:769] Sending connection context
0812 00:06:17.085125 (+ 63us) client_negotiation.cc:240] Negotiation successful
0812 00:06:17.085239 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47}
I20260812 00:06:17.085770 19322 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.206.124" port: 34403 } has no permanent_uuid. Determining permanent_uuid...
I20260812 00:06:17.086092 19326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:17.085993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.124:34403 (local address 127.0.0.1:42008)
0812 00:06:17.086039 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0812 00:06:17.086071 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.124:34403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260812 00:06:17.086386 19326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:17.086311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.124:34403 (local address 127.0.0.1:42022)
0812 00:06:17.086346 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0812 00:06:17.086370 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.124:34403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260812 00:06:17.086473 19322 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.206.124:34403: Network error: Client connection negotiation failed: client connection to 127.11.206.124:34403: connect: Connection refused (error 111)
I20260812 00:06:17.117611 19322 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.206.124" port: 34403 } attempt: 1
I20260812 00:06:17.118139 19326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:17.117998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.124:34403 (local address 127.0.0.1:42032)
0812 00:06:17.118063 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0812 00:06:17.118106 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.124:34403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260812 00:06:17.118501 19326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:17.118404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.124:34403 (local address 127.0.0.1:42042)
0812 00:06:17.118451 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0812 00:06:17.118478 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.124:34403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260812 00:06:17.118597 19322 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.206.124:34403: Network error: Client connection negotiation failed: client connection to 127.11.206.124:34403: connect: Connection refused (error 111)
W20260812 00:06:17.126500 19465 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 00:06:17.126717 19465 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:06:17.126734 19465 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:06:17.126753 19465 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:06:17.127919 19465 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:06:17.127964 19465 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:06:17.127976 19465 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:06:17.127988 19465 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:06:17.128011 19465 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:06:17.129629 19465 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:43737
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492899949492-12089-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492899949492-12089-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.11.206.126:46175,127.11.206.125:37137,127.11.206.124:34403
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.124.keytab
--principal=kudu/127.11.206.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.124:34403
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492899949492-12089-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.11.206.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19465
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492899949492-12089-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:06:17.129889 19465 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:06:17.130110 19465 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:06:17.134919 19475 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:06:17.134959 19473 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:06:17.134929 19471 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:06:17.134964 19465 server_base.cc:1034] running on GCE node
I20260812 00:06:17.135309 19465 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:06:17.135600 19465 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:06:17.136739 19465 hybrid_clock.cc:648] HybridClock initialized: now 1786493177136725 us; error 30 us; skew 500 ppm
Aug 12 00:06:17 dist-test-slave-f0tn krb5kdc[19188](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493177, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:06:17.139289 19465 init.cc:377] Logged in from keytab as kudu/127.11.206.124@KRBTEST.COM (short username kudu)
I20260812 00:06:17.139780 19465 webserver.cc:460] Webserver started at http://127.11.206.124:33061/ using document root <none> and password file <none>
I20260812 00:06:17.140025 19465 fs_manager.cc:359] Metadata directory not provided
I20260812 00:06:17.140075 19465 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:06:17.140200 19465 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:06:17.141369 19465 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492899949492-12089-0/minicluster-data/master-2/data/instance:
uuid: "7476d3c8b43d46d6aa5ee24602ed193e"
format_stamp: "Formatted at 2026-08-12 00:06:17 on dist-test-slave-f0tn"
server_key: "c9aefba0c6d70f4b38c6f1e9b1ada126"
server_key_iv: "34a0e269a8817bd6487493272d0a62df"
server_key_version: "encryptionkey@0"
I20260812 00:06:17.141783 19465 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492899949492-12089-0/minicluster-data/master-2/wal/instance:
uuid: "7476d3c8b43d46d6aa5ee24602ed193e"
format_stamp: "Formatted at 2026-08-12 00:06:17 on dist-test-slave-f0tn"
server_key: "c9aefba0c6d70f4b38c6f1e9b1ada126"
server_key_iv: "34a0e269a8817bd6487493272d0a62df"
server_key_version: "encryptionkey@0"
I20260812 00:06:17.143061 19465 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 00:06:17.143739 19492 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:06:17.143895 19465 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:06:17.143985 19465 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492899949492-12089-0/minicluster-data/master-2/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492899949492-12089-0/minicluster-data/master-2/wal
uuid: "7476d3c8b43d46d6aa5ee24602ed193e"
format_stamp: "Formatted at 2026-08-12 00:06:17 on dist-test-slave-f0tn"
server_key: "c9aefba0c6d70f4b38c6f1e9b1ada126"
server_key_iv: "34a0e269a8817bd6487493272d0a62df"
server_key_version: "encryptionkey@0"
I20260812 00:06:17.144047 19465 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492899949492-12089-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492899949492-12089-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492899949492-12089-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:06:17.150631 19452 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.206.124" port: 34403 } attempt: 2
I20260812 00:06:17.151098 19456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:17.150950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.124:34403 (local address 127.0.0.1:42056)
0812 00:06:17.151009 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0812 00:06:17.151057 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.124:34403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260812 00:06:17.151417 19456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:17.151340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.124:34403 (local address 127.0.0.1:42062)
0812 00:06:17.151377 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0812 00:06:17.151399 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.124:34403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
W20260812 00:06:17.151499 19452 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.206.124:34403: Network error: Client connection negotiation failed: client connection to 127.11.206.124:34403: connect: Connection refused (error 111)
I20260812 00:06:17.155411 19465 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:06:17.157657 19465 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:06:17.157801 19465 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:06:17.161681 19465 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.124:34403
I20260812 00:06:17.161715 19566 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.124:34403 every 8 connection(s)
I20260812 00:06:17.162071 19465 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492899949492-12089-0/minicluster-data/master-2/data/info.pb
I20260812 00:06:17.162942 19567 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:06:17.164562 19567 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.206.126" port: 46175 } has no permanent_uuid. Determining permanent_uuid...
I20260812 00:06:17.168200 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 19465
I20260812 00:06:17.168295 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786492899949492-12089-0/minicluster-data/master-2/wal/instance
I20260812 00:06:17.168466 12089 external_mini_cluster.cc:1428] Setting key e384d18aecfd256112ecdbc39b878b0c
Aug 12 00:06:17 dist-test-slave-f0tn krb5kdc[19188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493177, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.124@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:06:17.173697 19327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:17.165249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59158 (local address 127.11.206.126:46175)
0812 00:06:17.165317 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:17.165320 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:17.165553 (+ 233us) server_negotiation.cc:407] Connection header received
0812 00:06:17.166057 (+ 504us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:17.166059 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:17.166071 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:17.166129 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:17.166770 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:17.167240 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:17.168202 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:17.168439 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:17.168499 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:17.171096 (+ 2597us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:06:17.171098 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:06:17.171098 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:06:17.171107 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:06:17.172412 (+ 1305us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:17.172795 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:17.172797 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:17.172797 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:17.172856 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:17.173066 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:17.173067 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:17.173067 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:17.173177 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:06:17.173232 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:17.173523 (+ 291us) server_negotiation.cc:299] Negotiation successful
0812 00:06:17.173608 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260812 00:06:17.173866 19571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:17.165204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:46175 (local address 127.0.0.1:59158)
0812 00:06:17.165430 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0812 00:06:17.165476 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 00:06:17.165960 (+ 484us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:06:17.166206 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:06:17.166210 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:06:17.166474 (+ 264us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:06:17.166675 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:06:17.166679 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:06:17.167328 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:06:17.167330 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:06:17.168118 (+ 788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:06:17.168121 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:06:17.168512 (+ 391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:06:17.168513 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:06:17.168640 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:17.169215 (+ 575us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:06:17.169226 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:06:17.171014 (+ 1788us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:06:17.172489 (+ 1475us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:06:17.172494 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:06:17.172495 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:06:17.172700 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:06:17.172910 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:06:17.172911 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:06:17.172912 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:06:17.173009 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:06:17.173232 (+ 223us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:06:17.173239 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:06:17.173362 (+ 123us) client_negotiation.cc:769] Sending connection context
0812 00:06:17.173479 (+ 117us) client_negotiation.cc:240] Negotiation successful
0812 00:06:17.173631 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":90,"threads_started":1}
Aug 12 00:06:17 dist-test-slave-f0tn krb5kdc[19188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493176, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.206.124@KRBTEST.COM
I20260812 00:06:17.174407 19567 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.206.125" port: 37137 } has no permanent_uuid. Determining permanent_uuid...
I20260812 00:06:17.178169 19578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:17.168897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42064 (local address 127.11.206.124:34403)
0812 00:06:17.169067 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:17.169072 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:17.169093 (+ 21us) server_negotiation.cc:407] Connection header received
0812 00:06:17.169139 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:17.169142 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:17.169164 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:17.169227 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:17.169975 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:17.171014 (+ 1039us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:17.171961 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:17.172266 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:17.172318 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:17.174909 (+ 2591us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:06:17.174918 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:06:17.174918 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:06:17.174925 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:06:17.177019 (+ 2094us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:17.177389 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:17.177392 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:17.177393 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:17.177459 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:17.177639 (+ 180us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:17.177640 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:17.177640 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:17.177781 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:06:17.177947 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:17.177992 (+ 45us) server_negotiation.cc:299] Negotiation successful
0812 00:06:17.178069 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":83,"threads_started":1}
Aug 12 00:06:17 dist-test-slave-f0tn krb5kdc[19188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493177, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.124@KRBTEST.COM for kudu/127.11.206.125@KRBTEST.COM
I20260812 00:06:17.181049 19459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:17.174717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33534 (local address 127.11.206.125:37137)
0812 00:06:17.174772 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:17.174774 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:17.174809 (+ 35us) server_negotiation.cc:407] Connection header received
0812 00:06:17.174891 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:17.174893 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:17.174902 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:17.174947 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:17.175300 (+ 353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:17.175935 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:17.176666 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:17.176887 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:17.176943 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:17.178649 (+ 1706us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:06:17.178651 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:06:17.178651 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:06:17.178659 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:06:17.180117 (+ 1458us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:17.180445 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:17.180446 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:17.180446 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:17.180495 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:17.180663 (+ 168us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:17.180663 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:17.180663 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:17.180756 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:06:17.180803 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:17.180934 (+ 131us) server_negotiation.cc:299] Negotiation successful
0812 00:06:17.180990 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 00:06:17.181083 19571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:17.174659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.125:37137 (local address 127.0.0.1:33534)
0812 00:06:17.174760 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0812 00:06:17.174770 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:06:17.174822 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:06:17.174968 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:06:17.174969 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:06:17.175159 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:06:17.175215 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:06:17.175217 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:06:17.176003 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:06:17.176004 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:06:17.176591 (+ 587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:06:17.176593 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:06:17.176948 (+ 355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:06:17.176949 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:06:17.177020 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:17.177342 (+ 322us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:06:17.177347 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:06:17.178549 (+ 1202us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:06:17.180201 (+ 1652us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:06:17.180201 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:06:17.180202 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:06:17.180382 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:06:17.180545 (+ 163us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:06:17.180545 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:06:17.180546 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:06:17.180608 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:06:17.180807 (+ 199us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:06:17.180807 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:06:17.180847 (+ 40us) client_negotiation.cc:769] Sending connection context
0812 00:06:17.180914 (+ 67us) client_negotiation.cc:240] Negotiation successful
0812 00:06:17.180996 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":84}
I20260812 00:06:17.181430 19567 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.206.124" port: 34403 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 00:06:17 dist-test-slave-f0tn krb5kdc[19188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493176, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
Aug 12 00:06:17 dist-test-slave-f0tn krb5kdc[19188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493177, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.124@KRBTEST.COM for kudu/127.11.206.124@KRBTEST.COM
I20260812 00:06:17.186647 19327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:17.178946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59160 (local address 127.11.206.126:46175)
0812 00:06:17.178982 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:17.178983 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:17.178992 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:06:17.179035 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:17.179036 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:17.179044 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:17.179088 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:17.179579 (+ 491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:17.180286 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:17.181185 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:17.181467 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:17.181504 (+ 37us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:17.183523 (+ 2019us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:06:17.183525 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:06:17.183525 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:06:17.183531 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:06:17.185064 (+ 1533us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:17.185506 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:17.185507 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:17.185507 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:17.185567 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:17.185795 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:17.185796 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:17.185796 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:17.185897 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:06:17.186484 (+ 587us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:17.186519 (+ 35us) server_negotiation.cc:299] Negotiation successful
0812 00:06:17.186583 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260812 00:06:17.187582 19571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:17.181660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.124:34403 (local address 127.0.0.1:42066)
0812 00:06:17.181758 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0812 00:06:17.181767 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:06:17.181815 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:06:17.182025 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:06:17.182026 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:06:17.182155 (+ 129us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:06:17.182191 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:06:17.182192 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:06:17.182772 (+ 580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:06:17.182773 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:06:17.183234 (+ 461us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:06:17.183235 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:06:17.183539 (+ 304us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:06:17.183539 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:06:17.183586 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:17.183954 (+ 368us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:06:17.183958 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:06:17.185188 (+ 1230us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:06:17.186675 (+ 1487us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:06:17.186676 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:06:17.186677 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:06:17.186850 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:06:17.187028 (+ 178us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:06:17.187029 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:06:17.187029 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:06:17.187094 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:06:17.187324 (+ 230us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:06:17.187325 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:06:17.187371 (+ 46us) client_negotiation.cc:769] Sending connection context
0812 00:06:17.187433 (+ 62us) client_negotiation.cc:240] Negotiation successful
0812 00:06:17.187525 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":85}
I20260812 00:06:17.187788 19578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:17.181718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42066 (local address 127.11.206.124:34403)
0812 00:06:17.181932 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:17.181934 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:17.181940 (+ 6us) server_negotiation.cc:407] Connection header received
0812 00:06:17.181955 (+ 15us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:17.181956 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:17.181964 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:17.182003 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:17.182267 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:17.182696 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:17.183297 (+ 601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:17.183485 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:17.183535 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:17.185261 (+ 1726us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:06:17.185263 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:06:17.185263 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:06:17.185270 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:06:17.186600 (+ 1330us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:17.186917 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:17.186918 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:17.186918 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:17.186973 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:17.187160 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:17.187160 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:17.187161 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:17.187259 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:06:17.187319 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:17.187465 (+ 146us) server_negotiation.cc:299] Negotiation successful
0812 00:06:17.187616 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":40,"server-negotiator.queue_time_us":197}
I20260812 00:06:17.189401 19567 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7476d3c8b43d46d6aa5ee24602ed193e: Bootstrap starting.
I20260812 00:06:17.190418 19567 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7476d3c8b43d46d6aa5ee24602ed193e: Neither blocks nor log segments found. Creating new log.
I20260812 00:06:17.190755 19567 log.cc:824] T 00000000000000000000000000000000 P 7476d3c8b43d46d6aa5ee24602ed193e: Log is configured to *not* fsync() on all Append() calls
Aug 12 00:06:17 dist-test-slave-f0tn krb5kdc[19188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493176, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.206.125@KRBTEST.COM
I20260812 00:06:17.191563 19567 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7476d3c8b43d46d6aa5ee24602ed193e: No bootstrap required, opened a new log
I20260812 00:06:17.193181 19567 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7476d3c8b43d46d6aa5ee24602ed193e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5cae3bd41c644a28f0da59414acf756" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 46175 } } peers { permanent_uuid: "32c91eb7b663497bb5da7e65fb71ccad" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 37137 } } peers { permanent_uuid: "7476d3c8b43d46d6aa5ee24602ed193e" member_type: VOTER last_known_addr { host: "127.11.206.124" port: 34403 } }
I20260812 00:06:17.193316 19567 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7476d3c8b43d46d6aa5ee24602ed193e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7476d3c8b43d46d6aa5ee24602ed193e, State: Initialized, Role: FOLLOWER
I20260812 00:06:17.193423 19567 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7476d3c8b43d46d6aa5ee24602ed193e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5cae3bd41c644a28f0da59414acf756" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 46175 } } peers { permanent_uuid: "32c91eb7b663497bb5da7e65fb71ccad" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 37137 } } peers { permanent_uuid: "7476d3c8b43d46d6aa5ee24602ed193e" member_type: VOTER last_known_addr { host: "127.11.206.124" port: 34403 } }
I20260812 00:06:17.193747 19567 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7476d3c8b43d46d6aa5ee24602ed193e [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:06:17.193717 19322 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.206.124" port: 34403 } attempt: 2
I20260812 00:06:17.193717 19581 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7476d3c8b43d46d6aa5ee24602ed193e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5cae3bd41c644a28f0da59414acf756" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 46175 } } peers { permanent_uuid: "32c91eb7b663497bb5da7e65fb71ccad" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 37137 } } peers { permanent_uuid: "7476d3c8b43d46d6aa5ee24602ed193e" member_type: VOTER last_known_addr { host: "127.11.206.124" port: 34403 } } }
I20260812 00:06:17.193912 19581 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7476d3c8b43d46d6aa5ee24602ed193e [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:06:17.194527 19459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:17.187304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33548 (local address 127.11.206.125:37137)
0812 00:06:17.187339 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:17.187340 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:17.187350 (+ 10us) server_negotiation.cc:407] Connection header received
0812 00:06:17.187370 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:17.187371 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:17.187379 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:17.187432 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:17.187993 (+ 561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:17.188531 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:17.189357 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:17.189630 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:17.189682 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:17.191978 (+ 2296us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:06:17.191980 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:06:17.191981 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:06:17.191988 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:06:17.193202 (+ 1214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:17.193547 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:17.193548 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:17.193548 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:17.193603 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:17.193843 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:17.193844 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:17.193844 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:17.193976 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:06:17.194123 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:17.194371 (+ 248us) server_negotiation.cc:299] Negotiation successful
0812 00:06:17.194442 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
W20260812 00:06:17.195708 19598 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7476d3c8b43d46d6aa5ee24602ed193e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 00:06:17.195807 19598 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
Aug 12 00:06:17 dist-test-slave-f0tn krb5kdc[19188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493176, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.126@KRBTEST.COM for kudu/127.11.206.124@KRBTEST.COM
I20260812 00:06:17.195966 19465 master_runner.cc:186] Error getting master registration for 127.11.206.126:46175: OK, instance_id { permanent_uuid: "f5cae3bd41c644a28f0da59414acf756" instance_seqno: 1786493176852622 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 00:06:17.198654 19465 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 00:06:17.199400 12089 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:06:17.200325 19279 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "f5cae3bd41c644a28f0da59414acf756"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59160
I20260812 00:06:17.201702 19326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:17.193944 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.124:34403 (local address 127.0.0.1:42080)
0812 00:06:17.194031 (+ 87us) negotiation.cc:107] Waiting for socket to connect
0812 00:06:17.194041 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:06:17.194078 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:06:17.194265 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:06:17.194266 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:06:17.194423 (+ 157us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:06:17.194486 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:06:17.194488 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:06:17.195335 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:06:17.195337 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:06:17.196069 (+ 732us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:06:17.196072 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:06:17.196516 (+ 444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:06:17.196517 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:06:17.196585 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:17.196996 (+ 411us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:06:17.197001 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:06:17.198621 (+ 1620us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:06:17.200502 (+ 1881us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:06:17.200502 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:06:17.200503 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:06:17.200784 (+ 281us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:06:17.200984 (+ 200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:06:17.200985 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:06:17.200985 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:06:17.201052 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:06:17.201355 (+ 303us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:06:17.201356 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:06:17.201428 (+ 72us) client_negotiation.cc:769] Sending connection context
0812 00:06:17.201503 (+ 75us) client_negotiation.cc:240] Negotiation successful
0812 00:06:17.201605 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":71}
I20260812 00:06:17.201709 19578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:17.194128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42080 (local address 127.11.206.124:34403)
0812 00:06:17.194176 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:17.194178 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:17.194185 (+ 7us) server_negotiation.cc:407] Connection header received
0812 00:06:17.194200 (+ 15us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:17.194201 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:17.194208 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:17.194249 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:17.194569 (+ 320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:17.195239 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:17.196165 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:17.196438 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:17.196495 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:17.198728 (+ 2233us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:06:17.198729 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:06:17.198730 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:06:17.198737 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:06:17.200410 (+ 1673us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:17.200855 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:17.200856 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:17.200857 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:17.200920 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:17.201114 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:17.201115 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:17.201115 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:17.201280 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:06:17.201355 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:17.201537 (+ 182us) server_negotiation.cc:299] Negotiation successful
0812 00:06:17.201622 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260812 00:06:17.203306 19322 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f5cae3bd41c644a28f0da59414acf756: Bootstrap starting.
I20260812 00:06:17.204106 19322 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f5cae3bd41c644a28f0da59414acf756: Neither blocks nor log segments found. Creating new log.
I20260812 00:06:17.204492 19322 log.cc:824] T 00000000000000000000000000000000 P f5cae3bd41c644a28f0da59414acf756: Log is configured to *not* fsync() on all Append() calls
I20260812 00:06:17.205461 19322 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f5cae3bd41c644a28f0da59414acf756: No bootstrap required, opened a new log
I20260812 00:06:17.206817 19322 raft_consensus.cc:348] T 00000000000000000000000000000000 P f5cae3bd41c644a28f0da59414acf756 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5cae3bd41c644a28f0da59414acf756" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 46175 } } peers { permanent_uuid: "32c91eb7b663497bb5da7e65fb71ccad" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 37137 } } peers { permanent_uuid: "7476d3c8b43d46d6aa5ee24602ed193e" member_type: VOTER last_known_addr { host: "127.11.206.124" port: 34403 } }
I20260812 00:06:17.206965 19322 raft_consensus.cc:729] T 00000000000000000000000000000000 P f5cae3bd41c644a28f0da59414acf756 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5cae3bd41c644a28f0da59414acf756, State: Initialized, Role: FOLLOWER
I20260812 00:06:17.207048 19322 consensus_queue.cc:260] T 00000000000000000000000000000000 P f5cae3bd41c644a28f0da59414acf756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5cae3bd41c644a28f0da59414acf756" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 46175 } } peers { permanent_uuid: "32c91eb7b663497bb5da7e65fb71ccad" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 37137 } } peers { permanent_uuid: "7476d3c8b43d46d6aa5ee24602ed193e" member_type: VOTER last_known_addr { host: "127.11.206.124" port: 34403 } }
I20260812 00:06:17.207382 19322 sys_catalog.cc:564] T 00000000000000000000000000000000 P f5cae3bd41c644a28f0da59414acf756 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:06:17.207455 19279 raft_consensus.cc:482] T 00000000000000000000000000000000 P f5cae3bd41c644a28f0da59414acf756 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 00:06:17.207496 19279 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f5cae3bd41c644a28f0da59414acf756 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:06:17.208321 19279 raft_consensus.cc:504] T 00000000000000000000000000000000 P f5cae3bd41c644a28f0da59414acf756 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5cae3bd41c644a28f0da59414acf756" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 46175 } } peers { permanent_uuid: "32c91eb7b663497bb5da7e65fb71ccad" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 37137 } } peers { permanent_uuid: "7476d3c8b43d46d6aa5ee24602ed193e" member_type: VOTER last_known_addr { host: "127.11.206.124" port: 34403 } }
I20260812 00:06:17.208580 19279 leader_election.cc:288] T 00000000000000000000000000000000 P f5cae3bd41c644a28f0da59414acf756 [CANDIDATE]: Term 1 election: Requested vote from peers 32c91eb7b663497bb5da7e65fb71ccad (127.11.206.125:37137), 7476d3c8b43d46d6aa5ee24602ed193e (127.11.206.124:34403)
I20260812 00:06:17.209172 19528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f5cae3bd41c644a28f0da59414acf756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "7476d3c8b43d46d6aa5ee24602ed193e"
I20260812 00:06:17.209317 19528 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7476d3c8b43d46d6aa5ee24602ed193e [term 0 FOLLOWER]: Advancing to term 1
W20260812 00:06:17.209547 19622 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f5cae3bd41c644a28f0da59414acf756: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 00:06:17.209597 19622 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 00:06:17.210289 19528 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 7476d3c8b43d46d6aa5ee24602ed193e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5cae3bd41c644a28f0da59414acf756 in term 1.
I20260812 00:06:17.210503 19240 leader_election.cc:302] T 00000000000000000000000000000000 P f5cae3bd41c644a28f0da59414acf756 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7476d3c8b43d46d6aa5ee24602ed193e, f5cae3bd41c644a28f0da59414acf756; no voters:
I20260812 00:06:17.207345 19602 sys_catalog.cc:455] T 00000000000000000000000000000000 P f5cae3bd41c644a28f0da59414acf756 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5cae3bd41c644a28f0da59414acf756" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 46175 } } peers { permanent_uuid: "32c91eb7b663497bb5da7e65fb71ccad" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 37137 } } peers { permanent_uuid: "7476d3c8b43d46d6aa5ee24602ed193e" member_type: VOTER last_known_addr { host: "127.11.206.124" port: 34403 } } }
I20260812 00:06:17.211107 19602 sys_catalog.cc:458] T 00000000000000000000000000000000 P f5cae3bd41c644a28f0da59414acf756 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:06:17.211213 19602 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f5cae3bd41c644a28f0da59414acf756 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:06:17.211323 19602 raft_consensus.cc:686] T 00000000000000000000000000000000 P f5cae3bd41c644a28f0da59414acf756 [term 1 LEADER]: Becoming Leader. State: Replica: f5cae3bd41c644a28f0da59414acf756, State: Running, Role: LEADER
I20260812 00:06:17.211486 19602 consensus_queue.cc:237] T 00000000000000000000000000000000 P f5cae3bd41c644a28f0da59414acf756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5cae3bd41c644a28f0da59414acf756" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 46175 } } peers { permanent_uuid: "32c91eb7b663497bb5da7e65fb71ccad" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 37137 } } peers { permanent_uuid: "7476d3c8b43d46d6aa5ee24602ed193e" member_type: VOTER last_known_addr { host: "127.11.206.124" port: 34403 } }
I20260812 00:06:17.212023 19602 sys_catalog.cc:455] T 00000000000000000000000000000000 P f5cae3bd41c644a28f0da59414acf756 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f5cae3bd41c644a28f0da59414acf756. Latest consensus state: current_term: 1 leader_uuid: "f5cae3bd41c644a28f0da59414acf756" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5cae3bd41c644a28f0da59414acf756" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 46175 } } peers { permanent_uuid: "32c91eb7b663497bb5da7e65fb71ccad" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 37137 } } peers { permanent_uuid: "7476d3c8b43d46d6aa5ee24602ed193e" member_type: VOTER last_known_addr { host: "127.11.206.124" port: 34403 } } }
I20260812 00:06:17.212167 19602 sys_catalog.cc:458] T 00000000000000000000000000000000 P f5cae3bd41c644a28f0da59414acf756 [sys.catalog]: This master's current role is: LEADER
I20260812 00:06:17.210450 19216 master_runner.cc:186] Error getting master registration for 127.11.206.125:37137: OK, instance_id { permanent_uuid: "32c91eb7b663497bb5da7e65fb71ccad" instance_seqno: 1786493177011313 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 00:06:17.212790 19216 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 00:06:17.219602 19327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:17.210377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59176 (local address 127.11.206.126:46175)
0812 00:06:17.210424 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:17.210426 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:17.210853 (+ 427us) server_negotiation.cc:407] Connection header received
0812 00:06:17.210955 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:17.210957 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:17.210967 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:17.210996 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:17.211815 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:17.212464 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:17.213441 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:17.213641 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:17.213698 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:17.215187 (+ 1489us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:06:17.215189 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:06:17.215189 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:06:17.215196 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:06:17.216834 (+ 1638us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:17.217225 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:17.217226 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:17.217226 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:17.217301 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:17.217504 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:17.217505 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:17.217505 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:17.217655 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:06:17.219360 (+ 1705us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:17.219408 (+ 48us) server_negotiation.cc:299] Negotiation successful
0812 00:06:17.219498 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260812 00:06:17.225966 19578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:17.210910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42084 (local address 127.11.206.124:34403)
0812 00:06:17.210951 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:17.210952 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:17.217797 (+ 6845us) server_negotiation.cc:407] Connection header received
0812 00:06:17.218535 (+ 738us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:17.218537 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:17.218548 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:17.218577 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:17.219298 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:17.219999 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:17.221021 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:17.221298 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:17.221352 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:17.223078 (+ 1726us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:06:17.223080 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:06:17.223080 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:06:17.223089 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:06:17.224660 (+ 1571us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:17.225048 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:17.225050 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:17.225050 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:17.225106 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:17.225304 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:17.225304 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:17.225305 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:17.225482 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:06:17.225554 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:17.225792 (+ 238us) server_negotiation.cc:299] Negotiation successful
0812 00:06:17.225866 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 00:06:17.226182 19635 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:06:17.226924 19635 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:06:17.227257 19459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:17.210174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33554 (local address 127.11.206.125:37137)
0812 00:06:17.210219 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:17.210221 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:17.217612 (+ 7391us) server_negotiation.cc:407] Connection header received
0812 00:06:17.217716 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:17.217717 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:17.217731 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:17.217780 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:17.218445 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:17.219171 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:17.220510 (+ 1339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:17.221244 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:17.221321 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:17.223445 (+ 2124us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:06:17.223446 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:06:17.223447 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:06:17.223454 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:06:17.225284 (+ 1830us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:17.225960 (+ 676us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:17.225961 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:17.225961 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:17.226034 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:17.226578 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:17.226594 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:17.226594 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:17.226730 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:06:17.226841 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:17.227092 (+ 251us) server_negotiation.cc:299] Negotiation successful
0812 00:06:17.227168 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 00:06:17.228746 19528 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7476d3c8b43d46d6aa5ee24602ed193e [term 1 FOLLOWER]: Refusing update from remote peer f5cae3bd41c644a28f0da59414acf756: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:06:17.229173 19602 consensus_queue.cc:1035] T 00000000000000000000000000000000 P f5cae3bd41c644a28f0da59414acf756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7476d3c8b43d46d6aa5ee24602ed193e" member_type: VOTER last_known_addr { host: "127.11.206.124" port: 34403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:06:17.230576 19581 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7476d3c8b43d46d6aa5ee24602ed193e [sys.catalog]: SysCatalogTable state changed. Reason: New leader f5cae3bd41c644a28f0da59414acf756. Latest consensus state: current_term: 1 leader_uuid: "f5cae3bd41c644a28f0da59414acf756" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5cae3bd41c644a28f0da59414acf756" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 46175 } } peers { permanent_uuid: "32c91eb7b663497bb5da7e65fb71ccad" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 37137 } } peers { permanent_uuid: "7476d3c8b43d46d6aa5ee24602ed193e" member_type: VOTER last_known_addr { host: "127.11.206.124" port: 34403 } } }
I20260812 00:06:17.230665 19581 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7476d3c8b43d46d6aa5ee24602ed193e [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:06:17.234565 19602 sys_catalog.cc:455] T 00000000000000000000000000000000 P f5cae3bd41c644a28f0da59414acf756 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f5cae3bd41c644a28f0da59414acf756" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5cae3bd41c644a28f0da59414acf756" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 46175 } } peers { permanent_uuid: "32c91eb7b663497bb5da7e65fb71ccad" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 37137 } } peers { permanent_uuid: "7476d3c8b43d46d6aa5ee24602ed193e" member_type: VOTER last_known_addr { host: "127.11.206.124" port: 34403 } } }
I20260812 00:06:17.234678 19602 sys_catalog.cc:458] T 00000000000000000000000000000000 P f5cae3bd41c644a28f0da59414acf756 [sys.catalog]: This master's current role is: LEADER
I20260812 00:06:17.235129 19635 catalog_manager.cc:1347] Generated new cluster ID: c612150895054099a04030ce3f2e28a6
I20260812 00:06:17.235190 19635 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:06:17.235158 19581 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7476d3c8b43d46d6aa5ee24602ed193e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f5cae3bd41c644a28f0da59414acf756" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5cae3bd41c644a28f0da59414acf756" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 46175 } } peers { permanent_uuid: "32c91eb7b663497bb5da7e65fb71ccad" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 37137 } } peers { permanent_uuid: "7476d3c8b43d46d6aa5ee24602ed193e" member_type: VOTER last_known_addr { host: "127.11.206.124" port: 34403 } } }
I20260812 00:06:17.235261 19581 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7476d3c8b43d46d6aa5ee24602ed193e [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:06:17.235473 19638 mvcc.cc:205] Tried to move back new op lower bound from 7317476053926227968 to 7317476053859360768. Current Snapshot: MvccSnapshot[applied={T|T < 7317476053926227968 or (T in {7317476053926227968})}]
I20260812 00:06:17.235675 19641 mvcc.cc:205] Tried to move back new op lower bound from 7317476053926227968 to 7317476053859360768. Current Snapshot: MvccSnapshot[applied={T|T < 7317476053926227968}]
I20260812 00:06:17.242614 19452 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.206.124" port: 34403 } attempt: 3
Aug 12 00:06:17 dist-test-slave-f0tn krb5kdc[19188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493176, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.125@KRBTEST.COM for kudu/127.11.206.124@KRBTEST.COM
I20260812 00:06:17.251426 19456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:17.242941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.124:34403 (local address 127.0.0.1:42086)
0812 00:06:17.242997 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0812 00:06:17.243010 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 00:06:17.243052 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:06:17.243201 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:06:17.243202 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:06:17.243399 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:06:17.243451 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:06:17.243453 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:06:17.244319 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:06:17.244320 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:06:17.245143 (+ 823us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:06:17.245145 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:06:17.245612 (+ 467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:06:17.245613 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:06:17.245678 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:17.246278 (+ 600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:06:17.246284 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:06:17.247978 (+ 1694us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:06:17.249814 (+ 1836us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:06:17.249815 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:06:17.249816 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:06:17.250043 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:06:17.250734 (+ 691us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:06:17.250736 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:06:17.250736 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:06:17.250818 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:06:17.251103 (+ 285us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:06:17.251104 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:06:17.251153 (+ 49us) client_negotiation.cc:769] Sending connection context
0812 00:06:17.251212 (+ 59us) client_negotiation.cc:240] Negotiation successful
0812 00:06:17.251320 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260812 00:06:17.251426 19578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:17.242983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42086 (local address 127.11.206.124:34403)
0812 00:06:17.243039 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:17.243040 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:17.243050 (+ 10us) server_negotiation.cc:407] Connection header received
0812 00:06:17.243122 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:17.243123 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:17.243132 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:17.243174 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:17.243507 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:17.244251 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:17.245223 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:17.245551 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:17.245611 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:17.248078 (+ 2467us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:06:17.248080 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:06:17.248080 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:06:17.248088 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:06:17.249749 (+ 1661us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:17.250104 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:17.250105 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:17.250105 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:17.250161 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:17.250891 (+ 730us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:17.250892 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:17.250893 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:17.251039 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:06:17.251096 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:17.251266 (+ 170us) server_negotiation.cc:299] Negotiation successful
0812 00:06:17.251335 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260812 00:06:17.253620 19452 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 32c91eb7b663497bb5da7e65fb71ccad: Bootstrap starting.
I20260812 00:06:17.254439 19452 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 32c91eb7b663497bb5da7e65fb71ccad: Neither blocks nor log segments found. Creating new log.
I20260812 00:06:17.254765 19452 log.cc:824] T 00000000000000000000000000000000 P 32c91eb7b663497bb5da7e65fb71ccad: Log is configured to *not* fsync() on all Append() calls
I20260812 00:06:17.255873 19452 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 32c91eb7b663497bb5da7e65fb71ccad: No bootstrap required, opened a new log
I20260812 00:06:17.256964 19635 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:06:17.257726 19635 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:06:17.257970 19452 raft_consensus.cc:348] T 00000000000000000000000000000000 P 32c91eb7b663497bb5da7e65fb71ccad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5cae3bd41c644a28f0da59414acf756" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 46175 } } peers { permanent_uuid: "32c91eb7b663497bb5da7e65fb71ccad" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 37137 } } peers { permanent_uuid: "7476d3c8b43d46d6aa5ee24602ed193e" member_type: VOTER last_known_addr { host: "127.11.206.124" port: 34403 } }
I20260812 00:06:17.258123 19452 raft_consensus.cc:729] T 00000000000000000000000000000000 P 32c91eb7b663497bb5da7e65fb71ccad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32c91eb7b663497bb5da7e65fb71ccad, State: Initialized, Role: FOLLOWER
I20260812 00:06:17.258206 19452 consensus_queue.cc:260] T 00000000000000000000000000000000 P 32c91eb7b663497bb5da7e65fb71ccad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5cae3bd41c644a28f0da59414acf756" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 46175 } } peers { permanent_uuid: "32c91eb7b663497bb5da7e65fb71ccad" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 37137 } } peers { permanent_uuid: "7476d3c8b43d46d6aa5ee24602ed193e" member_type: VOTER last_known_addr { host: "127.11.206.124" port: 34403 } }
I20260812 00:06:17.258551 19452 sys_catalog.cc:564] T 00000000000000000000000000000000 P 32c91eb7b663497bb5da7e65fb71ccad [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:06:17.258607 19404 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f5cae3bd41c644a28f0da59414acf756" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "32c91eb7b663497bb5da7e65fb71ccad"
I20260812 00:06:17.258682 19402 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 32c91eb7b663497bb5da7e65fb71ccad [term 0 FOLLOWER]: Advancing to term 1
W20260812 00:06:17.259155 19370 tablet.cc:2369] T 00000000000000000000000000000000 P 32c91eb7b663497bb5da7e65fb71ccad: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:06:17.259619 19402 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 32c91eb7b663497bb5da7e65fb71ccad [term 1 FOLLOWER]: Refusing update from remote peer f5cae3bd41c644a28f0da59414acf756: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:06:17.260528 19404 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 32c91eb7b663497bb5da7e65fb71ccad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5cae3bd41c644a28f0da59414acf756 in term 1.
I20260812 00:06:17.261348 19602 consensus_queue.cc:1035] T 00000000000000000000000000000000 P f5cae3bd41c644a28f0da59414acf756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32c91eb7b663497bb5da7e65fb71ccad" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 37137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 00:06:17.265213 19673 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 32c91eb7b663497bb5da7e65fb71ccad: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 00:06:17.265291 19673 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 00:06:17.265498 19649 sys_catalog.cc:455] T 00000000000000000000000000000000 P 32c91eb7b663497bb5da7e65fb71ccad [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f5cae3bd41c644a28f0da59414acf756" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5cae3bd41c644a28f0da59414acf756" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 46175 } } peers { permanent_uuid: "32c91eb7b663497bb5da7e65fb71ccad" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 37137 } } peers { permanent_uuid: "7476d3c8b43d46d6aa5ee24602ed193e" member_type: VOTER last_known_addr { host: "127.11.206.124" port: 34403 } } }
I20260812 00:06:17.265579 19649 sys_catalog.cc:458] T 00000000000000000000000000000000 P 32c91eb7b663497bb5da7e65fb71ccad [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:06:17.265630 19649 sys_catalog.cc:455] T 00000000000000000000000000000000 P 32c91eb7b663497bb5da7e65fb71ccad [sys.catalog]: SysCatalogTable state changed. Reason: New leader f5cae3bd41c644a28f0da59414acf756. Latest consensus state: current_term: 1 leader_uuid: "f5cae3bd41c644a28f0da59414acf756" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5cae3bd41c644a28f0da59414acf756" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 46175 } } peers { permanent_uuid: "32c91eb7b663497bb5da7e65fb71ccad" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 37137 } } peers { permanent_uuid: "7476d3c8b43d46d6aa5ee24602ed193e" member_type: VOTER last_known_addr { host: "127.11.206.124" port: 34403 } } }
I20260812 00:06:17.265676 19649 sys_catalog.cc:458] T 00000000000000000000000000000000 P 32c91eb7b663497bb5da7e65fb71ccad [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:06:17.265707 19649 sys_catalog.cc:455] T 00000000000000000000000000000000 P 32c91eb7b663497bb5da7e65fb71ccad [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f5cae3bd41c644a28f0da59414acf756" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5cae3bd41c644a28f0da59414acf756" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 46175 } } peers { permanent_uuid: "32c91eb7b663497bb5da7e65fb71ccad" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 37137 } } peers { permanent_uuid: "7476d3c8b43d46d6aa5ee24602ed193e" member_type: VOTER last_known_addr { host: "127.11.206.124" port: 34403 } } }
I20260812 00:06:17.265758 19649 sys_catalog.cc:458] T 00000000000000000000000000000000 P 32c91eb7b663497bb5da7e65fb71ccad [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:06:17.270449 19678 mvcc.cc:205] Tried to move back new op lower bound from 7317476054037704704 to 7317476053859360768. Current Snapshot: MvccSnapshot[applied={T|T < 7317476053926227968}]
I20260812 00:06:17.273701 19635 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f5cae3bd41c644a28f0da59414acf756: Generated new TSK 0
I20260812 00:06:17.273911 19635 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:06:17.277740 19629 sys_catalog.cc:455] T 00000000000000000000000000000000 P f5cae3bd41c644a28f0da59414acf756 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f5cae3bd41c644a28f0da59414acf756" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5cae3bd41c644a28f0da59414acf756" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 46175 } } peers { permanent_uuid: "32c91eb7b663497bb5da7e65fb71ccad" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 37137 } } peers { permanent_uuid: "7476d3c8b43d46d6aa5ee24602ed193e" member_type: VOTER last_known_addr { host: "127.11.206.124" port: 34403 } } }
I20260812 00:06:17.277886 19629 sys_catalog.cc:458] T 00000000000000000000000000000000 P f5cae3bd41c644a28f0da59414acf756 [sys.catalog]: This master's current role is: LEADER
W20260812 00:06:17.299401 19327 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:06:17.297696 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59190 (local address 127.11.206.126:46175)
0812 00:06:17.297745 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:17.297748 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:17.298696 (+ 948us) server_negotiation.cc:407] Connection header received
0812 00:06:17.298805 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:17.298807 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:17.298819 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:17.298849 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:17.299326 (+ 477us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59190: BlockingRecv error: recv got EOF from 127.0.0.1:59190 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
W20260812 00:06:17.300203 19459 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:06:17.298113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33566 (local address 127.11.206.125:37137)
0812 00:06:17.298154 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:17.298156 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:17.299681 (+ 1525us) server_negotiation.cc:407] Connection header received
0812 00:06:17.299779 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:17.299780 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:17.299791 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:17.299820 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:17.300139 (+ 319us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33566: BlockingRecv error: recv got EOF from 127.0.0.1:33566 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260812 00:06:17.300925 19578 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:06:17.298419 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42088 (local address 127.11.206.124:34403)
0812 00:06:17.298461 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:17.298463 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:17.300423 (+ 1960us) server_negotiation.cc:407] Connection header received
0812 00:06:17.300518 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:17.300519 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:17.300529 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:17.300557 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:17.300863 (+ 306us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42088: BlockingRecv error: recv got EOF from 127.0.0.1:42088 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260812 00:06:17.303282 19459 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:06:17.302540 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33568 (local address 127.11.206.125:37137)
0812 00:06:17.302589 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:17.302591 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:17.302778 (+ 187us) server_negotiation.cc:407] Connection header received
0812 00:06:17.302878 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:17.302879 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:17.302898 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:17.302925 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:17.303232 (+ 307us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33568: BlockingRecv error: recv got EOF from 127.0.0.1:33568 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260812 00:06:17.306416 19459 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:06:17.305659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33582 (local address 127.11.206.125:37137)
0812 00:06:17.305694 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:17.305696 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:17.305909 (+ 213us) server_negotiation.cc:407] Connection header received
0812 00:06:17.306002 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:17.306003 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:17.306014 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:17.306040 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:17.306365 (+ 325us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33582: BlockingRecv error: recv got EOF from 127.0.0.1:33582 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260812 00:06:17.310362 19459 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:06:17.309608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33598 (local address 127.11.206.125:37137)
0812 00:06:17.309646 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:17.309647 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:17.309857 (+ 210us) server_negotiation.cc:407] Connection header received
0812 00:06:17.309950 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:17.309951 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:17.309962 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:17.309989 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:17.310312 (+ 323us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33598: BlockingRecv error: recv got EOF from 127.0.0.1:33598 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260812 00:06:17.316532 19459 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:06:17.315677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33610 (local address 127.11.206.125:37137)
0812 00:06:17.315719 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:17.315721 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:17.315957 (+ 236us) server_negotiation.cc:407] Connection header received
0812 00:06:17.316048 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:17.316049 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:17.316061 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:17.316089 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:17.316462 (+ 373us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33610: BlockingRecv error: recv got EOF from 127.0.0.1:33610 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260812 00:06:17.327005 19459 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:06:17.326067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33624 (local address 127.11.206.125:37137)
0812 00:06:17.326113 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:17.326116 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:17.326382 (+ 266us) server_negotiation.cc:407] Connection header received
0812 00:06:17.326484 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:17.326486 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:17.326499 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:17.326529 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:17.326946 (+ 417us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33624: BlockingRecv error: recv got EOF from 127.0.0.1:33624 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260812 00:06:17.345484 19459 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:06:17.344462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33630 (local address 127.11.206.125:37137)
0812 00:06:17.344510 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:17.344512 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:17.344806 (+ 294us) server_negotiation.cc:407] Connection header received
0812 00:06:17.344913 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:17.344914 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:17.344927 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:17.344957 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:17.345369 (+ 412us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33630: BlockingRecv error: recv got EOF from 127.0.0.1:33630 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260812 00:06:17.379882 19459 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:06:17.378910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33642 (local address 127.11.206.125:37137)
0812 00:06:17.378955 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:17.378957 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:17.379220 (+ 263us) server_negotiation.cc:407] Connection header received
0812 00:06:17.379322 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:17.379324 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:17.379337 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:17.379365 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:17.379812 (+ 447us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33642: BlockingRecv error: recv got EOF from 127.0.0.1:33642 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260812 00:06:17.445940 19459 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:06:17.445203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33658 (local address 127.11.206.125:37137)
0812 00:06:17.445264 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:17.445266 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:17.445405 (+ 139us) server_negotiation.cc:407] Connection header received
0812 00:06:17.445482 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:17.445483 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:17.445493 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:17.445543 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:17.445877 (+ 334us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33658: BlockingRecv error: recv got EOF from 127.0.0.1:33658 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
W20260812 00:06:17.575681 19459 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:06:17.575071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33668 (local address 127.11.206.125:37137)
0812 00:06:17.575143 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:17.575145 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:17.575200 (+ 55us) server_negotiation.cc:407] Connection header received
0812 00:06:17.575250 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:17.575251 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:17.575262 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:17.575331 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:17.575618 (+ 287us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33668: BlockingRecv error: recv got EOF from 127.0.0.1:33668 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
W20260812 00:06:17.833556 19459 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:06:17.832907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33670 (local address 127.11.206.125:37137)
0812 00:06:17.832979 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:17.832981 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:17.832992 (+ 11us) server_negotiation.cc:407] Connection header received
0812 00:06:17.833061 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:17.833062 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:17.833074 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:17.833125 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:17.833490 (+ 365us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33670: BlockingRecv error: recv got EOF from 127.0.0.1:33670 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 00:06:18.196295 19598 catalog_manager.cc:1259] Loaded cluster ID: c612150895054099a04030ce3f2e28a6
I20260812 00:06:18.196372 19598 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 7476d3c8b43d46d6aa5ee24602ed193e: loading cluster ID for follower catalog manager: success
I20260812 00:06:18.197176 19598 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 7476d3c8b43d46d6aa5ee24602ed193e: acquiring CA information for follower catalog manager: success
I20260812 00:06:18.197525 19598 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 7476d3c8b43d46d6aa5ee24602ed193e: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 00:06:18.265746 19673 catalog_manager.cc:1259] Loaded cluster ID: c612150895054099a04030ce3f2e28a6
I20260812 00:06:18.265856 19673 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 32c91eb7b663497bb5da7e65fb71ccad: loading cluster ID for follower catalog manager: success
I20260812 00:06:18.266676 19673 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 32c91eb7b663497bb5da7e65fb71ccad: acquiring CA information for follower catalog manager: success
I20260812 00:06:18.266960 19673 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 32c91eb7b663497bb5da7e65fb71ccad: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 00:06:18.349066 19785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:18.346675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33680 (local address 127.11.206.125:37137)
0812 00:06:18.346789 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:18.346791 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:18.346882 (+ 91us) server_negotiation.cc:407] Connection header received
0812 00:06:18.346939 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:18.346940 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:18.346991 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:18.347066 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:06:18.347180 (+ 114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:18.347683 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:18.348422 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:18.348622 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:18.348668 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:18.348781 (+ 113us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:06:18.348890 (+ 109us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:06:18.348945 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:18.348960 (+ 15us) server_negotiation.cc:299] Negotiation successful
0812 00:06:18.348977 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87,"thread_start_us":59,"threads_started":1}
I20260812 00:06:18.352936 19798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:18.350880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42090 (local address 127.11.206.124:34403)
0812 00:06:18.350976 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:18.350977 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:18.351003 (+ 26us) server_negotiation.cc:407] Connection header received
0812 00:06:18.351037 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:18.351037 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:18.351072 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:18.351129 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:06:18.351197 (+ 68us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:18.351692 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:18.352355 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:18.352533 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:18.352572 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:18.352673 (+ 101us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:06:18.352776 (+ 103us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:06:18.352829 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:18.352841 (+ 12us) server_negotiation.cc:299] Negotiation successful
0812 00:06:18.352855 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77,"thread_start_us":55,"threads_started":1}
I20260812 00:06:18.357218 19798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:18.354764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42102 (local address 127.11.206.124:34403)
0812 00:06:18.354803 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:18.354805 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:18.354839 (+ 34us) server_negotiation.cc:407] Connection header received
0812 00:06:18.354898 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:18.354899 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:18.354908 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:18.354952 (+ 44us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:06:18.355046 (+ 94us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:18.355509 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:18.356396 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:18.356675 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:18.356732 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:18.356908 (+ 176us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:06:18.356940 (+ 32us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:06:18.356987 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:18.357130 (+ 143us) server_negotiation.cc:299] Negotiation successful
0812 00:06:18.357150 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 00:06:18.357357 19785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:18.354533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33692 (local address 127.11.206.125:37137)
0812 00:06:18.354571 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:18.354572 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:18.354677 (+ 105us) server_negotiation.cc:407] Connection header received
0812 00:06:18.354839 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:18.354840 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:18.354853 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:18.354878 (+ 25us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:06:18.355051 (+ 173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:18.355782 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:18.356640 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:18.356878 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:18.356935 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:18.357045 (+ 110us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:06:18.357074 (+ 29us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:06:18.357117 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:18.357263 (+ 146us) server_negotiation.cc:299] Negotiation successful
0812 00:06:18.357286 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 00:06:18.357760 19813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:18.354551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59192 (local address 127.11.206.126:46175)
0812 00:06:18.354782 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:18.354784 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:18.354791 (+ 7us) server_negotiation.cc:407] Connection header received
0812 00:06:18.354839 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:18.354840 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:18.354890 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:18.355096 (+ 206us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:06:18.355132 (+ 36us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:18.355866 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:18.356695 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:18.356973 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:18.357059 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:18.357218 (+ 159us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:06:18.357336 (+ 118us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:06:18.357419 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:18.357675 (+ 256us) server_negotiation.cc:299] Negotiation successful
0812 00:06:18.357697 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":196,"thread_start_us":52,"threads_started":1}
I20260812 00:06:18.359337 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 19216
I20260812 00:06:18.375247 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 19332
I20260812 00:06:18.389281 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 19465
2026-08-12T00:06:18Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (2957 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492899949492-12089-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:06:18 dist-test-slave-f0tn krb5kdc[19818](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:06:18 dist-test-slave-f0tn krb5kdc[19818](info): set up 2 sockets
Aug 12 00:06:18 dist-test-slave-f0tn krb5kdc[19818](info): commencing operation
krb5kdc: starting...
W20260812 00:06:19.579638 12089 mini_kdc.cc:121] Time spent starting KDC: real 1.163s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492899949492-12089-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492899949492-12089-0/krb5kdc/test-user.keytab.
Aug 12 00:06:19 dist-test-slave-f0tn krb5kdc[19818](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493179, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:06:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:06:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.206.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab.
Entry for principal kudu/127.11.206.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab.
I20260812 00:06:19.702535 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492899949492-12089-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492899949492-12089-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492899949492-12089-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:34711
--webserver_interface=127.11.206.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab
--principal=kudu/127.11.206.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:42899
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.206.126:34711,127.11.206.125:38479,127.11.206.124:42825
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:06:19.785305 19841 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 00:06:19.785542 19841 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:06:19.785559 19841 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:06:19.785578 19841 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:06:19.786698 19841 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:06:19.786736 19841 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:06:19.786748 19841 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:06:19.786759 19841 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:06:19.786770 19841 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:06:19.788210 19841 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:42899
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492899949492-12089-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492899949492-12089-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.206.126:34711,127.11.206.125:38479,127.11.206.124:42825
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.126.keytab
--principal=kudu/127.11.206.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.126:34711
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.206.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19841
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492899949492-12089-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:06:19.788411 19841 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:06:19.788591 19841 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:06:19.793434 19855 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:06:19.793448 19849 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:06:19.793457 19852 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:06:19.793591 19841 server_base.cc:1034] running on GCE node
I20260812 00:06:19.793875 19841 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:06:19.794149 19841 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:06:19.795295 19841 hybrid_clock.cc:648] HybridClock initialized: now 1786493179795280 us; error 27 us; skew 500 ppm
Aug 12 00:06:19 dist-test-slave-f0tn krb5kdc[19818](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493179, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:06:19.802136 19841 init.cc:377] Logged in from keytab as kudu/127.11.206.126@KRBTEST.COM (short username kudu)
I20260812 00:06:19.802556 19841 webserver.cc:460] Webserver started at http://127.11.206.126:33455/ using document root <none> and password file <none>
I20260812 00:06:19.802783 19841 fs_manager.cc:359] Metadata directory not provided
I20260812 00:06:19.802834 19841 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:06:19.802959 19841 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:06:19.804035 19841 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492899949492-12089-0/minicluster-data/master-0/data/instance:
uuid: "cab9159963b646eb87cefa7c8a552ff2"
format_stamp: "Formatted at 2026-08-12 00:06:19 on dist-test-slave-f0tn"
server_key: "a340f936a9dbb8ba7ee0026dbe795adf"
server_key_iv: "121ea8d396a9c9151ef6dd6e0552946d"
server_key_version: "encryptionkey@0"
I20260812 00:06:19.804378 19841 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492899949492-12089-0/minicluster-data/master-0/wal/instance:
uuid: "cab9159963b646eb87cefa7c8a552ff2"
format_stamp: "Formatted at 2026-08-12 00:06:19 on dist-test-slave-f0tn"
server_key: "a340f936a9dbb8ba7ee0026dbe795adf"
server_key_iv: "121ea8d396a9c9151ef6dd6e0552946d"
server_key_version: "encryptionkey@0"
I20260812 00:06:19.805680 19841 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:06:19.806377 19869 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:06:19.806535 19841 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 00:06:19.806620 19841 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492899949492-12089-0/minicluster-data/master-0/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492899949492-12089-0/minicluster-data/master-0/wal
uuid: "cab9159963b646eb87cefa7c8a552ff2"
format_stamp: "Formatted at 2026-08-12 00:06:19 on dist-test-slave-f0tn"
server_key: "a340f936a9dbb8ba7ee0026dbe795adf"
server_key_iv: "121ea8d396a9c9151ef6dd6e0552946d"
server_key_version: "encryptionkey@0"
I20260812 00:06:19.806685 19841 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492899949492-12089-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492899949492-12089-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492899949492-12089-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:06:19.816658 19841 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:06:19.818523 19841 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:06:19.818655 19841 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:06:19.822432 19841 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.126:34711
I20260812 00:06:19.822543 19970 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.126:34711 every 8 connection(s)
I20260812 00:06:19.822793 19841 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492899949492-12089-0/minicluster-data/master-0/data/info.pb
I20260812 00:06:19.823650 19971 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:06:19.825151 19971 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.206.126" port: 34711 } has no permanent_uuid. Determining permanent_uuid...
I20260812 00:06:19.827512 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 19841
I20260812 00:06:19.827612 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492899949492-12089-0/minicluster-data/master-0/wal/instance
I20260812 00:06:19.827792 12089 external_mini_cluster.cc:1428] Setting key 896ad31c83f1929054ca2847945370f5
Aug 12 00:06:19 dist-test-slave-f0tn krb5kdc[19818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493179, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.126@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:06:19.835201 19974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:19.825816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:34711 (local address 127.0.0.1:32792)
0812 00:06:19.825987 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0812 00:06:19.826024 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 00:06:19.826478 (+ 454us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:06:19.826735 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:06:19.826737 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:06:19.826978 (+ 241us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:06:19.827130 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:06:19.827133 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:06:19.828315 (+ 1182us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:06:19.828316 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:06:19.829285 (+ 969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:06:19.829288 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:06:19.829957 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:06:19.829958 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:06:19.830017 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:19.830540 (+ 523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:06:19.830549 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:06:19.832122 (+ 1573us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:06:19.833796 (+ 1674us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:06:19.833804 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:06:19.833806 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:06:19.833997 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:06:19.834210 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:06:19.834210 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:06:19.834211 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:06:19.834295 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:06:19.834627 (+ 332us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:06:19.834632 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:06:19.834699 (+ 67us) client_negotiation.cc:769] Sending connection context
0812 00:06:19.834780 (+ 81us) client_negotiation.cc:240] Negotiation successful
0812 00:06:19.835003 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"mutex_wait_us":83,"thread_start_us":91,"threads_started":1}
I20260812 00:06:19.835209 19975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:19.825851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32792 (local address 127.11.206.126:34711)
0812 00:06:19.826075 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:19.826079 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:19.826113 (+ 34us) server_negotiation.cc:407] Connection header received
0812 00:06:19.826624 (+ 511us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:19.826626 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:19.826643 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:19.826724 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:19.827245 (+ 521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:19.828221 (+ 976us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:19.829408 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:19.829871 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:19.829981 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:19.832209 (+ 2228us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:06:19.832216 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:06:19.832217 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:06:19.832224 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:06:19.833721 (+ 1497us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:19.834075 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:19.834077 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:19.834078 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:19.834152 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:19.834347 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:19.834348 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:19.834348 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:19.834565 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:06:19.834636 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:19.834820 (+ 184us) server_negotiation.cc:299] Negotiation successful
0812 00:06:19.834929 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":191,"thread_start_us":73,"threads_started":1}
WARNING: no policy specified for kudu/127.11.206.125@KRBTEST.COM; defaulting to no policy
I20260812 00:06:19.835933 19971 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.206.125" port: 38479 } has no permanent_uuid. Determining permanent_uuid...
I20260812 00:06:19.836341 19974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:19.836220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.125:38479 (local address 127.0.0.1:42004)
0812 00:06:19.836267 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0812 00:06:19.836316 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.125:38479: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260812 00:06:19.836485 19872 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.206.125:38479: connect: Connection refused (error 111)
I20260812 00:06:19.836870 19974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:19.836802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.125:38479 (local address 127.0.0.1:42010)
0812 00:06:19.836827 (+ 25us) negotiation.cc:107] Waiting for socket to connect
0812 00:06:19.836853 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.125:38479: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":13}
W20260812 00:06:19.837045 19971 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.206.125:38479: Network error: Client connection negotiation failed: client connection to 127.11.206.125:38479: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.125@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.125.keytab.
Entry for principal kudu/127.11.206.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.125.keytab.
I20260812 00:06:19.852113 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492899949492-12089-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492899949492-12089-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492899949492-12089-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492899949492-12089-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.125:38479
--webserver_interface=127.11.206.125
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.125.keytab
--principal=kudu/127.11.206.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:42899
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.206.126:34711,127.11.206.125:38479,127.11.206.124:42825
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:06:19.886281 19971 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.206.125" port: 38479 } attempt: 1
I20260812 00:06:19.886801 19974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:19.886662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.125:38479 (local address 127.0.0.1:42022)
0812 00:06:19.886726 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0812 00:06:19.886770 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.125:38479: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260812 00:06:19.887207 19974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:19.887068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.125:38479 (local address 127.0.0.1:42030)
0812 00:06:19.887132 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0812 00:06:19.887177 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.125:38479: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260812 00:06:19.887317 19971 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.206.125:38479: Network error: Client connection negotiation failed: client connection to 127.11.206.125:38479: connect: Connection refused (error 111)
W20260812 00:06:19.933653 19982 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 00:06:19.933871 19982 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:06:19.933887 19982 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:06:19.933905 19982 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:06:19.935061 19982 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:06:19.935109 19982 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:06:19.935122 19982 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:06:19.935133 19982 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:06:19.935144 19982 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:06:19.936632 19982 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:42899
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492899949492-12089-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492899949492-12089-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.11.206.126:34711,127.11.206.125:38479,127.11.206.124:42825
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.125.keytab
--principal=kudu/127.11.206.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.125:38479
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492899949492-12089-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.11.206.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19982
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492899949492-12089-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:06:19.936896 19982 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:06:19.937116 19982 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 00:06:19.941958 19982 server_base.cc:1034] running on GCE node
W20260812 00:06:19.941928 19988 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:06:19.941910 19996 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:06:19.941978 19992 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:06:19.942303 19982 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:06:19.942597 19982 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:06:19.943742 19982 hybrid_clock.cc:648] HybridClock initialized: now 1786493179943724 us; error 34 us; skew 500 ppm
Aug 12 00:06:19 dist-test-slave-f0tn krb5kdc[19818](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493179, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:06:19.946233 19982 init.cc:377] Logged in from keytab as kudu/127.11.206.125@KRBTEST.COM (short username kudu)
I20260812 00:06:19.946624 19982 webserver.cc:460] Webserver started at http://127.11.206.125:42365/ using document root <none> and password file <none>
I20260812 00:06:19.946825 19982 fs_manager.cc:359] Metadata directory not provided
I20260812 00:06:19.946873 19982 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:06:19.946969 19982 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:06:19.947988 19982 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492899949492-12089-0/minicluster-data/master-1/data/instance:
uuid: "36cb8ff01c284b9ab3dd73dd44492a39"
format_stamp: "Formatted at 2026-08-12 00:06:19 on dist-test-slave-f0tn"
server_key: "bf24d1112480a80cbe8f7ee357da59b4"
server_key_iv: "2c51a390a67169bd25ca15530e9618aa"
server_key_version: "encryptionkey@0"
I20260812 00:06:19.948292 19982 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492899949492-12089-0/minicluster-data/master-1/wal/instance:
uuid: "36cb8ff01c284b9ab3dd73dd44492a39"
format_stamp: "Formatted at 2026-08-12 00:06:19 on dist-test-slave-f0tn"
server_key: "bf24d1112480a80cbe8f7ee357da59b4"
server_key_iv: "2c51a390a67169bd25ca15530e9618aa"
server_key_version: "encryptionkey@0"
I20260812 00:06:19.949561 19982 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:06:19.950208 20010 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:06:19.950356 19982 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:06:19.950441 19982 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492899949492-12089-0/minicluster-data/master-1/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492899949492-12089-0/minicluster-data/master-1/wal
uuid: "36cb8ff01c284b9ab3dd73dd44492a39"
format_stamp: "Formatted at 2026-08-12 00:06:19 on dist-test-slave-f0tn"
server_key: "bf24d1112480a80cbe8f7ee357da59b4"
server_key_iv: "2c51a390a67169bd25ca15530e9618aa"
server_key_version: "encryptionkey@0"
I20260812 00:06:19.950502 19982 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492899949492-12089-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492899949492-12089-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492899949492-12089-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:06:19.955479 19971 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.206.125" port: 38479 } attempt: 2
I20260812 00:06:19.955904 19974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:19.955775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.125:38479 (local address 127.0.0.1:42044)
0812 00:06:19.955830 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0812 00:06:19.955872 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.125:38479: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260812 00:06:19.956219 19974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:19.956148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.125:38479 (local address 127.0.0.1:42052)
0812 00:06:19.956180 (+ 32us) negotiation.cc:107] Waiting for socket to connect
0812 00:06:19.956203 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.125:38479: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
W20260812 00:06:19.956307 19971 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.206.125:38479: Network error: Client connection negotiation failed: client connection to 127.11.206.125:38479: connect: Connection refused (error 111)
I20260812 00:06:19.964291 19982 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:06:19.966423 19982 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:06:19.966535 19982 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:06:19.970304 19982 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.125:38479
I20260812 00:06:19.970338 20099 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.125:38479 every 8 connection(s)
I20260812 00:06:19.970676 19982 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492899949492-12089-0/minicluster-data/master-1/data/info.pb
I20260812 00:06:19.971570 20100 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:06:19.973099 20100 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.206.126" port: 34711 } has no permanent_uuid. Determining permanent_uuid...
I20260812 00:06:19.977347 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 19982
I20260812 00:06:19.977469 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492899949492-12089-0/minicluster-data/master-1/wal/instance
I20260812 00:06:19.977677 12089 external_mini_cluster.cc:1428] Setting key 950efb3b0eaa822694a554c97df0739e
Aug 12 00:06:19 dist-test-slave-f0tn krb5kdc[19818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493179, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.125@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:06:19.984402 19975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:19.973802 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32800 (local address 127.11.206.126:34711)
0812 00:06:19.973845 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:19.973847 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:19.974083 (+ 236us) server_negotiation.cc:407] Connection header received
0812 00:06:19.974588 (+ 505us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:19.974590 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:19.974605 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:19.974659 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:19.975266 (+ 607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:19.975739 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:19.976697 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:19.976901 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:19.976959 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:19.981646 (+ 4687us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:06:19.981648 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:06:19.981649 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:06:19.981658 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:06:19.983121 (+ 1463us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:19.983493 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:19.983494 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:19.983495 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:19.983561 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:19.983772 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:19.983773 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:19.983773 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:19.983920 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:06:19.983990 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:19.984216 (+ 226us) server_negotiation.cc:299] Negotiation successful
0812 00:06:19.984303 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 00:06:19.984473 20102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:19.973793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:34711 (local address 127.0.0.1:32800)
0812 00:06:19.973966 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0812 00:06:19.974001 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0812 00:06:19.974489 (+ 488us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:06:19.974732 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:06:19.974736 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:06:19.974983 (+ 247us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:06:19.975174 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:06:19.975178 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:06:19.975827 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:06:19.975828 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:06:19.976613 (+ 785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:06:19.976615 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:06:19.976973 (+ 358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:06:19.976974 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:06:19.977090 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:19.980139 (+ 3049us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:06:19.980147 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:06:19.981541 (+ 1394us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:06:19.983202 (+ 1661us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:06:19.983208 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:06:19.983210 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:06:19.983423 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:06:19.983629 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:06:19.983630 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:06:19.983630 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:06:19.983719 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:06:19.983978 (+ 259us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:06:19.983981 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:06:19.984097 (+ 116us) client_negotiation.cc:769] Sending connection context
0812 00:06:19.984175 (+ 78us) client_negotiation.cc:240] Negotiation successful
0812 00:06:19.984301 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":78,"threads_started":1}
I20260812 00:06:19.985046 20100 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.206.125" port: 38479 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.11.206.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.206.124@KRBTEST.COM" created.
Aug 12 00:06:19 dist-test-slave-f0tn krb5kdc[19818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493179, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.125@KRBTEST.COM for kudu/127.11.206.125@KRBTEST.COM
I20260812 00:06:19.992338 20102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:19.985310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.125:38479 (local address 127.0.0.1:42062)
0812 00:06:19.985360 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0812 00:06:19.985372 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 00:06:19.985437 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:06:19.985663 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:06:19.985664 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:06:19.985808 (+ 144us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:06:19.985870 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:06:19.985872 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:06:19.986678 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:06:19.986679 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:06:19.987187 (+ 508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:06:19.987188 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:06:19.987669 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:06:19.987670 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:06:19.987729 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:19.988151 (+ 422us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:06:19.988156 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:06:19.989558 (+ 1402us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:06:19.991278 (+ 1720us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:06:19.991279 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:06:19.991279 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:06:19.991479 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:06:19.991645 (+ 166us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:06:19.991646 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:06:19.991646 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:06:19.991705 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:06:19.991958 (+ 253us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:06:19.991959 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:06:19.992009 (+ 50us) client_negotiation.cc:769] Sending connection context
0812 00:06:19.992082 (+ 73us) client_negotiation.cc:240] Negotiation successful
0812 00:06:19.992186 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260812 00:06:19.992359 20104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:19.985373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42062 (local address 127.11.206.125:38479)
0812 00:06:19.985528 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:19.985532 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:19.985552 (+ 20us) server_negotiation.cc:407] Connection header received
0812 00:06:19.985573 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:19.985574 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:19.985585 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:19.985644 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:19.985933 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:19.986619 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:19.987247 (+ 628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:19.987609 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:19.987661 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:19.989643 (+ 1982us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:06:19.989654 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:06:19.989654 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:06:19.989662 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:06:19.991193 (+ 1531us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:19.991553 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:19.991556 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:19.991557 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:19.991606 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:19.991757 (+ 151us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:19.991757 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:19.991758 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:19.991897 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:06:19.991954 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:19.992126 (+ 172us) server_negotiation.cc:299] Negotiation successful
0812 00:06:19.992237 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":39,"server-negotiator.queue_time_us":110,"thread_start_us":75,"threads_started":1}
I20260812 00:06:19.993163 20100 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.206.124" port: 42825 } has no permanent_uuid. Determining permanent_uuid...
I20260812 00:06:19.993496 20102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:19.993358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.124:42825 (local address 127.0.0.1:56610)
0812 00:06:19.993417 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0812 00:06:19.993471 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.124:42825: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260812 00:06:19.993633 20013 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.206.124:42825: connect: Connection refused (error 111)
I20260812 00:06:19.994040 20102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:19.993946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.124:42825 (local address 127.0.0.1:56614)
0812 00:06:19.993991 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0812 00:06:19.994019 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.124:42825: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260812 00:06:19.994138 20100 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.206.124:42825: Network error: Client connection negotiation failed: client connection to 127.11.206.124:42825: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.206.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.124.keytab.
Entry for principal kudu/127.11.206.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.124.keytab.
I20260812 00:06:20.002683 12089 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksssay4/build/release/bin/kudu
/tmp/dist-test-tasksssay4/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492899949492-12089-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492899949492-12089-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492899949492-12089-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492899949492-12089-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.124:42825
--webserver_interface=127.11.206.124
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.124.keytab
--principal=kudu/127.11.206.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.206.84:42899
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.206.126:34711,127.11.206.125:38479,127.11.206.124:42825
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492899949492-12089-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492899949492-12089-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492899949492-12089-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:06:20.043380 20100 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.206.124" port: 42825 } attempt: 1
I20260812 00:06:20.043949 20102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:20.043790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.124:42825 (local address 127.0.0.1:56628)
0812 00:06:20.043863 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0812 00:06:20.043912 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.124:42825: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260812 00:06:20.044306 20102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:20.044216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.124:42825 (local address 127.0.0.1:56632)
0812 00:06:20.044259 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0812 00:06:20.044287 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.124:42825: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260812 00:06:20.044399 20100 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.206.124:42825: Network error: Client connection negotiation failed: client connection to 127.11.206.124:42825: connect: Connection refused (error 111)
I20260812 00:06:20.047461 19971 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.206.125" port: 38479 } attempt: 3
Aug 12 00:06:20 dist-test-slave-f0tn krb5kdc[19818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493179, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.126@KRBTEST.COM for kudu/127.11.206.125@KRBTEST.COM
I20260812 00:06:20.054206 20104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:20.047796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42066 (local address 127.11.206.125:38479)
0812 00:06:20.047856 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:20.047858 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:20.047868 (+ 10us) server_negotiation.cc:407] Connection header received
0812 00:06:20.047894 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:20.047895 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:20.047905 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:20.047950 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:20.048281 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:20.048776 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:20.049482 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:20.049711 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:20.049769 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:20.051658 (+ 1889us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:06:20.051660 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:06:20.051660 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:06:20.051666 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:06:20.053079 (+ 1413us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:20.053468 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:20.053469 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:20.053469 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:20.053520 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:20.053716 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:20.053716 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:20.053717 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:20.053830 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:06:20.053881 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:20.054054 (+ 173us) server_negotiation.cc:299] Negotiation successful
0812 00:06:20.054144 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260812 00:06:20.054239 19974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:20.047733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.125:38479 (local address 127.0.0.1:42066)
0812 00:06:20.047784 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0812 00:06:20.047794 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:06:20.047841 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:06:20.047961 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:06:20.047961 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:06:20.048135 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:06:20.048203 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:06:20.048205 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:06:20.048851 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:06:20.048852 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:06:20.049409 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:06:20.049411 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:06:20.049774 (+ 363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:06:20.049775 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:06:20.049853 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:20.050267 (+ 414us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:06:20.050272 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:06:20.051559 (+ 1287us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:06:20.053151 (+ 1592us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:06:20.053152 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:06:20.053153 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:06:20.053369 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:06:20.053590 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:06:20.053591 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:06:20.053591 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:06:20.053660 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:06:20.053891 (+ 231us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:06:20.053892 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:06:20.053945 (+ 53us) client_negotiation.cc:769] Sending connection context
0812 00:06:20.054031 (+ 86us) client_negotiation.cc:240] Negotiation successful
0812 00:06:20.054139 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260812 00:06:20.054636 19971 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.206.124" port: 42825 } has no permanent_uuid. Determining permanent_uuid...
I20260812 00:06:20.054955 19974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:20.054850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.124:42825 (local address 127.0.0.1:56642)
0812 00:06:20.054894 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0812 00:06:20.054930 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.124:42825: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
I20260812 00:06:20.055286 19974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:20.055205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.124:42825 (local address 127.0.0.1:56656)
0812 00:06:20.055245 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0812 00:06:20.055269 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.124:42825: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260812 00:06:20.055371 19971 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.206.124:42825: Network error: Client connection negotiation failed: client connection to 127.11.206.124:42825: connect: Connection refused (error 111)
I20260812 00:06:20.086546 19971 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.206.124" port: 42825 } attempt: 1
I20260812 00:06:20.087070 19974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:20.086915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.124:42825 (local address 127.0.0.1:56664)
0812 00:06:20.086984 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0812 00:06:20.087032 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.124:42825: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260812 00:06:20.087417 19974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:20.087327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.124:42825 (local address 127.0.0.1:56666)
0812 00:06:20.087368 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0812 00:06:20.087395 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.124:42825: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260812 00:06:20.087520 19971 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.206.124:42825: Network error: Client connection negotiation failed: client connection to 127.11.206.124:42825: connect: Connection refused (error 111)
W20260812 00:06:20.087628 20109 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 00:06:20.087837 20109 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:06:20.087853 20109 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:06:20.087888 20109 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:06:20.089087 20109 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:06:20.089130 20109 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:06:20.089144 20109 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:06:20.089155 20109 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:06:20.089166 20109 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:06:20.090786 20109 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.206.84:42899
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492899949492-12089-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492899949492-12089-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.11.206.126:34711,127.11.206.125:38479,127.11.206.124:42825
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492899949492-12089-0/krb5kdc/kudu_127.11.206.124.keytab
--principal=kudu/127.11.206.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.206.124:42825
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492899949492-12089-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.11.206.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20109
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492899949492-12089-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 22:58:32 UTC on ccycloud.quasar-jwjgej.root.comops.site
build id 4581605
I20260812 00:06:20.091038 20109 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:06:20.091310 20109 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:06:20.096231 20121 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:06:20.096360 20118 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:06:20.096391 20119 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:06:20.096562 20109 server_base.cc:1034] running on GCE node
I20260812 00:06:20.096760 20109 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:06:20.097043 20109 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:06:20.098176 20109 hybrid_clock.cc:648] HybridClock initialized: now 1786493180098161 us; error 31 us; skew 500 ppm
Aug 12 00:06:20 dist-test-slave-f0tn krb5kdc[19818](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493180, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:06:20.100665 20109 init.cc:377] Logged in from keytab as kudu/127.11.206.124@KRBTEST.COM (short username kudu)
I20260812 00:06:20.101070 20109 webserver.cc:460] Webserver started at http://127.11.206.124:40723/ using document root <none> and password file <none>
I20260812 00:06:20.101317 20109 fs_manager.cc:359] Metadata directory not provided
I20260812 00:06:20.101364 20109 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:06:20.101504 20109 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:06:20.102633 20109 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492899949492-12089-0/minicluster-data/master-2/data/instance:
uuid: "e00692bcaa7146ddaeaa2b440801f43b"
format_stamp: "Formatted at 2026-08-12 00:06:20 on dist-test-slave-f0tn"
server_key: "cfe803080c003d970fcc4a082da87e6c"
server_key_iv: "4d62f8024f86125bd5e8892922abb6cc"
server_key_version: "encryptionkey@0"
I20260812 00:06:20.102978 20109 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492899949492-12089-0/minicluster-data/master-2/wal/instance:
uuid: "e00692bcaa7146ddaeaa2b440801f43b"
format_stamp: "Formatted at 2026-08-12 00:06:20 on dist-test-slave-f0tn"
server_key: "cfe803080c003d970fcc4a082da87e6c"
server_key_iv: "4d62f8024f86125bd5e8892922abb6cc"
server_key_version: "encryptionkey@0"
I20260812 00:06:20.104298 20109 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 00:06:20.105017 20141 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:06:20.105181 20109 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 00:06:20.105281 20109 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492899949492-12089-0/minicluster-data/master-2/data,/tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492899949492-12089-0/minicluster-data/master-2/wal
uuid: "e00692bcaa7146ddaeaa2b440801f43b"
format_stamp: "Formatted at 2026-08-12 00:06:20 on dist-test-slave-f0tn"
server_key: "cfe803080c003d970fcc4a082da87e6c"
server_key_iv: "4d62f8024f86125bd5e8892922abb6cc"
server_key_version: "encryptionkey@0"
I20260812 00:06:20.105347 20109 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492899949492-12089-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492899949492-12089-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492899949492-12089-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:06:20.112532 20100 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.206.124" port: 42825 } attempt: 2
I20260812 00:06:20.112958 20102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:20.112834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.124:42825 (local address 127.0.0.1:56668)
0812 00:06:20.112893 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0812 00:06:20.112929 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.124:42825: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260812 00:06:20.113291 20102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:20.113207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.124:42825 (local address 127.0.0.1:56670)
0812 00:06:20.113248 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0812 00:06:20.113272 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.206.124:42825: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260812 00:06:20.113368 20100 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.206.124:42825: Network error: Client connection negotiation failed: client connection to 127.11.206.124:42825: connect: Connection refused (error 111)
I20260812 00:06:20.118309 20109 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:06:20.120426 20109 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:06:20.120548 20109 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:06:20.124322 20109 rpc_server.cc:307] RPC server started. Bound to: 127.11.206.124:42825
I20260812 00:06:20.124362 20230 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.206.124:42825 every 8 connection(s)
I20260812 00:06:20.124691 20109 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492899949492-12089-0/minicluster-data/master-2/data/info.pb
I20260812 00:06:20.125600 20231 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:06:20.127133 20231 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.206.126" port: 34711 } has no permanent_uuid. Determining permanent_uuid...
I20260812 00:06:20.128368 12089 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksssay4/build/release/bin/kudu as pid 20109
I20260812 00:06:20.128472 12089 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksssay4/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786492899949492-12089-0/minicluster-data/master-2/wal/instance
I20260812 00:06:20.128664 12089 external_mini_cluster.cc:1428] Setting key e5c22922262a17bd25e6602207825446
Aug 12 00:06:20 dist-test-slave-f0tn krb5kdc[19818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493180, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.124@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
Aug 12 00:06:20 dist-test-slave-f0tn krb5kdc[19818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493179, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.206.124@KRBTEST.COM
I20260812 00:06:20.136561 19975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:20.127794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32816 (local address 127.11.206.126:34711)
0812 00:06:20.127870 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:20.127873 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:20.128028 (+ 155us) server_negotiation.cc:407] Connection header received
0812 00:06:20.128502 (+ 474us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:20.128504 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:20.128516 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:20.128567 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:20.129295 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:20.129812 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:20.130738 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:20.130927 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:20.130984 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:20.133562 (+ 2578us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:06:20.133563 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:06:20.133564 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:06:20.133572 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:06:20.135192 (+ 1620us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:20.135605 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:20.135607 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:20.135607 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:20.135668 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:20.135901 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:20.135902 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:20.135903 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:20.136038 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:06:20.136102 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:20.136373 (+ 271us) server_negotiation.cc:299] Negotiation successful
0812 00:06:20.136460 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260812 00:06:20.136729 20233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:20.127759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.126:34711 (local address 127.0.0.1:32816)
0812 00:06:20.127915 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0812 00:06:20.127952 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 00:06:20.128402 (+ 450us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:06:20.128639 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:06:20.128642 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:06:20.128920 (+ 278us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:06:20.129192 (+ 272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:06:20.129198 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:06:20.129898 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:06:20.129899 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:06:20.130658 (+ 759us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:06:20.130660 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:06:20.130996 (+ 336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:06:20.130997 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:06:20.131129 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:20.131597 (+ 468us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:06:20.131605 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:06:20.133480 (+ 1875us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:06:20.135271 (+ 1791us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:06:20.135279 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:06:20.135282 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:06:20.135534 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:06:20.135731 (+ 197us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:06:20.135731 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:06:20.135732 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:06:20.135839 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:06:20.136100 (+ 261us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:06:20.136107 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:06:20.136246 (+ 139us) client_negotiation.cc:769] Sending connection context
0812 00:06:20.136344 (+ 98us) client_negotiation.cc:240] Negotiation successful
0812 00:06:20.136495 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"mutex_wait_us":3,"thread_start_us":71,"threads_started":1}
I20260812 00:06:20.137037 20238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:20.129011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56684 (local address 127.11.206.124:42825)
0812 00:06:20.129163 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:20.129168 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:20.129195 (+ 27us) server_negotiation.cc:407] Connection header received
0812 00:06:20.129248 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:20.129251 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:20.129276 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:20.129341 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:20.129950 (+ 609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:20.130716 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:20.131421 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:20.131725 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:20.131780 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:20.134381 (+ 2601us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:06:20.134390 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:06:20.134390 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:06:20.134396 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:06:20.135736 (+ 1340us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:20.136049 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:20.136052 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:20.136053 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:20.136104 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:20.136279 (+ 175us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:20.136280 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:20.136280 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:20.136410 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:06:20.136565 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:20.136897 (+ 332us) server_negotiation.cc:299] Negotiation successful
0812 00:06:20.136962 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":89,"threads_started":1}
I20260812 00:06:20.137346 20231 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.206.125" port: 38479 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 00:06:20 dist-test-slave-f0tn krb5kdc[19818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493180, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.124@KRBTEST.COM for kudu/127.11.206.125@KRBTEST.COM
Aug 12 00:06:20 dist-test-slave-f0tn krb5kdc[19818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493179, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.206.126@KRBTEST.COM
I20260812 00:06:20.144236 20104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:20.137825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42082 (local address 127.11.206.125:38479)
0812 00:06:20.137884 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:20.137886 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:20.137892 (+ 6us) server_negotiation.cc:407] Connection header received
0812 00:06:20.137913 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:20.137914 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:20.137922 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:20.137961 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:20.138277 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:20.138908 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:20.139535 (+ 627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:20.139735 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:20.139796 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:20.141593 (+ 1797us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:06:20.141595 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:06:20.141595 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:06:20.141601 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:06:20.143030 (+ 1429us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:20.143427 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:20.143428 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:20.143429 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:20.143489 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:20.143700 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:20.143702 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:20.143702 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:20.143839 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:06:20.143883 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:20.144071 (+ 188us) server_negotiation.cc:299] Negotiation successful
0812 00:06:20.144137 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260812 00:06:20.144236 20233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:20.137645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.125:38479 (local address 127.0.0.1:42082)
0812 00:06:20.137680 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0812 00:06:20.137691 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 00:06:20.137729 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:06:20.137976 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:06:20.137977 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:06:20.138139 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:06:20.138200 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:06:20.138203 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:06:20.138980 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:06:20.138981 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:06:20.139464 (+ 483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:06:20.139466 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:06:20.139790 (+ 324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:06:20.139791 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:06:20.139856 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:20.140209 (+ 353us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:06:20.140214 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:06:20.141496 (+ 1282us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:06:20.143115 (+ 1619us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:06:20.143117 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:06:20.143118 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:06:20.143326 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:06:20.143565 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:06:20.143566 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:06:20.143566 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:06:20.143628 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:06:20.143930 (+ 302us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:06:20.143931 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:06:20.143977 (+ 46us) client_negotiation.cc:769] Sending connection context
0812 00:06:20.144040 (+ 63us) client_negotiation.cc:240] Negotiation successful
0812 00:06:20.144136 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19}
I20260812 00:06:20.145007 20231 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.206.124" port: 42825 } has no permanent_uuid. Determining permanent_uuid...
I20260812 00:06:20.145929 19975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:20.137795 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32828 (local address 127.11.206.126:34711)
0812 00:06:20.137834 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:20.137836 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:20.137928 (+ 92us) server_negotiation.cc:407] Connection header received
0812 00:06:20.138014 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:20.138015 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:20.138023 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:20.138058 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:20.138594 (+ 536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:20.139043 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:20.139695 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:20.139891 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:20.139944 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:20.142176 (+ 2232us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:06:20.142177 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:06:20.142177 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:06:20.142184 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:06:20.143609 (+ 1425us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:20.143994 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:20.143995 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:20.143995 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:20.144055 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:20.144270 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:20.144271 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:20.144272 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:20.144829 (+ 557us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:06:20.145514 (+ 685us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:20.145751 (+ 237us) server_negotiation.cc:299] Negotiation successful
0812 00:06:20.145839 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
Aug 12 00:06:20 dist-test-slave-f0tn krb5kdc[19818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493180, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.124@KRBTEST.COM for kudu/127.11.206.124@KRBTEST.COM
I20260812 00:06:20.151965 20233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:20.145267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.124:42825 (local address 127.0.0.1:56698)
0812 00:06:20.145411 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0812 00:06:20.145420 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:06:20.145465 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:06:20.145623 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:06:20.145623 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:06:20.145761 (+ 138us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:06:20.145798 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:06:20.145800 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:06:20.146643 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:06:20.146643 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:06:20.147151 (+ 508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:06:20.147153 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:06:20.147568 (+ 415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:06:20.147569 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:06:20.147615 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:20.148139 (+ 524us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:06:20.148144 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:06:20.149509 (+ 1365us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:06:20.151101 (+ 1592us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:06:20.151102 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:06:20.151102 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:06:20.151250 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:06:20.151414 (+ 164us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:06:20.151415 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:06:20.151415 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:06:20.151468 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:06:20.151665 (+ 197us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:06:20.151666 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:06:20.151703 (+ 37us) client_negotiation.cc:769] Sending connection context
0812 00:06:20.151762 (+ 59us) client_negotiation.cc:240] Negotiation successful
0812 00:06:20.151859 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134}
I20260812 00:06:20.152006 20238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:20.145333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56698 (local address 127.11.206.124:42825)
0812 00:06:20.145367 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:20.145369 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:20.145461 (+ 92us) server_negotiation.cc:407] Connection header received
0812 00:06:20.145523 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:20.145524 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:20.145538 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:20.145617 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:20.145939 (+ 322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:20.146574 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:20.147218 (+ 644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:20.147457 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:20.147516 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:20.149598 (+ 2082us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:06:20.149600 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:06:20.149600 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:06:20.149608 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:06:20.151028 (+ 1420us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:20.151313 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:20.151314 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:20.151314 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:20.151364 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:20.151516 (+ 152us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:20.151517 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:20.151518 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:20.151616 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:06:20.151667 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:20.151795 (+ 128us) server_negotiation.cc:299] Negotiation successful
0812 00:06:20.151904 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":48,"server-negotiator.queue_time_us":16}
Aug 12 00:06:20 dist-test-slave-f0tn krb5kdc[19818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493179, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.206.125@KRBTEST.COM
I20260812 00:06:20.156782 20231 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e00692bcaa7146ddaeaa2b440801f43b: Bootstrap starting.
I20260812 00:06:20.157842 20231 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e00692bcaa7146ddaeaa2b440801f43b: Neither blocks nor log segments found. Creating new log.
I20260812 00:06:20.158154 20104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:20.146731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42084 (local address 127.11.206.125:38479)
0812 00:06:20.147739 (+ 1008us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:20.147741 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:20.147750 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:06:20.147780 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:20.147781 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:20.147791 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:20.147848 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:20.148421 (+ 573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:20.149103 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:20.150043 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:20.150348 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:20.150390 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:20.154990 (+ 4600us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:06:20.154992 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:06:20.154992 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:06:20.155000 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:06:20.156596 (+ 1596us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:20.157028 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:20.157030 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:20.157030 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:20.157102 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:20.157350 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:20.157351 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:20.157351 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:20.157530 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:06:20.157713 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:20.157976 (+ 263us) server_negotiation.cc:299] Negotiation successful
0812 00:06:20.158056 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":983}
I20260812 00:06:20.158149 20231 log.cc:824] T 00000000000000000000000000000000 P e00692bcaa7146ddaeaa2b440801f43b: Log is configured to *not* fsync() on all Append() calls
I20260812 00:06:20.158936 20231 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e00692bcaa7146ddaeaa2b440801f43b: No bootstrap required, opened a new log
I20260812 00:06:20.159682 12089 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:06:20.160647 20231 raft_consensus.cc:348] T 00000000000000000000000000000000 P e00692bcaa7146ddaeaa2b440801f43b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab9159963b646eb87cefa7c8a552ff2" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 34711 } } peers { permanent_uuid: "36cb8ff01c284b9ab3dd73dd44492a39" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 38479 } } peers { permanent_uuid: "e00692bcaa7146ddaeaa2b440801f43b" member_type: VOTER last_known_addr { host: "127.11.206.124" port: 42825 } }
I20260812 00:06:20.160800 20231 raft_consensus.cc:729] T 00000000000000000000000000000000 P e00692bcaa7146ddaeaa2b440801f43b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e00692bcaa7146ddaeaa2b440801f43b, State: Initialized, Role: FOLLOWER
I20260812 00:06:20.160883 20231 consensus_queue.cc:260] T 00000000000000000000000000000000 P e00692bcaa7146ddaeaa2b440801f43b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab9159963b646eb87cefa7c8a552ff2" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 34711 } } peers { permanent_uuid: "36cb8ff01c284b9ab3dd73dd44492a39" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 38479 } } peers { permanent_uuid: "e00692bcaa7146ddaeaa2b440801f43b" member_type: VOTER last_known_addr { host: "127.11.206.124" port: 42825 } }
I20260812 00:06:20.161171 20231 sys_catalog.cc:564] T 00000000000000000000000000000000 P e00692bcaa7146ddaeaa2b440801f43b [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:06:20.161124 20240 sys_catalog.cc:455] T 00000000000000000000000000000000 P e00692bcaa7146ddaeaa2b440801f43b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab9159963b646eb87cefa7c8a552ff2" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 34711 } } peers { permanent_uuid: "36cb8ff01c284b9ab3dd73dd44492a39" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 38479 } } peers { permanent_uuid: "e00692bcaa7146ddaeaa2b440801f43b" member_type: VOTER last_known_addr { host: "127.11.206.124" port: 42825 } } }
I20260812 00:06:20.161247 20240 sys_catalog.cc:458] T 00000000000000000000000000000000 P e00692bcaa7146ddaeaa2b440801f43b [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:06:20.160609 19921 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "cab9159963b646eb87cefa7c8a552ff2"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:32828
I20260812 00:06:20.162668 19971 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.206.124" port: 42825 } attempt: 2
W20260812 00:06:20.163117 20267 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e00692bcaa7146ddaeaa2b440801f43b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 00:06:20.163174 20267 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 00:06:20.163563 20109 master_runner.cc:186] Error getting master registration for 127.11.206.126:34711: OK, instance_id { permanent_uuid: "cab9159963b646eb87cefa7c8a552ff2" instance_seqno: 1786493179821318 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 00:06:20.166497 20109 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
Aug 12 00:06:20 dist-test-slave-f0tn krb5kdc[19818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493179, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.126@KRBTEST.COM for kudu/127.11.206.124@KRBTEST.COM
I20260812 00:06:20.169909 19974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:20.162928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.124:42825 (local address 127.0.0.1:56706)
0812 00:06:20.163013 (+ 85us) negotiation.cc:107] Waiting for socket to connect
0812 00:06:20.163023 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 00:06:20.163073 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:06:20.163284 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:06:20.163285 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:06:20.163450 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:06:20.163496 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:06:20.163498 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:06:20.164361 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:06:20.164362 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:06:20.164863 (+ 501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:06:20.164865 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:06:20.165290 (+ 425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:06:20.165290 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:06:20.165357 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:20.165765 (+ 408us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:06:20.165770 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:06:20.167298 (+ 1528us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:06:20.168937 (+ 1639us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:06:20.168938 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:06:20.168939 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:06:20.169119 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:06:20.169289 (+ 170us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:06:20.169290 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:06:20.169290 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:06:20.169346 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:06:20.169613 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:06:20.169614 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:06:20.169660 (+ 46us) client_negotiation.cc:769] Sending connection context
0812 00:06:20.169720 (+ 60us) client_negotiation.cc:240] Negotiation successful
0812 00:06:20.169815 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":67}
I20260812 00:06:20.169906 20238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:20.163003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56706 (local address 127.11.206.124:42825)
0812 00:06:20.163037 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:20.163038 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:20.163047 (+ 9us) server_negotiation.cc:407] Connection header received
0812 00:06:20.163117 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:20.163118 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:20.163127 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:20.163175 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:20.163579 (+ 404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:20.164295 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:20.164934 (+ 639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:20.165232 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:20.165288 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:20.167392 (+ 2104us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:06:20.167409 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:06:20.167409 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:06:20.167416 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:06:20.168858 (+ 1442us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:20.169181 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:20.169182 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:20.169182 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:20.169236 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:20.169417 (+ 181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:20.169418 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:20.169418 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:20.169546 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:06:20.169606 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:20.169746 (+ 140us) server_negotiation.cc:299] Negotiation successful
0812 00:06:20.169816 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 00:06:20.171792 19971 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cab9159963b646eb87cefa7c8a552ff2: Bootstrap starting.
I20260812 00:06:20.172550 19971 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cab9159963b646eb87cefa7c8a552ff2: Neither blocks nor log segments found. Creating new log.
I20260812 00:06:20.172876 19971 log.cc:824] T 00000000000000000000000000000000 P cab9159963b646eb87cefa7c8a552ff2: Log is configured to *not* fsync() on all Append() calls
I20260812 00:06:20.173892 19971 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cab9159963b646eb87cefa7c8a552ff2: No bootstrap required, opened a new log
I20260812 00:06:20.175453 19971 raft_consensus.cc:348] T 00000000000000000000000000000000 P cab9159963b646eb87cefa7c8a552ff2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab9159963b646eb87cefa7c8a552ff2" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 34711 } } peers { permanent_uuid: "36cb8ff01c284b9ab3dd73dd44492a39" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 38479 } } peers { permanent_uuid: "e00692bcaa7146ddaeaa2b440801f43b" member_type: VOTER last_known_addr { host: "127.11.206.124" port: 42825 } }
I20260812 00:06:20.175630 19971 raft_consensus.cc:729] T 00000000000000000000000000000000 P cab9159963b646eb87cefa7c8a552ff2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab9159963b646eb87cefa7c8a552ff2, State: Initialized, Role: FOLLOWER
I20260812 00:06:20.175724 19971 consensus_queue.cc:260] T 00000000000000000000000000000000 P cab9159963b646eb87cefa7c8a552ff2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab9159963b646eb87cefa7c8a552ff2" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 34711 } } peers { permanent_uuid: "36cb8ff01c284b9ab3dd73dd44492a39" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 38479 } } peers { permanent_uuid: "e00692bcaa7146ddaeaa2b440801f43b" member_type: VOTER last_known_addr { host: "127.11.206.124" port: 42825 } }
I20260812 00:06:20.176265 20273 sys_catalog.cc:455] T 00000000000000000000000000000000 P cab9159963b646eb87cefa7c8a552ff2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab9159963b646eb87cefa7c8a552ff2" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 34711 } } peers { permanent_uuid: "36cb8ff01c284b9ab3dd73dd44492a39" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 38479 } } peers { permanent_uuid: "e00692bcaa7146ddaeaa2b440801f43b" member_type: VOTER last_known_addr { host: "127.11.206.124" port: 42825 } } }
I20260812 00:06:20.176329 19971 sys_catalog.cc:564] T 00000000000000000000000000000000 P cab9159963b646eb87cefa7c8a552ff2 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:06:20.176334 20273 sys_catalog.cc:458] T 00000000000000000000000000000000 P cab9159963b646eb87cefa7c8a552ff2 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:06:20.178602 19921 raft_consensus.cc:482] T 00000000000000000000000000000000 P cab9159963b646eb87cefa7c8a552ff2 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 00:06:20.178661 19921 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cab9159963b646eb87cefa7c8a552ff2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:06:20.179404 19921 raft_consensus.cc:504] T 00000000000000000000000000000000 P cab9159963b646eb87cefa7c8a552ff2 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab9159963b646eb87cefa7c8a552ff2" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 34711 } } peers { permanent_uuid: "36cb8ff01c284b9ab3dd73dd44492a39" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 38479 } } peers { permanent_uuid: "e00692bcaa7146ddaeaa2b440801f43b" member_type: VOTER last_known_addr { host: "127.11.206.124" port: 42825 } }
I20260812 00:06:20.179646 19921 leader_election.cc:288] T 00000000000000000000000000000000 P cab9159963b646eb87cefa7c8a552ff2 [CANDIDATE]: Term 1 election: Requested vote from peers 36cb8ff01c284b9ab3dd73dd44492a39 (127.11.206.125:38479), e00692bcaa7146ddaeaa2b440801f43b (127.11.206.124:42825)
I20260812 00:06:20.180071 20188 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cab9159963b646eb87cefa7c8a552ff2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "e00692bcaa7146ddaeaa2b440801f43b"
I20260812 00:06:20.180220 20188 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e00692bcaa7146ddaeaa2b440801f43b [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:06:20.181133 20188 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e00692bcaa7146ddaeaa2b440801f43b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab9159963b646eb87cefa7c8a552ff2 in term 1.
I20260812 00:06:20.181457 19873 leader_election.cc:302] T 00000000000000000000000000000000 P cab9159963b646eb87cefa7c8a552ff2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cab9159963b646eb87cefa7c8a552ff2, e00692bcaa7146ddaeaa2b440801f43b; no voters:
I20260812 00:06:20.181694 20273 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cab9159963b646eb87cefa7c8a552ff2 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:06:20.181883 20273 raft_consensus.cc:686] T 00000000000000000000000000000000 P cab9159963b646eb87cefa7c8a552ff2 [term 1 LEADER]: Becoming Leader. State: Replica: cab9159963b646eb87cefa7c8a552ff2, State: Running, Role: LEADER
I20260812 00:06:20.181978 20273 consensus_queue.cc:237] T 00000000000000000000000000000000 P cab9159963b646eb87cefa7c8a552ff2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab9159963b646eb87cefa7c8a552ff2" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 34711 } } peers { permanent_uuid: "36cb8ff01c284b9ab3dd73dd44492a39" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 38479 } } peers { permanent_uuid: "e00692bcaa7146ddaeaa2b440801f43b" member_type: VOTER last_known_addr { host: "127.11.206.124" port: 42825 } }
I20260812 00:06:20.182814 20296 sys_catalog.cc:455] T 00000000000000000000000000000000 P cab9159963b646eb87cefa7c8a552ff2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cab9159963b646eb87cefa7c8a552ff2. Latest consensus state: current_term: 1 leader_uuid: "cab9159963b646eb87cefa7c8a552ff2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab9159963b646eb87cefa7c8a552ff2" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 34711 } } peers { permanent_uuid: "36cb8ff01c284b9ab3dd73dd44492a39" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 38479 } } peers { permanent_uuid: "e00692bcaa7146ddaeaa2b440801f43b" member_type: VOTER last_known_addr { host: "127.11.206.124" port: 42825 } } }
I20260812 00:06:20.182945 20296 sys_catalog.cc:458] T 00000000000000000000000000000000 P cab9159963b646eb87cefa7c8a552ff2 [sys.catalog]: This master's current role is: LEADER
I20260812 00:06:20.183331 20299 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:06:20.184190 20299 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:06:20.182214 19841 master_runner.cc:186] Error getting master registration for 127.11.206.125:38479: OK, instance_id { permanent_uuid: "36cb8ff01c284b9ab3dd73dd44492a39" instance_seqno: 1786493179969193 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 00:06:20.184551 19841 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 00:06:20.186405 20188 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e00692bcaa7146ddaeaa2b440801f43b [term 1 FOLLOWER]: Refusing update from remote peer cab9159963b646eb87cefa7c8a552ff2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:06:20.186748 20296 consensus_queue.cc:1035] T 00000000000000000000000000000000 P cab9159963b646eb87cefa7c8a552ff2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e00692bcaa7146ddaeaa2b440801f43b" member_type: VOTER last_known_addr { host: "127.11.206.124" port: 42825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:06:20.188555 20240 sys_catalog.cc:455] T 00000000000000000000000000000000 P e00692bcaa7146ddaeaa2b440801f43b [sys.catalog]: SysCatalogTable state changed. Reason: New leader cab9159963b646eb87cefa7c8a552ff2. Latest consensus state: current_term: 1 leader_uuid: "cab9159963b646eb87cefa7c8a552ff2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab9159963b646eb87cefa7c8a552ff2" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 34711 } } peers { permanent_uuid: "36cb8ff01c284b9ab3dd73dd44492a39" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 38479 } } peers { permanent_uuid: "e00692bcaa7146ddaeaa2b440801f43b" member_type: VOTER last_known_addr { host: "127.11.206.124" port: 42825 } } }
I20260812 00:06:20.188659 20240 sys_catalog.cc:458] T 00000000000000000000000000000000 P e00692bcaa7146ddaeaa2b440801f43b [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:06:20.189697 20104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:20.181213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42092 (local address 127.11.206.125:38479)
0812 00:06:20.181259 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:20.181262 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:20.181440 (+ 178us) server_negotiation.cc:407] Connection header received
0812 00:06:20.181544 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:20.181545 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:20.181557 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:20.181587 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:20.182419 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:20.183110 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:20.184135 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:20.184413 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:20.184458 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:20.186666 (+ 2208us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:06:20.186668 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:06:20.186668 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:06:20.186689 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:06:20.188265 (+ 1576us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:20.188815 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:20.188817 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:20.188817 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:20.188876 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:20.189138 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:20.189140 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:20.189140 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:20.189273 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:06:20.189365 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:20.189513 (+ 148us) server_negotiation.cc:299] Negotiation successful
0812 00:06:20.189610 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 00:06:20.191763 20296 sys_catalog.cc:455] T 00000000000000000000000000000000 P cab9159963b646eb87cefa7c8a552ff2 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "cab9159963b646eb87cefa7c8a552ff2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab9159963b646eb87cefa7c8a552ff2" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 34711 } } peers { permanent_uuid: "36cb8ff01c284b9ab3dd73dd44492a39" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 38479 } } peers { permanent_uuid: "e00692bcaa7146ddaeaa2b440801f43b" member_type: VOTER last_known_addr { host: "127.11.206.124" port: 42825 } } }
I20260812 00:06:20.191848 20296 sys_catalog.cc:458] T 00000000000000000000000000000000 P cab9159963b646eb87cefa7c8a552ff2 [sys.catalog]: This master's current role is: LEADER
I20260812 00:06:20.192441 20240 sys_catalog.cc:455] T 00000000000000000000000000000000 P e00692bcaa7146ddaeaa2b440801f43b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "cab9159963b646eb87cefa7c8a552ff2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab9159963b646eb87cefa7c8a552ff2" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 34711 } } peers { permanent_uuid: "36cb8ff01c284b9ab3dd73dd44492a39" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 38479 } } peers { permanent_uuid: "e00692bcaa7146ddaeaa2b440801f43b" member_type: VOTER last_known_addr { host: "127.11.206.124" port: 42825 } } }
I20260812 00:06:20.192529 20240 sys_catalog.cc:458] T 00000000000000000000000000000000 P e00692bcaa7146ddaeaa2b440801f43b [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:06:20.192601 20304 mvcc.cc:205] Tried to move back new op lower bound from 7317476066040893440 to 7317476066027180032. Current Snapshot: MvccSnapshot[applied={T|T < 7317476066040893440}]
I20260812 00:06:20.193090 20299 catalog_manager.cc:1347] Generated new cluster ID: 3484a481d53c4005801bcd808f3c83c8
I20260812 00:06:20.193141 20299 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:06:20.199154 20238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:20.189656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56714 (local address 127.11.206.124:42825)
0812 00:06:20.189690 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:20.189692 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:20.190039 (+ 347us) server_negotiation.cc:407] Connection header received
0812 00:06:20.190321 (+ 282us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:20.190323 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:20.190334 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:20.190397 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:20.191056 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:20.191727 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:20.192646 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:20.192920 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:20.192987 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:20.195205 (+ 2218us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:06:20.195207 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:06:20.195207 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:06:20.195213 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:06:20.196814 (+ 1601us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:20.197999 (+ 1185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:20.198000 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:20.198000 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:20.198077 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:20.198400 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:20.198401 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:20.198401 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:20.198546 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:06:20.198626 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:20.198987 (+ 361us) server_negotiation.cc:299] Negotiation successful
0812 00:06:20.199066 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 00:06:20.204001 19975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:20.189922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32836 (local address 127.11.206.126:34711)
0812 00:06:20.189962 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:20.189964 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:20.190134 (+ 170us) server_negotiation.cc:407] Connection header received
0812 00:06:20.190237 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:20.190238 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:20.190248 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:20.190281 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:20.193659 (+ 3378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:20.194248 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:20.195196 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:20.195450 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:20.195496 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:20.201017 (+ 5521us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:06:20.201019 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:06:20.201019 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:06:20.201028 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:06:20.202622 (+ 1594us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:20.203049 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:20.203051 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:20.203051 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:20.203113 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:20.203363 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:20.203364 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:20.203365 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:20.203496 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:06:20.203594 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:20.203816 (+ 222us) server_negotiation.cc:299] Negotiation successful
0812 00:06:20.203899 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 00:06:20.204559 20100 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.206.124" port: 42825 } attempt: 3
Aug 12 00:06:20 dist-test-slave-f0tn krb5kdc[19818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786493179, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.206.125@KRBTEST.COM for kudu/127.11.206.124@KRBTEST.COM
I20260812 00:06:20.213263 20102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:20.204806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.206.124:42825 (local address 127.0.0.1:56722)
0812 00:06:20.204856 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0812 00:06:20.204865 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 00:06:20.204899 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:06:20.205109 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:06:20.205110 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:06:20.205270 (+ 160us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:06:20.205314 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:06:20.205316 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:06:20.206153 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:06:20.206154 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:06:20.206911 (+ 757us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:06:20.206913 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:06:20.207382 (+ 469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:06:20.207383 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:06:20.207437 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:20.207922 (+ 485us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:06:20.207943 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:06:20.209502 (+ 1559us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:06:20.212026 (+ 2524us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:06:20.212027 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:06:20.212028 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:06:20.212245 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:06:20.212508 (+ 263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:06:20.212509 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:06:20.212509 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:06:20.212569 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:06:20.212957 (+ 388us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:06:20.212958 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:06:20.213012 (+ 54us) client_negotiation.cc:769] Sending connection context
0812 00:06:20.213061 (+ 49us) client_negotiation.cc:240] Negotiation successful
0812 00:06:20.213158 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260812 00:06:20.213986 20238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:20.204982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56722 (local address 127.11.206.124:42825)
0812 00:06:20.205014 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:20.205015 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:20.205034 (+ 19us) server_negotiation.cc:407] Connection header received
0812 00:06:20.205051 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:20.205051 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:20.205059 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:20.205103 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:20.205369 (+ 266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:20.206088 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:20.206995 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:20.207314 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:20.207372 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:20.209618 (+ 2246us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:06:20.209619 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:06:20.209620 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:06:20.209626 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:06:20.211919 (+ 2293us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:20.212325 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:20.212327 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:20.212327 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:20.212412 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:06:20.212634 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:06:20.212634 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:06:20.212635 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:06:20.212837 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:06:20.213639 (+ 802us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:20.213711 (+ 72us) server_negotiation.cc:299] Negotiation successful
0812 00:06:20.213846 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260812 00:06:20.215855 20100 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 36cb8ff01c284b9ab3dd73dd44492a39: Bootstrap starting.
I20260812 00:06:20.216666 20100 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 36cb8ff01c284b9ab3dd73dd44492a39: Neither blocks nor log segments found. Creating new log.
I20260812 00:06:20.216974 20100 log.cc:824] T 00000000000000000000000000000000 P 36cb8ff01c284b9ab3dd73dd44492a39: Log is configured to *not* fsync() on all Append() calls
I20260812 00:06:20.218346 20100 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 36cb8ff01c284b9ab3dd73dd44492a39: No bootstrap required, opened a new log
I20260812 00:06:20.220348 20100 raft_consensus.cc:348] T 00000000000000000000000000000000 P 36cb8ff01c284b9ab3dd73dd44492a39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab9159963b646eb87cefa7c8a552ff2" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 34711 } } peers { permanent_uuid: "36cb8ff01c284b9ab3dd73dd44492a39" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 38479 } } peers { permanent_uuid: "e00692bcaa7146ddaeaa2b440801f43b" member_type: VOTER last_known_addr { host: "127.11.206.124" port: 42825 } }
I20260812 00:06:20.220501 20100 raft_consensus.cc:729] T 00000000000000000000000000000000 P 36cb8ff01c284b9ab3dd73dd44492a39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36cb8ff01c284b9ab3dd73dd44492a39, State: Initialized, Role: FOLLOWER
I20260812 00:06:20.220579 20100 consensus_queue.cc:260] T 00000000000000000000000000000000 P 36cb8ff01c284b9ab3dd73dd44492a39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab9159963b646eb87cefa7c8a552ff2" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 34711 } } peers { permanent_uuid: "36cb8ff01c284b9ab3dd73dd44492a39" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 38479 } } peers { permanent_uuid: "e00692bcaa7146ddaeaa2b440801f43b" member_type: VOTER last_known_addr { host: "127.11.206.124" port: 42825 } }
I20260812 00:06:20.220942 20100 sys_catalog.cc:564] T 00000000000000000000000000000000 P 36cb8ff01c284b9ab3dd73dd44492a39 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:06:20.226576 20054 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cab9159963b646eb87cefa7c8a552ff2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "36cb8ff01c284b9ab3dd73dd44492a39"
I20260812 00:06:20.226702 20054 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 36cb8ff01c284b9ab3dd73dd44492a39 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:06:20.227540 20054 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 36cb8ff01c284b9ab3dd73dd44492a39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab9159963b646eb87cefa7c8a552ff2 in term 1.
I20260812 00:06:20.227978 20053 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 36cb8ff01c284b9ab3dd73dd44492a39 [term 1 FOLLOWER]: Refusing update from remote peer cab9159963b646eb87cefa7c8a552ff2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:06:20.228240 20273 consensus_queue.cc:1035] T 00000000000000000000000000000000 P cab9159963b646eb87cefa7c8a552ff2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36cb8ff01c284b9ab3dd73dd44492a39" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 38479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:06:20.237185 20299 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:06:20.237521 20341 sys_catalog.cc:455] T 00000000000000000000000000000000 P 36cb8ff01c284b9ab3dd73dd44492a39 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cab9159963b646eb87cefa7c8a552ff2. Latest consensus state: current_term: 1 leader_uuid: "cab9159963b646eb87cefa7c8a552ff2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab9159963b646eb87cefa7c8a552ff2" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 34711 } } peers { permanent_uuid: "36cb8ff01c284b9ab3dd73dd44492a39" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 38479 } } peers { permanent_uuid: "e00692bcaa7146ddaeaa2b440801f43b" member_type: VOTER last_known_addr { host: "127.11.206.124" port: 42825 } } }
I20260812 00:06:20.237703 20341 sys_catalog.cc:458] T 00000000000000000000000000000000 P 36cb8ff01c284b9ab3dd73dd44492a39 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:06:20.237790 20341 sys_catalog.cc:455] T 00000000000000000000000000000000 P 36cb8ff01c284b9ab3dd73dd44492a39 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "cab9159963b646eb87cefa7c8a552ff2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab9159963b646eb87cefa7c8a552ff2" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 34711 } } peers { permanent_uuid: "36cb8ff01c284b9ab3dd73dd44492a39" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 38479 } } peers { permanent_uuid: "e00692bcaa7146ddaeaa2b440801f43b" member_type: VOTER last_known_addr { host: "127.11.206.124" port: 42825 } } }
I20260812 00:06:20.237884 20341 sys_catalog.cc:458] T 00000000000000000000000000000000 P 36cb8ff01c284b9ab3dd73dd44492a39 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:06:20.237984 20299 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:06:20.238523 20316 sys_catalog.cc:455] T 00000000000000000000000000000000 P 36cb8ff01c284b9ab3dd73dd44492a39 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cab9159963b646eb87cefa7c8a552ff2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab9159963b646eb87cefa7c8a552ff2" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 34711 } } peers { permanent_uuid: "36cb8ff01c284b9ab3dd73dd44492a39" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 38479 } } peers { permanent_uuid: "e00692bcaa7146ddaeaa2b440801f43b" member_type: VOTER last_known_addr { host: "127.11.206.124" port: 42825 } } }
I20260812 00:06:20.238624 20316 sys_catalog.cc:458] T 00000000000000000000000000000000 P 36cb8ff01c284b9ab3dd73dd44492a39 [sys.catalog]: This master's current role is: FOLLOWER
W20260812 00:06:20.239418 20335 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 36cb8ff01c284b9ab3dd73dd44492a39: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 00:06:20.239468 20335 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 00:06:20.243072 20299 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cab9159963b646eb87cefa7c8a552ff2: Generated new TSK 0
I20260812 00:06:20.243319 20299 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:06:20.246448 20338 mvcc.cc:205] Tried to move back new op lower bound from 7317476066040893440 to 7317476066027180032. Current Snapshot: MvccSnapshot[applied={T|T < 7317476066040893440}]
I20260812 00:06:20.246780 20273 sys_catalog.cc:455] T 00000000000000000000000000000000 P cab9159963b646eb87cefa7c8a552ff2 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "cab9159963b646eb87cefa7c8a552ff2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab9159963b646eb87cefa7c8a552ff2" member_type: VOTER last_known_addr { host: "127.11.206.126" port: 34711 } } peers { permanent_uuid: "36cb8ff01c284b9ab3dd73dd44492a39" member_type: VOTER last_known_addr { host: "127.11.206.125" port: 38479 } } peers { permanent_uuid: "e00692bcaa7146ddaeaa2b440801f43b" member_type: VOTER last_known_addr { host: "127.11.206.124" port: 42825 } } }
I20260812 00:06:20.246863 20273 sys_catalog.cc:458] T 00000000000000000000000000000000 P cab9159963b646eb87cefa7c8a552ff2 [sys.catalog]: This master's current role is: LEADER
W20260812 00:06:20.285351 20238 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:06:20.283884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56724 (local address 127.11.206.124:42825)
0812 00:06:20.283921 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:20.283923 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:20.284656 (+ 733us) server_negotiation.cc:407] Connection header received
0812 00:06:20.284760 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:20.284761 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:20.284772 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:20.284801 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:20.285278 (+ 477us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56724: BlockingRecv error: recv got EOF from 127.0.0.1:56724 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260812 00:06:20.286203 20104 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:06:20.283653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42096 (local address 127.11.206.125:38479)
0812 00:06:20.283700 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:20.283703 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:20.285691 (+ 1988us) server_negotiation.cc:407] Connection header received
0812 00:06:20.285792 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:20.285793 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:20.285804 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:20.285831 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:20.286141 (+ 310us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42096: BlockingRecv error: recv got EOF from 127.0.0.1:42096 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
W20260812 00:06:20.286989 19975 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:06:20.284120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32852 (local address 127.11.206.126:34711)
0812 00:06:20.284159 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:20.284161 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:20.286502 (+ 2341us) server_negotiation.cc:407] Connection header received
0812 00:06:20.286591 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:20.286592 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:20.286602 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:20.286629 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:20.286924 (+ 295us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:32852: BlockingRecv error: recv got EOF from 127.0.0.1:32852 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260812 00:06:20.289511 20104 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:06:20.288683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42104 (local address 127.11.206.125:38479)
0812 00:06:20.288719 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:20.288721 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:20.288962 (+ 241us) server_negotiation.cc:407] Connection header received
0812 00:06:20.289079 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:20.289080 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:20.289099 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:20.289126 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:20.289464 (+ 338us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42104: BlockingRecv error: recv got EOF from 127.0.0.1:42104 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260812 00:06:20.292928 20104 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:06:20.292066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42120 (local address 127.11.206.125:38479)
0812 00:06:20.292104 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:20.292106 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:20.292369 (+ 263us) server_negotiation.cc:407] Connection header received
0812 00:06:20.292458 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:20.292459 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:20.292471 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:20.292499 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:20.292875 (+ 376us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42120: BlockingRecv error: recv got EOF from 127.0.0.1:42120 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260812 00:06:20.297199 20104 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:06:20.296289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42124 (local address 127.11.206.125:38479)
0812 00:06:20.296327 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:20.296330 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:20.296629 (+ 299us) server_negotiation.cc:407] Connection header received
0812 00:06:20.296734 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:20.296735 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:20.296747 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:20.296778 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:20.297146 (+ 368us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42124: BlockingRecv error: recv got EOF from 127.0.0.1:42124 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260812 00:06:20.303769 20104 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:06:20.302852 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42128 (local address 127.11.206.125:38479)
0812 00:06:20.302891 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:20.302893 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:20.303200 (+ 307us) server_negotiation.cc:407] Connection header received
0812 00:06:20.303300 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:20.303301 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:20.303313 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:20.303341 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:20.303713 (+ 372us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42128: BlockingRecv error: recv got EOF from 127.0.0.1:42128 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260812 00:06:20.314131 20104 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:06:20.313116 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42130 (local address 127.11.206.125:38479)
0812 00:06:20.313159 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:20.313162 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:20.313521 (+ 359us) server_negotiation.cc:407] Connection header received
0812 00:06:20.313645 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:20.313647 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:20.313659 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:20.313689 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:20.314072 (+ 383us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42130: BlockingRecv error: recv got EOF from 127.0.0.1:42130 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260812 00:06:20.332636 20104 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:06:20.331611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42140 (local address 127.11.206.125:38479)
0812 00:06:20.331660 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:20.331663 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:20.332014 (+ 351us) server_negotiation.cc:407] Connection header received
0812 00:06:20.332119 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:20.332121 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:20.332134 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:20.332164 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:20.332573 (+ 409us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42140: BlockingRecv error: recv got EOF from 127.0.0.1:42140 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260812 00:06:20.367163 20104 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:06:20.366252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42148 (local address 127.11.206.125:38479)
0812 00:06:20.366298 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:20.366300 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:20.366591 (+ 291us) server_negotiation.cc:407] Connection header received
0812 00:06:20.366689 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:20.366690 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:20.366702 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:20.366728 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:20.367104 (+ 376us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42148: BlockingRecv error: recv got EOF from 127.0.0.1:42148 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260812 00:06:20.433187 20104 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:06:20.432608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42154 (local address 127.11.206.125:38479)
0812 00:06:20.432690 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:20.432692 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:20.432738 (+ 46us) server_negotiation.cc:407] Connection header received
0812 00:06:20.432785 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:20.432786 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:20.432797 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:20.432859 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:20.433138 (+ 279us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42154: BlockingRecv error: recv got EOF from 127.0.0.1:42154 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
W20260812 00:06:20.563061 20104 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:06:20.562411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42166 (local address 127.11.206.125:38479)
0812 00:06:20.562460 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:20.562462 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:20.562603 (+ 141us) server_negotiation.cc:407] Connection header received
0812 00:06:20.562663 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:20.562663 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:20.562675 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:20.562712 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:20.562998 (+ 286us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42166: BlockingRecv error: recv got EOF from 127.0.0.1:42166 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260812 00:06:20.820999 20104 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:06:20.820340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42168 (local address 127.11.206.125:38479)
0812 00:06:20.820408 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:20.820410 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:20.820422 (+ 12us) server_negotiation.cc:407] Connection header received
0812 00:06:20.820494 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:20.820495 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:20.820507 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:20.820553 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:06:20.820935 (+ 382us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42168: BlockingRecv error: recv got EOF from 127.0.0.1:42168 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
I20260812 00:06:21.163614 20267 catalog_manager.cc:1259] Loaded cluster ID: 3484a481d53c4005801bcd808f3c83c8
I20260812 00:06:21.163694 20267 catalog_manager.cc:1552] T 00000000000000000000000000000000 P e00692bcaa7146ddaeaa2b440801f43b: loading cluster ID for follower catalog manager: success
I20260812 00:06:21.164490 20267 catalog_manager.cc:1574] T 00000000000000000000000000000000 P e00692bcaa7146ddaeaa2b440801f43b: acquiring CA information for follower catalog manager: success
I20260812 00:06:21.164798 20267 catalog_manager.cc:1602] T 00000000000000000000000000000000 P e00692bcaa7146ddaeaa2b440801f43b: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 00:06:21.239945 20335 catalog_manager.cc:1259] Loaded cluster ID: 3484a481d53c4005801bcd808f3c83c8
I20260812 00:06:21.240032 20335 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 36cb8ff01c284b9ab3dd73dd44492a39: loading cluster ID for follower catalog manager: success
I20260812 00:06:21.240854 20335 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 36cb8ff01c284b9ab3dd73dd44492a39: acquiring CA information for follower catalog manager: success
I20260812 00:06:21.241165 20335 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 36cb8ff01c284b9ab3dd73dd44492a39: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 00:06:21.336655 20454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:21.334178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42184 (local address 127.11.206.125:38479)
0812 00:06:21.334294 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:21.334297 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:21.334307 (+ 10us) server_negotiation.cc:407] Connection header received
0812 00:06:21.334336 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:21.334337 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:21.334398 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:21.334466 (+ 68us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:06:21.334615 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:21.335132 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:21.335892 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:21.336095 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:21.336149 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:21.336307 (+ 158us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:06:21.336424 (+ 117us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:06:21.336493 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:21.336539 (+ 46us) server_negotiation.cc:299] Negotiation successful
0812 00:06:21.336567 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92,"thread_start_us":51,"threads_started":1}
I20260812 00:06:21.340734 20469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:21.338417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56736 (local address 127.11.206.124:42825)
0812 00:06:21.338531 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:21.338533 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:21.338540 (+ 7us) server_negotiation.cc:407] Connection header received
0812 00:06:21.338582 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:21.338583 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:21.338621 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:21.338692 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:06:21.338796 (+ 104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:21.339299 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:21.340008 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:21.340230 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:21.340283 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:21.340421 (+ 138us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:06:21.340528 (+ 107us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:06:21.340595 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:21.340632 (+ 37us) server_negotiation.cc:299] Negotiation successful
0812 00:06:21.340652 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92,"thread_start_us":51,"threads_started":1}
I20260812 00:06:21.345052 20469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:21.342340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56746 (local address 127.11.206.124:42825)
0812 00:06:21.342432 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:21.342434 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:21.342516 (+ 82us) server_negotiation.cc:407] Connection header received
0812 00:06:21.342595 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:21.342596 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:21.342606 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:21.342660 (+ 54us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:06:21.342800 (+ 140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:21.343528 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:21.344346 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:21.344626 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:21.344678 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:21.344801 (+ 123us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:06:21.344830 (+ 29us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:06:21.344872 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:21.344965 (+ 93us) server_negotiation.cc:299] Negotiation successful
0812 00:06:21.344986 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260812 00:06:21.345085 20484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:21.342287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32868 (local address 127.11.206.126:34711)
0812 00:06:21.342422 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:21.342424 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:21.342549 (+ 125us) server_negotiation.cc:407] Connection header received
0812 00:06:21.342602 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:21.342603 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:21.342642 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:21.342721 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:06:21.342847 (+ 126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:21.343336 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:21.344309 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:21.344553 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:21.344621 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:21.344783 (+ 162us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:06:21.344888 (+ 105us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:06:21.344948 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:21.344992 (+ 44us) server_negotiation.cc:299] Negotiation successful
0812 00:06:21.345013 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":53,"threads_started":1}
I20260812 00:06:21.345557 20454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:06:21.342328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42194 (local address 127.11.206.125:38479)
0812 00:06:21.342366 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0812 00:06:21.342368 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 00:06:21.342462 (+ 94us) server_negotiation.cc:407] Connection header received
0812 00:06:21.342521 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:06:21.342522 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:06:21.342533 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:06:21.342584 (+ 51us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:06:21.342811 (+ 227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:21.343533 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:21.344537 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:06:21.344810 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:06:21.344867 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:06:21.345012 (+ 145us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:06:21.345044 (+ 32us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:06:21.345072 (+ 28us) server_negotiation.cc:1035] Waiting for connection context
0812 00:06:21.345466 (+ 394us) server_negotiation.cc:299] Negotiation successful
0812 00:06:21.345491 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 00:06:21.347038 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 19841
I20260812 00:06:21.371273 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 19982
I20260812 00:06:21.384788 12089 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksssay4/build/release/bin/kudu with pid 20109
2026-08-12T00:06:21Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (2992 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (5949 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (281420 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST